MIT Media Lab Foodcam Bot

Intro

I did my Master's thesis in the Biomechatronics group at the MIT Media Lab. There are a lot of events at the Media Lab, and leftover food is always placed in the same spot with a webcam pointed at it. After the food is placed there, a button is pressed, and everybody gets a notification that there is food available. This of course starts a race for the food, and the first people to arrive get the best pickings.

To create a competitive advantage for me and my research group, I built a bot that continuously monitors the foodcam and sends a notification to a Slack channel when food is detected. Additonally, you can select the food you are interested in and the bot will notify you when it is detected.
Slack application description page.

Software

The bot is based on the slack API and a Vision Transformer pre-trained on ImageNet-21k and finetuned on the food-101 dataset.