Build your own smart refrigerator that can track contents anytime, anywhere using Raspberry Pi and ChatGPT
Upgrading my Pi4 Smart Fridge with GTP4 Vision : r/raspberry_pi
https://www.reddit.com/r/raspberry_pi/comments/19epwtn/upgrading_my_pi4_smart_fridge_with_gtp4_vision/
Raspberry Pi smart fridge uses Chat GPT4 to keep track of your food | Tom's Hardware
https://www.tomshardware.com/raspberry-pi/raspberry-pi-smart-fridge-uses-chat-gpt4-to-keep-track-of-your-food
Reddit user mimobeano said that he was working on a project for his graduate school master's degree, ``research to understand what kind of food is in the refrigerator and use it before the expiration date.'' Initially, they used an object detection model learned from over 2,000 photos of the inside of the refrigerator and a camera to build a system that only works for 12 ingredients. However, it seems that further improvements have been made by using ChatGPT, which is based on GPT4.
The system created by mimobeano is below. A camera connected to Raspberry Pi is attached to the top of the refrigerator, and when you open the refrigerator door, you can take pictures of the inside.
The photo taken with the camera looks like this. Vegetables, fruits, and drinks are shown.
An object detection model analyzes the photos taken by the camera and determines whether there is food. Then, when Mr. Mimobeano sends a request with the command '/ingredients' through the messaging application Telegram, a list of foods that were photographed the last time they were photographed with the camera will be sent.
And when you use '/recipes', ChatGPT will suggest dishes that you can cook using what's currently in your fridge. According to mimobeano, OpenAI's API is only used when a request is sent on Telegram, so there is no cost.
mimobeano says he plans to create a mount for the camera with a 3D printer and take the project further. He also plans to add the original purpose of checking whether food is nearing its expiry date as a function.
Related Posts:
