MiniCPM-V 4.7 35B-A3B 搭配 ESP32 屏幕做拍照记录热量的演示项目
OpenBMB 社区用 MiniCPM-V 4.7 拍照识菜估热量，再让 ESP32 圆屏用进度环显示每天吃剩多少额度。流程拆得很细，识别结果要人工确认才入账。想玩视觉模型加硬件的可以照着搭。
OpenBMB 的 ambassador emwstudio 发布了 esp32-intake 演示项目，用 MiniCPM-V 4.7 35B-A3B 模型拍照识别食物并估算热量，配合 iOS 应用和 ESP32-S3 AMOLED 圆形屏幕使用。模型通过 ModelBest API 在线运行，ESP32 只负责本地显示。
工作流程是：拍照后模型识别食物并给出热量估算，用户在加入每日总热量前可以确认、重新估算或跳过，还能预览这顿饭对当日目标的影响。应用把当天热量总数通过本地 Wi-Fi 发送到 ESP32-S3 屏幕，屏幕上用进度环、剩余热量数字和绿黄红三种状态颜色展示摄入情况。
热量估算为近似值，仅供一般参考。该项目代码开源，MiniCPM-V 模型也在 GitHub 和 Hugging Face 上开放，适合想动手把多模态模型接到硬件上的开发者参考。
📸 Snap your meal. Review the estimate. See your daily intake at a glance.
Our ambassador @emwstudio built esp32-intake, a food-logging demo that connects MiniCPM-V’s visual understanding with an iOS app and a circular ESP32 display. 🍽️
Here’s the workflow: 🧠 MiniCPM-V 4.7 35B-A3B identifies food in a photo and estimates calories through the ModelBest API. ✅ You review the estimate before adding it to your daily calorie total. Re-estimate or skip it, with a preview of how the meal would affect your daily target. 📊 The app stores today’s calorie total locally and sends the total and daily target over the local Wi-Fi network to an ESP32-S3 AMOLED display. 🟢🟡🔴 A progress ring, calories remaining — or over target — and matching status colors make the day’s intake easy to check.
The model runs online via API; the ESP32 handles the display. Calorie estimates are approximate and intended for general reference.
We love seeing our ambassadors turn visual intelligence into hands-on experiences that connect software, hardware, and everyday routines. 💙
🛠️ Explore @emwstudio’s project: https://t.co/oIQp6fQCXV 🚀 MiniCPM-V GitHub: https://t.co/iYDxpa52tn 🤗 Model on Hugging Face: https://t.co/Lwu8eW4QbF
#MiniCPM #OpenBMB #ESP32 #OpenSource
This report is categorized under AITOP's "Products" desk, focusing on China's AI industry and domestic foundation model ecosystem. Within our cross-regional analytical framework, it directly maps to AI developer toolchains, coding agents, and engineering workflows. Key entities and technical topics under continuous tracking include MiniCPM-V, OpenBMB, ESP32, 多模态.
Source attribution: curated from OpenBMB (@OpenBMB).
