Measure and Improve Your Food: Ingredient Estimation Based Nutrition Calculator

Liangyu Wang, Yoko Yamakata, Ryoma Maeda, Kiyoharu Aizawa

Abstract: We developed an application that can easily calculate the nutritional content of a meal by utilizing our multimedia recipe dataset tied to the Nutrition Facts table and an ingredient estimation model. A CLIP-based image recognition model and an ingredient co-occurrence graph assist a user in selecting the appropriate ingredient from over 2,500 ingredients. Unlike traditional food applications, ours calculates nutrition from a list of ingredients, allowing the user to see how each ingredient affects the overall nutrition. The user adjusts the amount of each ingredient and knows how to change their meal to meet their body's needs.