Whirlpool Corporation, headquartered in Benton Harbor, Michigan is a global home appliance manufacturer with approximately $17 billion in annual sales, 40 manufacturing and research centers, and 44,000 employees. Whirlpool’s mission is to improve satisfaction and engagement with its home appliances.

Buying groceries is a common chore that consists of tedious planning. However, items get lost in the fridge from time to time. This results in food waste and repurchasing of food, which hurts the buyer’s budget and creates the stress of needing to manually track groceries.

Our Intelligent Recognition and Inventory System mitigates this problem by providing an automated up-to-date inventory with the fridge’s contents and a history of recent groceries that have been added or removed from the fridge.

When a user opens the fridge, a camera scans and identifies the product in the user’s hand. Our system determines whether the product is being placed in or removed from the fridge and updates the inventory accordingly.

Manual addition of grocery data is also supported. Any errors with the image recognition are tracked via the red flag icon in the table.

As the inventory is updated with current items in the fridge, the user sees a history of objects that were loaded or unloaded from the fridge. In addition, a video playback is accessible to the user to view the most recent groceries that have been either loaded or unloaded.

Our system reduces food waste and provides additional value to Whirlpool appliances.

The software is built with Flutter and Dart for the user interface with a Python and Firebase back end. Our software also utilizes YOLOv8 object detection model.