Skip to content
Logo Amsterdam University of Applied Sciences - link to home page
Project

Computer vision: Innovative technology for more conscious and healthier shopping behaviour

1 January 2025 - 31 December 2025

How can we help consumers make more conscious, healthier, and more sustainable choices while grocery shopping? With the innovative Situated Analytics Shopping Assistant (SASA), we combine advanced computer vision (CV) and augmented reality (AR) into a user-friendly smartphone application. SASA recognizes products in the supermarket, provides direct feedback about the recognition, and offers relevant information about nutritional values, health characteristics, and sustainability labels. The result? A shopping experience that contributes to a healthier life and a more sustainable world.

Goal of this project 

The goal of this project is to develop and test a prototype of a Situated Analytics Shopping Assistant (SASA). This innovative system focuses on: 

  • Health and sustainability advice: Transparent information about products to promote conscious purchasing choices. 

  • Reliable product recognition: Overcoming technical limitations in realistic supermarket conditions. 

  • User-friendly customer guidance: Designing an intuitive smartphone application that is directly applicable to customers. 

  • Technological innovation: Developing new knowledge and solutions in the field of computer vision and augmented reality. 

The project contributes to the societal transitions towards healthier nutrition and more sustainable consumer behavior, where technology plays a practical role in daily life. 

Methodology 

The project consists of the following phases: 

  • Research and analysis  

  • Inventory of technical challenges related to product recognition and AR applications. 

  • Study of consumer behavior and user experiences in the supermarket context, 

  • Development of the prototype  

  • Implementation of advanced computer vision technology for real-time product recognition. 

  • Integration of augmented reality for visual feedback, such as color markings and product information. 

  • Designing user-friendly instructions and interfaces for the SASA app. 

  • Practical test in a Jumbo supermarket  

  • The SASA system is tested in a realistic shopping environment. 

  • Evaluation of performance, customer experience, and technological reliability. 

  • Knowledge sharing and further development  

  • Analysis of test results and recommendations for further optimization. 

Team 

  • Tibert Verhagen 

Collaboration & Partners 

  • Amsterdam University of Applied Sciences (HvA): Research and educational institution with expertise in technology and innovation. 

  • 360Fabriek: High-tech SME specialized in immersive technology, such as augmented reality. 

  • Jumbo Bas Bobeldijk: Supermarket partner that facilitates the practical test environment and provides insights from the retail sector. 

  • KIEM Hightech (NWO-SIA): Funding partner that stimulates innovation and collaboration between knowledge institutions and companies.