Build Self Checkout Machine & Virtual Keyboard with OpenCV

Learn how to build self checkout machine and virtual keyboard using OpenCV, CNN, Keras, Tkinter, and MediaPipe

Created by: Christ Raharja
Ex Technology Risk Consultant, and E-commerce enthusiast

What Will I Learn?

• Learn how to build self checkout machine using OpenCV and Tkinter
• Learn how to build virtual keyboard using OpenCV, Tkinter and MediaPipe
• Learn how to train self checkout model using Convolutional Neural Networks and Keras
• Learn how to integrate virtual keyboard to self checkout machine
• Learn how to create training data consisting of product images and products informations like product ID, product name, price, and discount
• Learn how to create function to load product images from training data
• Learn how to create function to detect object and recognize product
• Learn how to create function for payment processing simulation
• Learn how to design custom virtual keyboard layout
• Learn how to integrate hand tracking and detection system to virtual keyboard
• Learn how to design simple graphical user interface and create button using Tkinter
• Learn about self checkout machine and retail automation, such as getting to know its use cases, technical limitations, and technologies that will be used
• Learn how self checkout machines work. This section covers training data creation, preprocessing, model training, product scanning, extracting product details
• Learn about virtual keyboard and how this technology enables users to type in using finger movement without physically touching the keyboard
• Learn how to activate webcam using OpenCV
• Learn how to conduct performance testing on self checkout machine and virtual keyboard

Requirements

• No previous experience in computer vision is required
• Basic knowledge in Python and object detection

Target audience

• People who are interested in building self checkout machine and virtual keyboard using OpenCV and MediaPipe
• People who are interested in leveraging computer vision and object detection for retail automation