The title of my project

Interactive GUI to teach programming using computer vision

Please watch the below video for a short demo

Procedure: I created a CSV file with questions and choices for that question then the CSV file was taken as input using python. Question and options are displayed on the screen using the computer vision module. The media pipe hand module is used to track the hand and show the key points of the hand. I took the 8th and 12th key points from the media pipe hand module from all the key points (You can view all the key points and modules here). Then I considered the distance between the 8th and 12th key points. Once the distance is small between these key points and overlaps on the boxes created by computer vision, that option is selected. I have created an empty window with information related to that choice, so this window opens and shows the information once the option is selected.

Future work: I plan to show an avatar showing the American sign language translation when selecting that option.