Overview

Using Tensorflows Posenet library ive developed a game that uses pose detection to help teach kids how to use the semaphore flag system, reading their arm positions and working over multiple lessons The semaphore flag system is a system primarily used by scouts and sailors to send messages from afar using flags and outstretched arms where the angles of the arms represent letters and unique messages

Progress so far

Pose Detection

The Game can track your pose and play your webcam back to you without any special steps via pygame

Pose Analysis

The game can read and analyse the users pose and output the relevant letters

Interactive

The game is fully interactive utilising navigation and feedback all done via the webcam

Feedback

The game gives immediate feedback to the user to inform them how they are doing, if its correct/incorrect or giving feedback on what they are trying to spell