Detecting Hand Gestures from camera motion events

Questions & Help
1

Hi

I came across this AI library at work. Guia de tarefas de reconhecimento de gestos  |  Google AI Edge  |  Google AI for Developers

I was wondering if you could use this library to achieve the equivalent of Aqara G3 camera which has built-in hand gesture detection ?

Demo of usage : https://mediapipe-studio.webapps.google.com/demo/gesture_recognizer

I was wondering if this could be used to capture gestures via camera and get that to trigger a homey event. I was thinking if there is a Face++ App ( Face++ App for Homey | Homey ) for homey that detects faces then why not use do something similar to capture hand gestures .

Would this work ? What problems would I come across?

John

2

The issue is recognising hand gestures requires monitoring motion and Homey can only capture still images at a low rate.

Maybe in the future, the Homey 2023 will be able to do that, but not sure if it has the processing power to analyse it.