Smart Home Automation: Gesture Recognition via RNN

This is the wrong direction.

detect hand movements in real time.

But you still want me to use my hands for communicating?

No!

I do not want to make funny motions in thin air. That's even worse than talking to a machine.

A good automation is the one that knows what I want, and what I need, without me explaining it.

For the rest, I prefer to push buttons and turn knobs.