hand gesture detection server with tfjs and websocket

🖐️ Gesture-Based WebSocket Server (Electron & WebSocket)

This repository provides a WebSocket server built with Electron.js, allowing real-time hand gesture recognition to communicate with other applications. It is designed to work alongside gestureboard-combines-gestures-with-keyboard-control via WebSocket.

✨ Features

✅ WebSocket Communication – Sends real-time hand gesture data to connected clients
✅ Electron-Based UI – Runs inside an Electron app with a graphical interface
✅ Gesture Recognition – Receives gesture data from MediaPipe HandLandmarker
✅ Works with GestureBoard – This server communicates with gestureboard-combines-gestures-with-keyboard-control
✅ Cross-Platform – Works on Windows, macOS, and Linux

---

🚀 How It Works

1. The WebSocket server runs on ws://localhost:8081.
2. GestureBoard detects hand gestures using MediaPipe HandLandmarker.
3. Gesture data is sent to this WebSocket server.
4. The WebSocket server forwards the gesture data to connected clients.
5. The connected app (e.g., gestureboard-combines-gestures-with-keyboard-control) maps gestures to keyboard inputs.

---

🛠️ Installation & Setup

1️⃣ Clone this repository

git clone https://github.com/itsyuimorii/YOUR_REPO_NAME.git



https://medium.com/@azer.maslow/creating-desktop-applications-with-electron-and-react-b7f81f78c9d5
https://github.com/ahmed-0egy/Hand-Gesture-Recognition-for-Cursor-Controlling
https://github.com/charliegerard/hand-control-figma-plugin/tree/main/figma-plugin-hand-control
https://x.com/adispezio/status/1440153362872221701
https://charliegerard.dev/blog/hand-control-ui-figma-plugin/
https://github.com/tensorflow/tfjs-models/tree/master/hand-pose-detection/src/tfjs