<<<<<<< HEAD
A touchless typing system that uses computer vision and hand tracking to simulate keyboard input.
- Virtual QWERTY Keyboard: On-screen keyboard with visual feedback
- Hand Tracking: Real-time finger position detection using MediaPipe
- Touchless Typing: Type without physically touching a keyboard
- Visual Feedback: Key highlighting and animations
- Responsive Performance: 15+ FPS tracking and <100ms typing latency
- Python 3.8+
- Webcam (720p or above recommended)
- Windows/macOS/Linux
- Clone this repository
- Install dependencies:
pip install -r requirements.txt
Run the main application:
python virtual_keyboard.py- Index Finger: Point to keys to type
- ESC: Exit the application
- Space: Toggle keyboard visibility
- Hand Detection: MediaPipe tracks your hand landmarks in real-time
- Finger Tracking: Index fingertip (landmark 8) is tracked for key interaction
- Key Detection: When your finger overlaps a virtual key, it highlights
- Typing Logic: Press detection uses depth/movement logic to confirm intent
- Input Simulation: Valid presses are converted to actual keystrokes
Edit config.py to customize:
- Keyboard layout and positioning
- Tracking sensitivity
- Visual appearance
- Performance settings
virtualkeyboard/
├── virtual_keyboard.py # Main application
├── keyboard_layout.py # Keyboard UI and layout
├── hand_tracker.py # MediaPipe hand tracking
├── input_simulator.py # Keystroke simulation
├── config.py # Configuration settings
├── requirements.txt # Dependencies
└── README.md # This file
- Ensure good lighting for hand tracking
- Keep hands within camera view
- Maintain 30-60cm distance from camera
- Use a solid background for better tracking
- Multi-language keyboard layouts
- Gesture controls (space, backspace, shift)
- Calibration wizard
- Typing analytics and training
- VR/AR integration
origin/main