Gesture Controlled OS

Team SpongeBob

Gesture Controlled Virtual Mouse makes human-computer interaction simple by utilizing Hand Gestures. The computer requires almost no direct contact, and all input/output operations can be virtually controlled using static and dynamic hand gestures. This project leverages state-of-the-art Machine Learning and Computer Vision algorithms to recognize hand gestures and voice commands, providing smooth interaction without any additional hardware requirements. It consists of two modules: one which directly works on hands using MediaPipe Hand detection, and the other which makes use of gloves of any uniform color. Currently, it works on the Windows platform.

Future Applications

1. Hospital Surgery Room: Surgeons can control vital monitors for patients' data history without contaminating gloves, ensuring a sterile environment during surgeries.
2. Billing & Restaurant Kiosks: Users can navigate through billing kiosks in public spaces without physically touching the screen, enhancing hygiene and reducing the spread of germs.
3. Car Infotainment System: Drivers and passengers can control various functions of the car's infotainment system through hand gestures, allowing for safer and more convenient operation while driving.

Features included:

• Hand gesture enabled mouse control, with clicks
• Select and drag elements
• Volume controls
• Screen scroll
• Demo Shopping interface Here
• Powerpoint controls Here

Frameworks, Libraries, and Technologies Used

• 
• 
• 
• 
• 
• 
• 
• 

Instructions for Running

To run the Gesture Controlled OS, follow these steps:

1. Ensure you have all necessary libraries installed (MediaPipe, OpenCV, PyAutoGUI, etc.).
2. Clone the repository to your local machine.
3. Run the workingmodel.ipynb to run the main code with all the features gestures.
4. Navigate to PowerPoint/ and run powerpoint.py to enable the gesture features for ppt presentations.
5. Position your hands in front of the camera and perform gestures to control the OS.
6. Run DragDrop.html inside Shopping/src for a sample kiosk setup, to test the gestures

Contributors

This project was developed by Team Spongebob during Technica24 at VIT Vellore.

• Vijay Varadarajan
• Santhosh Kumar S P
• Goutham Kurapati
• Gokul

For any inquiries or issues, please contact santhoshkumarsp222004@gmail.com .