AirControl

Use your computer like you use an Apple Vision Pro!



View Demo .

Table of Contents

• Table of Contents
• About The Project
  • Built With
• Getting Started
  • Prerequisites
  • Installation
  • Features
  • Notes
• Roadmap
• Contributing
• License
• Contact
• Acknowledgments

About The Project

The Apple Vision Pro introduced a novel type of computer-human interaction. Using hand gestures to control user interfaces was a method that was never seen before. This project brings this unique type of user interaction to normal computers, not just VR devices.

AirControl is designed to:

• Introduce hand gesture recgonition based user interaction to laptop and desktop computers
• Make workflows more efficient
• Improve accesibility for people who are not able to use mouses/keyboards

Built With

This project was built with the following technologies:

• Python
• pyautogui
• opencv
• mediapipe

Getting Started

Below are instructions on how to run this project locally.

Installation

Please follow the following steps for successful installation:

1. Clone the Repository: Get started by cloning the repository to your local machine.

   https://github.com/Ray0716/teenhacks-2025
   

2. Initialize virtual environment: Please run this command :

   python -m venv myenv
   

3. Activate venv: Run this command :

   source myenv/bin/activate

4. Install packages:

   • Run the following:

     pip install opencv-python && pip install pyautogui && pip install medaipipe

   Now, your AirControl App should be successfully up and running!

Features

• Wave hand to move cursor
• Pinch with thumb and index finger to click mouse
• Pinch & Drag with thumb and middle finger to drag mouse
• Make fist to show all applications

Notes

• When using this version of AirControl, make sure your entire hand is visible to the camera and is oriented orthagonally to the camera. (eg, it should see your palm clearly).
• When makign pinching gestures, sometimes rotating you hand slightly to the left helps. (to the right if you are using your left hand)
• If you are using your left hand, set the x-offset to 0.1 instead of -0.1.

Roadmap

The roadmap includes both completed and future goals. Here's what we have accomplished and looking forward to:

• stuff
• not stuff

We continue our commitment to improving and expanding the capabilities of makeread.me to provide an efficient and seamless AirControl experience to our users.

See the open issues for a full list of proposed features (and known issues).

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement". Don't forget to give the project a star! Thanks again!

License

Distributed under the Mozilla Public License 2.0 License. See Mozilla Public License 2.0 License for more information.

Contact

If you have any questions or suggestions, feel free to reach out to us: