Gestured Controlled Apps

Inspiration

Joy in Building Applications

What it does

It Opens and Closes applications using hand gestures for example, if we show 1 - it will open chrome(can be changed) 2-it will open Itunes etc till 4 and for 5 fingers it would close all and for you can repeat this cycle

How we built it

We built it using python as our main language, used OpenCV, Mediapipe, and some inbuilt modules in python

Challenges we ran into

Ran into many challenges a few major ones are mentioned below

----The output for this code was continuos Like if it detects 1 finger it gives 111111111111..... until you change the number of fingers so it would open (finger*no of times it repeated itself)*Chrome.exe So it would open many applications of Chrome

Solution)

-The first approach to solve this problem was to check if the application is already running using psutil and check the task manager by iterating through all the running applications, It was working but due to greater time complexity it would start to lag

-Solved it using dictionaries, the concept was if the application was opened then pop it from the dictionary so even if it tries to find it would get an error, and capture that error as an exception

---- For closing the application the module subprocess requires only the name of the application(chrome.exe) and not its path(C:\Program Files\Google\Chrome\Application\chrome.exe") Solution) -used regular expressions from re module to filter out only the required pattern

Accomplishments that we're proud of

Was built in 1 day

What we learned

Learned a lot about Having control of OS over code Expanded my knowledge about Opencv and other modules

What's next for Gestured Controlled Apps

Making an application out of it which can work efficiently in every Operating System It Opens Many opportunities in Robotics fields/Drones to control robots by Gestures of hands

Built With

• mediapipe
• opencv
• python