Inspiration
The idea comes to our mind while talking with Logitech about their disruptive new lineup of products.
What it does
Our pice of code is capable of analyzing images from the webcam and detect a human face, track eyes and mouth to estimate the level of stress and fatigue of the user and suggest him/her to take a break to increase productivity or learn a better way to complete a job like using our system of shortcuts (by sending user notifications on their system).
How we built it
We used the opensource library OpenCV that provided us with pre-trained models to recognize the user's face. We worked with Python to design our own algorithm to detect yawnings and blinkings and calculate the level of fatigue of the user. We worked in parallel on key detection and short-cuts personalization using LabView that allow us to create an executable that is intuitive and with a simple user interface.
Challenges we ran into
The main challenge is learning how to set up the project to use Logitech API, how to create a well-performed face detection program that can detect correctly and fast in a real-time scenario.
Accomplishments that we're proud of
We created a very stable and good real-time face recognition system and a great program that offer a totally different experience in line with Logitech products.
What we learned
What's next for FlashDev
Our vision for this software product is to be implemented in all operating systems in order to give the freedom to the user to create great personalized short-cuts and to improve quality of life by reducing stress and prostration. Moreover, we want to leverage the built-in proximity sensor of the MX keys plus keyboard (unfortunately it is not publicly available yet) to increase the productivity of the user in terms of input/time.
Log in or sign up for Devpost to join the conversation.