Inspiration
We were inspired by the music Youtuber community who try to make it easier for people to learn music and enjoy it, so we tried a different approach to this.
What it does
This is a online music learning software for people to learn and compose music without needing an instrument, and without spending any money, even allowing them to play music with their "band".
How we built it
We used Mediapipe, Streamlit and Python to load the models and to test what the user is doing as well as getting the HTML part to link with the Streamlit server.
Challenges we ran into
The Mediapipe model was really slow and as a result, couldn't originally process most of our movements, leading to less than half of the notes being actually played.
Accomplishments that we're proud of
We're proud of the accurate detection of fingers and the way that the music produced by our movements is accurate for each notes, and that the drums can be used at a decent pace; and you can connect to a client laptop to play as a band.
What we learned
We learned how to deal with camera and resolution issues when dealing with something that requires speed and accuracy.
What's next for Crowd Cast
We'd like to add more songs and instruments and link the app to a domain to connect to other computers differently.
Built With
- css3
- html5
- javascript
- mediapipe
- opencv
- web-audio-api
Log in or sign up for Devpost to join the conversation.