Inspiration

We were inspired by the music Youtuber community who try to make it easier for people to learn music and enjoy it, so we tried a different approach to this.

What it does

This is a online music learning software for people to learn and compose music without needing an instrument, and without spending any money, even allowing them to play music with their "band".

How we built it

We used Mediapipe, Streamlit and Python to load the models and to test what the user is doing as well as getting the HTML part to link with the Streamlit server.

Challenges we ran into

The Mediapipe model was really slow and as a result, couldn't originally process most of our movements, leading to less than half of the notes being actually played.

Accomplishments that we're proud of

We're proud of the accurate detection of fingers and the way that the music produced by our movements is accurate for each notes, and that the drums can be used at a decent pace; and you can connect to a client laptop to play as a band.

What we learned

We learned how to deal with camera and resolution issues when dealing with something that requires speed and accuracy.

What's next for Crowd Cast

We'd like to add more songs and instruments and link the app to a domain to connect to other computers differently.

Built With

Share this project:

Updates