Inspiration
We noticed that learning American Sign Language (ASL) can be challenging, especially with the limited engaging resources available. Music is something that brings people together, so we wanted to create a fun and interactive way to help people learn ASL through songs.
What We Learned
- Syncing visuals with audio β We explored JavaScriptβs
timeupdateevent to ensure ASL signs appeared at the right moments in a song. - Dynamic DOM updates β Instead of constantly replacing elements, which caused lag, we found better ways to update the ASL visuals efficiently.
- Performance optimization β We learned that too many changes at once can slow things down, so we fine-tuned our approach to make everything run smoothly.
How We Built It
- HTML & CSS β Structured the audio player and ASL display area.
- JavaScript β
- Created an array to store lyrics, timestamps, and matching ASL GIFs.
- Used
audio.addEventListener("timeupdate", updateGifs)to switch signs at the right time. - Optimized GIF updates to reduce unnecessary changes and improve performance.
- Created an array to store lyrics, timestamps, and matching ASL GIFs.
Challenges We Faced
- Getting the GIFs to sync perfectly with the lyrics took a lot of fine-tuning.
- Frequent updates caused lag, so we adjusted our approach to minimize unnecessary changes.
- Some GIFs were misaligned or too large, so we dynamically adjusted their size and placement for a better user experience.
Whatβs Next?
- Letting users choose their own songs for ASL translation.
- Using AI to generate ASL translations automatically.
- Making transitions between GIFs smoother for a more natural feel.
This project brought together music, accessibility, and coding, turning ASL learning into something fun and engaging.
Log in or sign up for Devpost to join the conversation.