Bear Escape

• 

  Title/ start screen

• 

  Select game mode

• 

  Song select and multiplayer lobby creatio

• 

  Single player

• 

  Multiplayer (Guitar and drums)

• 

  Drums, uses webcam to detect drumming motions, for guitar, detects star power (lifting controller above shoulders)

• 

  End screen - accuracy, grade, score

Inspiration

This game is inspired by our shared love for rhythm games and the joy of making games interactive. We also drew inspiration from the beauty of Ithaca and the amazing BigRed hackathon community and organizers.

What it does

Bear Escape is a rhythm game with the theme of “saving the bears.” Players hit notes in time with music to keep the bears safe. The game has the following two modes:

• Single Player: Use a guitar controller to play four lanes of notes.
• Multiplayer: One player uses the guitar while another plays drums through OpenCV motion detection, competing in real time.

How we built it

We split the work into clear tracks: two teammates focused on OpenCV drum detection, one on building the game UI, and one on integrating Gemini AI for chart generation. After building each part independently, we merged everything into one system, debugging together until the whole game ran smoothly.

Challenges we ran into

• Wrestling with Git version control (pull, merge, push).
• Getting Gemini AI to generate chart files in a consistent, playable format.
• Making multiplayer work: designing the lobby, syncing gameplay, and showing live scores for both players.

Accomplishments that we're proud of

• We built a full rhythm game in just 36 hours
• The game is fun, playable, and showcases both AI and computer vision.
• And it’s not just bearly running

What we learned

• How to collaborate under tight deadlines.
• How to integrate AI and CV into a game pipeline.
• The importance of supporting each other and debugging as a team.

What's next for Bear Escape

We’d love to expand Bear Escape with more features: difficulty levels, more instruments, dynamic visual effects, and refined chart generation-- especially for the drum instrument independently. Eventually, we’d like to make it a community game where players can upload songs, generate their own charts with AI, and compete online to keep saving the bears!

Built With

• gemini
• opencv
• python
• react
• rust
• spacetimedb
• three.js
• typescript
• vercel
• vite