Inspiration
The idea for AURA APP came from noticing how much creative energy and momentum is lost when you’re away from your laptop. Great ideas don’t only happen at a desk, so we wanted to build something that lets developers stay in flow anywhere. We were especially inspired by the idea of “vibe coding”, turning spontaneous thoughts and conversations into real code without needing a screen.
What it does
AURA APP is a voice-first developer tool that lets you speak code into existence. Using a pure audio interface, you can write, edit, and collaborate on code remotely from your phone or any device. It allows developers to stay productive on the go, turning voice input into real-time coding actions.
How we built it
We built AURA as a real-time voice pipeline that connects speech input to a remote coding environment. Audio is streamed, transcribed, interpreted, and converted into code changes that are applied remotely. The system is designed to be lightweight and hands-free, focusing on low latency and natural interactions so it feels conversational rather than command-based. Technologies Used: Swift UI, Trae, LiveKit, Gemini API, Eleven Labs, Ngrok, NodeJS.
Challenges we ran into
One of the biggest challenges was handling real-time audio reliably and making sure responses sounded natural. Synchronizing speech input, code generation, and audio feedback without noticeable lag took careful tuning. We also had to ensure the system could clearly distinguish between casual conversation and actual coding instructions.
Accomplishments that we're proud of
We’re proud that we built a fully working voice-to-code pipeline that runs in real time. AURA successfully allows users to code remotely using only their voice, without relying on a screen. Getting the audio interface to feel smooth and usable was a big milestone for us.
What we learned
We learned a lot about building real-time, audio-driven systems and how small latency or formatting issues can greatly affect user experience. More importantly, we learned how powerful voice-first interfaces can be when they’re designed around natural human behavior instead of rigid commands.
What's next for AURA APP
Next, we want to expand AURA’s capabilities by adding richer context awareness, better collaboration features, and deeper integration with development tools. Long term, we see AURA becoming an accessibility-first way for anyone to code, whether they’re multitasking, on the move, or simply want a more natural way to build software.
Built With
- livekit
- overshoot
- trae
Log in or sign up for Devpost to join the conversation.