Remorize

Organize your daily conversations with AI

Comment

Inspiration

Having to note down and memorize everything in your day is a tedious task and creates a chance for miscommunication and misunderstanding, thus came the utility for remorize where we handle all your daily audio data to simplify your day.

What it does

Remorize is an end-to-end platform that uses a mini mic to track your daily audio activity to automate and simplify your life in many ways:

1. Hourly notes / action items list

Remorize creates an hourly dashboard for your audio as notes and action items to complete throughout your day.

2. Google Calendar integration

Remorize automatically adds any discussed event to your Google Calendar to keep you in track of what's going on.

3. Email drafts

Remorize prepares an email draft for you based on the audio context to copy and modify as per your requirements.

4. Pinecone Vector DB

Remorize stores all your audio memories in a vector database and then performs context retrieval to feed the context to your mobile as and when you're speaking in a previously relevant conversation.

How I built it

  • Mobile Frontend : Android Studio, Java and Speech Recognition API
  • Server : Python, GPT-4, Flask, APScheduler, ngrok
  • Web Frontend : Next.js, React.js, TailwindCSS, ReactMarkdown
  • Database : SQLite, Pinecone, DB Browser - sqlite

Challenges I ran into

  • Making sure the LLM does not hallucinate by using precise prompt engineering
  • Setting up the mini microphone as an audio device

Accomplishments that I'm proud of

  • Setting up the entire audio-to-text pipeline via the user's phone as a gateway to the server
  • Making a seamless backend infrastructure to create notes, action items and setting up calendar events
  • Making all of these features in <36 hours

What I learned

  • API and microservices architecture
  • Database management using sqlite

What's next for Remorize

  • Enhanced Speech Recognition : We aim to improve the accuracy and responsiveness of the speech recognition system by integrating more advanced AI models. This will help in better understanding diverse accents and dialects.
  • Offline Capabilities : We plan to develop offline functionalities that will allow users to access features of Remorize without an internet connection, making it more versatile in various settings.

Built With

Share this project:

Updates