Opilot

• 

  The sidebar includes the chat, and can be toggled on and off using the Copilot icon on the statusbar

Inspiration

I've seen previews of Microsoft's Copilot and how convenient it was to have AI included into your sidebar, but unfortunately, this was only available for Windows 11 users, as well as being non extensible since it doesn't expose any API endpoints.

What it does

It's a cross-platform desktop shell that replaces your default status bar on Windows or Linux, and comes with an Gemini assistant capable of some tasks, including: Chatting, Web search, Scheduling, Opening applications and files.

How we built it

I used Tauri for a desktop native platform, Nextjs, TailwindCSS and the Node.js Gemini SDK for Gemini integration.

Challenges we ran into

Integrating the Node.js backend through the Rust backend was kinda painful because I didn't add types to each of my outputs, meaning I was constantly error checking. Also, streaming the AI output turned out to be impossible due to being unable to efficiently pass through a stream object to a frontend.

Accomplishments that we're proud of

Getting a Windows lookalike statusbar Scheduing Integration with window capture

What we learned

I learnt a lot about the Tauri, Gemini SDK and specifically it's image generation capabilities.

What's next for Opilot

More integrations, toggling existing integrations on and off, and a more powerful scheduling system.

Built With

• gemini
• next
• node.js
• react
• rust
• tauri
• typescript