GhostAI

Inspiration

GhostAI was inspired by the need to create a better way for users to consume news and social media. Traditional platforms often present biased, cluttered, or overwhelming feeds. With SambaNova Cloud's lightning-fast inference speed and powerful AI models, we saw an opportunity to create a platform that delivers real-time, personalized, and balanced content. This was the perfect alignment of timing, technology, and innovation.

What it does

GhostAI transforms news into dynamic, AI-generated social media posts. Users can customize their experience by selecting preferred categories or searching for keywords, generating real-time feeds tailored to their interests. Each post provides for and against arguments, ensuring balanced perspectives. GhostAI is built to offer a seamless, engaging, and informative social media experience. Also the ai agent will comment on your post either searching relative resources or from basic understanding.

How We Built It

GhostAI was developed using Meta-Llama 3.1-70B, hosted on SambaNova Cloud, to deliver a dynamic and engaging social media experience. Here’s how it works:

Real-Time News Integration: The system fetches live news tailored to user preferences or keyword searches. AI-Powered Post Generation: News articles are processed by the LLM to create concise, engaging posts formatted for social media. Personalized Feed: Posts are displayed in a dynamic feed that updates continuously as the user interacts with the app. Seamless Processing: SambaNova Cloud’s OpenAI-compatible APIs provide rapid integration and high-speed performance for real-time responses. In addition, GhostAI features a Commenter AI Agent that enhances user interactions:

Triggering Comments: When a user creates a new post, an edge function activates a ReAct-based AI agent (Reinforcement Learning with Action and Thought). Dynamic Analysis: The AI agent evaluates the post to determine if external context or additional research is needed: If external context is required, the agent triggers a Google Search API to gather relevant information. Search results are processed to create meaningful, social media-style comments. Automated Comment Generation: Comments, whether derived from external search or internal reasoning, are stored in the database as replies to the user’s post. This architecture ensures that both posts and comments are dynamically generated, contextually relevant, and personalized, creating a seamless and intelligent user experience.

Challenges we ran into

Designing the app to handle high user loads and diverse news sources while maintaining speed and reliability.

Accomplishments that we're proud of

Successfully deploying a real-time social media platform powered by a 70B-parameter LLM. Achieving balanced and unbiased content generation, a critical step for fostering informed decision-making. Building a seamless, user-friendly interface that delivers dynamic feeds powered by AI. Leveraging SambaNova Cloud to demonstrate the potential of lightning-fast AI inference.

What we learned

Harnessing AI Models: Working with large language models to generate contextually accurate and engaging content. The Power of Speed: SambaNova Cloud’s speed unlocked possibilities for real-time applications that weren’t feasible before. User-Centric Design: Balancing technical innovation with intuitive user experiences is key to adoption.

What's next for Ghost AI

Adding features for real-time sentiment tracking and content curation.

Built With

• deno
• giphy
• google-custom-search-engine
• sambanova.ai
• supabase
• vuejs