MistralCommentator

Overview

MistralCommentator is an AI-powered football commentator that provides real-time analysis and commentary during football matches.

Features

• Utilizes Mistral models for advanced analysis.
• Integrates YOLO model for player and ball tracking.
• Operates on a Nebius server for real-time data processing.

How It Works

MistralCommentator processes live match data using YOLO to track players and the ball. It then utilizes Mistral models to analyze gameplay and provide commentary.

Installation

1. Clone the repository.
2. Install dependencies using pip install -r requirements.txt.
3. Set up Mistral API credentials.
4. Run the server using python -m streamlit run server.py.

Usage

• Access the MistralCommentator interface via a web browser.
• Input live match data for real-time analysis and commentary.

Challenges

• Transmitting match details in real-time to the Mistral model posed challenges.
• Fine-tuning YOLO for accurate player and ball tracking required significant effort.

Accomplishments

• Successfully deployed YOLO and Mistral models.
• Adapted data formats for Mistral input.
• Implemented prompt engineering techniques for enhanced performance.

What We Learned

• Fine-tuning large language models (LLMs).
• Utilizing YOLO for specific tasks in AI applications.

Next Steps

• Implement audio commentary feature for an immersive user experience.
• Enhance user interface for better usability.

Built With

• mistral
• nebius
• yolo