AI Communication Coach

The system now provides:

Voice Interaction:¶

• Real-time voice conversation with AI assistant
• Automatic greeting when you connect
• Natural language understanding and response
• Weather information for any city worldwide

Technical Features:¶

• Gemini 2.5 Flash with native audio I/O (no separate STT/TTS)
• WebRTC peer-to-peer audio streaming (low latency)
• Professional voice activity detection (Silero VAD)
• Function calling (AI can fetch real weather data from APIs)
• Multi-user session support
• Production-grade logging

User Experience:¶

• Real-time audio level visualization
• Clear conversation state indicators
• Automatic speech detection (knows when you're done speaking)
• Silence detection with helpful prompts

Documentation¶

• Complete documentation available in docs/:
• Task completion report
• Installation guide
• Architecture documentation
• All fixes documented with code examples
• Guide for switching to Communication Coach

Note: The Zip file is attached below. Switch to weather-app branch.
To run

1. Backend:

python -m venv venv
venv\Scripts\activate  # Windows
pip install -r requirements.txt
uvicorn app.main:app --reload --host 0.0.0.0 --port 8000

2. Configure
   Create a .env file and add GEMINI API KEY and OPEN WEATHER MAP API KEY

3. Frontend

cd frontend
npm install
npm run dev

Open http://localhost:3000

Expected Experience¶

• Click "Start Voice Session" button
• Allow microphone access when prompted
• Hear AI greet you: "Hello! I'm Aria, your weather assistant. I can help you check the weather in any city around the world..."
• Speak: "What's the weather in London?" or "How's the weather in Delhi right now?"
• See your microphone level at the bottom (green bar = good audio level)
• Wait ~2-3 seconds after speaking (AI detects you're done)
• Hear AI respond with current weather: "Currently in London, it's 15 degrees Celsius with partly cloudy skies..."
• Continue conversation naturally - ask about other cities!

Visual Feedback:¶

• Screen shows "🔊 AI is responding..." when AI speaks
• "✅ Listening - Speak now" when waiting for you
• "🎤 Recording your voice..." when you speak
• Audio level bar turns green when you're loud enough

Pipeline Flow¶

User Speech → Microphone → WebRTC → SmallWebRTC Transport
    ↓
Voice Activity Detection (Silero VAD)
    ↓
Context Aggregator (tracks user messages)
    ↓
Gemini Multimodal Live LLM
  - Understands speech
  - Calls functions if needed (get_weather)
  - Generates natural response
  - Converts to speech
    ↓
Transport Output → WebRTC → Speaker
    ↓
Context Aggregator (stores AI responses)
    ↓
User Hears AI Response 🔊