NeuroSmith

Start a project

All certificates

Public

Certificate NS-C02 · Public project

Virtual Michael

A real-time travel concierge you can talk to: a voice agent with a talking avatar, answering from a knowledge base built by hand.

Status
In progress · substantially built
Stack
LiveKit · Deepgram · ElevenLabs / Cartesia · Hedra / Anam · LlamaIndex · Flutter
Disclosure
Public project
  • Virtual Michael app: a day’s itinerary with arrival, hotel and a theme-park visit.
Fig. 1 Virtual Michael: the itinerary view. A real screenshot of the app.

What it is

Virtual Michael is a travel concierge in avatar form. You speak to it in a Flutter app and it answers out loud, on screen, from a theme-park knowledge base engineered by hand from data sheets and reference files.

Process: what we built

A LiveKit voice agent listens, with voice-activity and turn detection so it knows when you have finished. Deepgram turns speech into text. LlamaIndex retrieval answers from the knowledge base. ElevenLabs or Cartesia speaks the answer, and a Hedra or Anam avatar says it on screen.

  1. Listen

    • LiveKit voice agent: VAD, turn detection
    • Deepgram speech-to-text

  2. Know

    • Theme-park knowledge base
    • LlamaIndex RAG

  3. Speak

    • ElevenLabs / Cartesia text-to-speech

  4. Appear

    • Hedra / Anam avatar

  5. Carry

    • Flutter app
Fig. 2 System schematic, drawn from the certificate’s facts. The outlined step in blue is where the system decides.

Need something built to this standard?

Tell us what the system should decide or do. We’ll tell you plainly if AI isn’t the right tool.

Start a project [email protected]