Back to cases

Agent-based voice AI assistant for Tesla drivers

We developed a GenAI-powered voice assistant, enabling Tesla drivers to interact with the platform hands-free.

ai powered voice assistant for cars
ai powered voice assistant for cars

    A mature platform with a safety gap

    Our client, Kilowatts Co., developed an infotainment application for Tesla owners. The platform combined several digital services in one ecosystem, from trip support and charging-related services to purchases and payments.

    Alongside a wide range of capabilities, the platform required continuous manual interaction through a mobile interface. Drivers had to shift their attention between the road and the application to complete tasks, which increased cognitive load and compromised driver safety. To address this safety issue, the client decided to build a voice-based AI assistant and engaged our team to design and deliver it.

    • Client

    • Country

    • Solution

    • Domain

    • Outsourcing model

    • Technology

    Implementing the solution

    We began with a thorough analysis of the client’s existing cloud-based microservice architecture and the services already running inside the Kilowatts ecosystem. The platform already had established back-end flows, external integrations, and a defined service structure, so rebuilding it would have meant spending resources on replacing what already worked instead of solving the actual interaction problem. The right approach was to naturally integrate an AI layer into the existing architecture.

    To implement this layer, we developed and integrated a dedicated microservice connecting the Kilowatts back end with OpenAI APIs. This microservice became the technical bridge between natural voice interaction and the platform’s existing execution flows, keeping both layers independent and the overall system stable.

    Agent-based architecture

    The AI layer is designed as a multi-agent system. At the core is an orchestrator agent that receives driver requests, handles intent recognition, and routes each request to the appropriate downstream agent.

    Each downstream agent owns a specific functional domain—navigation, ordering, payments, and vehicle communication—and interacts with the platform exclusively through a defined set of function calls. This means that agents can trigger actions but have no direct access to underlying services or data stores.

    Execution responsibility stays entirely within the existing back-end infrastructure, which processes every action through its established service integrations. This keeps the AI layer controlled while making the system easier to extend with new driver scenarios in future.

    Voice-enabled platform capabilities

    Order creation

    The assistant allows drivers to create orders from nearby cafés, restaurants, and stores by voice. A driver can ask for available options nearby, along the route, or close to the destination. The assistant suggests relevant places, helps review available items, supports product customizations, and guides the driver toward order confirmation.

    AI Development Services

    Explore the possibilities of AI!

    Route planning and navigation

    The assistant allows drivers to create routes by voice and send them to the vehicle’s navigation system. A driver can name a destination, ask for the most suitable route, and confirm the trip without typing or switching between screens. Once confirmed, the route is sent to the Tesla navigation system.

    Result

    Kilowatts gained a safer interaction model for its current in-car services: the voice AI assistant lets drivers access 5+ scenarios without touching a screen. Since the AI layer was built on top of the current infrastructure, core back-end logic, established integrations, and the existing product experience remained intact. This reduced delivery risk, kept time to market short, and created a scalable foundation for future voice assistant capabilities. New scenarios can be added through additional agents or function calls without redesigning what is already in place.

    Still have questions?

    Can’t find the answer you are looking for? Contact us and we will get in touch with you shortly.
    Get in touch now!

    Tech stack

    • Architecture

      • Microservices
      • Event-Driven
    • Operating systems

      • Linux
    • Frameworks

    • Runtime environment

    • Programming languages

    • Technologies

      • RESTful APIs
      • WebSockets
      • Azure Functions
    • Virtualization

      • Docker
    • Infrastructure (Cloud)

      • Azure
    • Event and messaging

      • Azure EventGrid
      • Azure Event Hubs
    • Data storage and querying

      • Azure Cosmos DB
      • Azure Blob Storage
    • Payment providers

      • Stripe
    • Artificial intelligence

      • OpenAI Chat
      • OpenAI Assistant
      • OpenAI Realtime
      • LangChain
    • External services

      • Tesla (Fleet API, Command SDK, Telemetry)
      • Iternio
      • MealMe
    • User authentication

      • Tesla OAuth2
      • Azure B2C
    • Mobile applications

      • iOS (Swift)
      • SwiftUI+UIKit
      • Combine
      • MapKit
      • Alamofire+URLSession
      • Keychain
      • Stripe
      • Firebase

    Contact us

    Our team would love to hear from you.

      Let’s connect

      Fill out the form, and we’ve got you covered.

      What happens next?

      • Our expert will follow up after reviewing your needs.
      • If required, we’ll sign an NDA to ensure privacy.
      • Our Pre-Sales Manager will send you a proposal.
      • Then, we get started on your project.

      Our locations

      Say hello to our friendly team at one of these locations.

      • San Diego, California

        4445 Eastgate Mall, Suite 200
        92121, 1-800-288-9659

      • San Francisco, California

        50 California St #1500
        94111, 1-800-288-9659

      • Pittsburgh, Pennsylvania

        One Oxford Centre, 500 Grant St Suite 2900
        15219, 1-800-288-9659

      • Durham, North Carolina

        RTP Meridian, 2530 Meridian Pkwy Suite 300
        27713, 1-800-288-9659

      • San Jose, Costa Rica

        C. 118B, Trejos Montealegre
        10203, 1-800-288-9659

      Join our newsletter

      Stay up to date with the latest news, announcements, and articles.

        Error text
        error message
        You must accept the terms and conditions to continue.
        title
        content
        View project