collaboration

Agora and OpenAI Realtime API

Build lifelike, ultra-low latency AI voice agents with Agora's SDK and OpenAI's Realtime API

Get Started for Free

Go to Docs

Supported Platforms

No items found.

collaboration

Agora and OpenAI Realtime API

Build lifelike, ultra-low latency AI voice agents with Agora's SDK and OpenAI's Realtime API

Get Started for Free

Go to Docs

Supported Platforms

No items found.

Customers building with
Agora and OpenAI

Create engaging voice-driven AI experiences with human-like emotion

Agora worked with OpenAI to make it easy to build real-time conversational AI.

Integrated with OpenAI

Agora’s SDK is directly integrated with OpenAI’s Real-Time API for ease of use and connection to GPT models.

Ultra-low latency

Enable human-like voice interactions with OpenAI’s LLM that are only possible with an ultra-low latency real-time network.

AI noise suppression

Built in AI echo cancellation and background noise elimination ensure accurate voice processing in any environment.

Talk to a voice agent powered by the Conversational AI Engine

Try it now

One real-time view for the metrics that matter the most

Use a single dashboard to monitor every active session around the world. Track the metrics that are most important to you, from concurrent users and channels to network latency and so much more.

Go to Quickstart

Your vision, unrestricted.

With Interactive Whiteboard, you can build a collaborative app fast—with custom branding and full of features. Our platform makes it easy to create a customized and engaging learning environment.

Flexible APIs support custom branding and extensive digital whiteboard features.
Easily integrate real-time voice and video calling, interactive streaming and signaling.
Save users’ bandwidth by preloading, sharing, and annotating files, and retain all the dynamic content.

And have peace of mind with HIPAA, GDPR, and CCPA compliance.

See OpenAI's Realtime API in action

The real-time network for lifelike voice interaction with AI

Built for real-time AI

Intelligent routing optimized for ultra-low latency voice conversation.

Built for real-time AI

Last mile optimization

Ensure natural human-to-AI conversations despite last mile challenges.

Last mile optimization

Global scale

Powering 60B minutes of real-time interaction per month in 200+ countries and regions.

Global scale

Recording options for:

Cloud recording

Store, retrieve and share recordings in the cloud.

Go to Docs

On-premise recording

Store on a local server for security and confidentiality.

Go to Docs

Webpage recording

Record the entire web browser screen experience.

Go to Docs

Agora Media Services

Recording

Record audio streams, video streams and web pages for archive, review, or distribution.

Cloud Recording Documentation

On-Premise Recording Documentation

Webpage Recording Documentation

Media Gateway

Directly push media streams into Agora voice and video channels using the RTMP/SRT protocol and enable advanced transcoding processing on media streams to facilitate distribution.

Go to Documentation

Media Pull

Add additional engagement to your Agora sessions by pulling live or recorded video and audio content and ingesting directly into your Agora channel.

Go to Documentation

Media Push

Expand your audience with hybrid engagement experiences by pushing audio and video streams from Agora channels to Content Delivery Networks (CDN).

Go to Documentation

Build your conversational AI experience

Quickstart guide

View the quickstart guide to get up and running with Agora and Open AI.

Go to Docs

How the Conversational AI Engine works

Build your conversational AI experience

Your Code

Agora SDK

Customize your experience from the start with our flexible SDK.

Go to Docs

No items found.

Your Code

Agora SDK

Build and integrate real-time video into your app with the most flexibility and customization using Agora's Video SDK.

Go to Docs

No items found.

NO CODE

App Builder

Agora’s App Builder is the fastest and easiest way to real-time video into your product using our no-code visual designer.

Go to Docs

low code

Agora UI Kit

Add real-time video to your app with only a few lines of code using low-code UI Kit libraries.

Go to Docs

your code

Agora SDK

Customize your experience from the start with our flexible SDK.

No items found.

Go to Docs

low code

Agora UI Kit

Integrate real-time communication and streaming using only a few lines of code with low-code UIKit libraries.

Go to Docs

Documentation

This project presents you a set of API examples to help you understand how to use Agora APIs.

Go to Docs

Activate the AI Noise Suppression extension on the Agora Console.

Activate the Agora and OpenAI Realtime API extension in the Agora Console.

your code

Agora SDK

Build and integrate Voice Calling with the most flexibility and full customization using Agora's Voice SDK.

No items found.

Go to Docs

NO code

App Builder

Agora’s App Builder is the fastest and easiest way to add real-time voice chat, video chat, and live streaming into your product.

Go to Docs

your code

Agora SDK

Build and integrate real-time visual collaboration features into your application with the most flexibility and full customization using Agora's Interactive Whiteboard SDK.

No items found.

Go to Docs

LOW code

Fastboard

Build real-time visual collaboration faster with a pre-built UI and the ability to include custom plug ins.

Try it Now

Security, privacy and compliance

Agora is certified to the ISO/IEC 27001, 27017, 27018, 27701 and SOC 2 security standards and meets privacy regulations like GDPR, CCAP, COPPA, and HIPAA. Agora doesn’t collect or store any end-user data aside from Internet Protocol (IP) addresses and operational information necessary for providing our services.

ISO 27001:2022

ISO 27017:2015

ISO 27018:2019

ISO 27701:2019

HIPAA

GDPR

SOC2 Type1&2

CCPA

COPPA

HOW TO INTEGRATE?

Streamlined 3-step integration process:

Activate Agora Conversational AI Engine

Unlock real-time Speech-to-Text (STT) and Text-to-Speech (TTS) capabilities, enabling seamless conversational interactions.

Integrate Agora Edge Chip on Hardware

Optimize microphone, speaker, and system efficiency to ensure ultra-low-latency and high-fidelity conversations.

Deploy AI Voice Agents

Enable interactive, multilingual, and user-customized conversations for a wide range of IoT applications.

By building our Conversational AI technology into Beken’s high-performance IoT chip modules, the turnkey solution makes it easy to integrate voice AI into any connected toy.

“With Agora’s conversational AI technology and our optimized AI hardware, we’re enabling the next generation of toys to think, respond, and interact naturally. We are excited to usher in the future of robotics and toys, ones that can react to the environment around them and interact fluently with users.”

Pengfei Zhang

CEO, BEKEN

Use cases

Real-time voice AI interaction for any app

24/7 Customer Support

Provide round-the-clock support with AI-powered chatbots that handle common queries, troubleshoot issues, and guide customers through processes. Whether it’s booking reservations or resolving order problems, our AI is always ready to help.

Concierge

Create advanced voice-driven AI chatbots that can provide users with guidance and take actions like booking reservations, placing orders, and more.

Health and wellness

Foster mental health and well-being with innovative solutions like friendship-companion apps and wellness coaching. Create supportive, empathetic interactions that make a difference.

Language learning

Offer interactive, on-demand tutoring and language learning sessions. Our voice tutor technology makes learning engaging and accessible by allowing users to practice with lifelike conversations without having to feel judged.

Gaming

Bring games to life with real-time conversations between players and NPCs. Create dynamic, engaging gaming experiences that captivate users

IoT

Seamlessly integrate conversational AI into IoT devices, smart glasses, watches, and more. Enable intuitive, hands-free interactions that enhance user experience with Language User Interfaces (LUIs).

Robopoet's Fuzzoo, an AI companion robot, leverages Agora's ConvoAI Device Kit to deliver real-time emotional support and personalized interaction.

"Agora’s AI technology enables toys and robots to interact in a way that feels natural and engaging. With real-time voice processing, emotional AI, and advanced speech capabilities, Agora makes seamless human-machine interaction possible and ensures exceptional performance and reliability."

Yuna Pan

Co-Founder and CTO

Fastboard

Easily build and integrate Agora’s Interactive Whiteboard with our newest Fastboard SDK that delivers all the same whiteboard features with a pre-built UI and the ability to include custom plug ins.

Try it Now

No items found.

Request more information

Connect with our experts to answer your questions, discuss requirements, and provide more detail on the ConvoAI Device Kit

Thank you for your request. A member of our team will be in touch shortly.

Frequently asked questions

How does Agora improve the experience in comparison with other solutions for voice interaction with AI?

Agora enables more natural voice conversations with AI, thanks to low-latency responses and real-time interruption handling. Agora’s built-in background noise suppression, echo cancelation, and selective attention locking allow AI to hear the user clearly in any environment. Agora’s global real-time network ensures connectivity and performance in any location.

What LLMs can be connected to Agora’s Conversational AI Engine?

You can connect to any LLM that is OpenAI compatible, including OpenAI’s GPT models, Google Gemini, DeepSeek or any custom model that is OpenAI-compatible. Support for additional LLMs coming soon!

What additional technology is required to implement a voice AI agent?

To implement a voice AI agent, you need to connect an LLM and a text-to-speech service to Agora’s Conversational AI Engine. This enables full customization of the experience, with the LLM and voice of your choice.

What is a "chained model" in relation to conversational voice AI?

The chained model refers to the flow of the user’s voice being processed by speech-to-text technology, then that text being processed by the LLM, then the LLM’s response being processed by text-to-speech technology and ultimately outputting the AI agent’s voice response.

Does Agora’s Conversational AI Engine enable the creation of an AI model or LLM?

No, Agora’s Conversational AI Engine requires an existing AI model or LLM. The Engine enables customized voice interaction with the LLM but is not capable of creating or training an LLM.

Start building for free

Create a free Agora account and start building with Agora and the OpenAI Realtime API.

Try for Free

Talk to Us

Whether you have questions about Agora’s technology, development, pricing or partnerships, we’re here to help.

Contact Sales

Developer Resources

Start building with Agora SDKs. Access guides, sample apps, SDK downloads, documentation, API reference, FAQs and more.

Go to Docs

Press inquiry? Reach out to us at press@agora.io

App Builder

Flexible Classroom

Download SDKs

Support Plans and Pricing

Agora and OpenAI Realtime API

Agora and OpenAI Realtime API

Create engaging voice-driven AI experiences with human-like emotion

Your vision, unrestricted.

See OpenAI's Realtime API in action

The real-time network for lifelike voice interaction with AI

Built for real-time AI

Built for real-time AI

Last mile optimization

Last mile optimization

Global scale

Global scale

Recording options for:

Agora Media Services

Build your conversational AI experience

Quickstart guide

Build your conversational AI experience

Agora SDK

Agora SDK

App Builder

Agora UI Kit

Agora SDK

Agora UI Kit

Documentation

Agora SDK

App Builder

Agora SDK

Fastboard

Real-time voice AI interaction for any app

Fastboard

Frequently asked questions

Start building for free

Talk to Us

Developer Resources