Try Agora for Free
Sign up and start building! You don’t pay until you scale.
We’re thrilled to announce that Agora’s Conversational AI Extension is now available on Dify Marketplace as a plugin, bringing powerful real-time voice AI capabilities directly to developers within the Dify ecosystem. This partnership combines Agora’s expertise in low-latency, interactive AI solutions with Dify’s open, community-driven plugin marketplace, enabling developers to create smarter, more engaging AI agents with ease.
Dify.AI, an open-source AI application development platform, has launched a dynamic plugin ecosystem with its new Marketplace in Dify v1.0.0. The Marketplace hosts over 120+ plugins, including Models, Tools, Agent Strategies, Extensions, and Bundles, enabling developers to build and scale innovative solutions. With its modular architecture, developer-friendly tools, and distribution channels like community sharing and local deployment, Dify Marketplace provides an ideal platform for Agora’s Conversational AI Extension, enhancing real-time voice AI adoption within a thriving global developer community.
Agora is proud to introduce our Conversational AI Extension, now live on Dify Marketplace. This powerful extension empowers developers to build real-time, interactive voice AI experiences. Developers can use a wide range of leading Large Language Models (LLMs) to build seamless voice AI agents with industry-leading speech-to-text and the ability to choose from leading text-to-speech voice services. Powered by Agora’s ultra-low-latency Software-Defined Real-Time Network (SD-RTNTM), the extension offers quick response times and global reliability—even in poor network conditions. With its rapid, low-code integration, developers can deploy voice agents—such as virtual assistants or customer support bots—directly within Dify.
The Conversational AI Extension is powered by the Ten Framework, an Agora-supported open-source framework and community project for building conversational AI.
It’s easy to get started with the Agora Conversational AI Extension on Dify.
Enter the explore page of Dify Plugins, then find the “Agora Conversational AI” extension, and install it.
Check your installed plugins gallery. You should see the extension installed there.
Prepare your Agora account for necessary information.
First, log into Agora’s console, then create a project and copy the App ID. Save it for later use. If you have enabled a certificate for your project, save that as well.
Next, enable the configuration in the conversation AI engine. As shown in the image, you will see the "active" indicator on the right side.
Third, on the "RESTful API" sub-page of the overview section, create the corresponding RESTful API key and password. Save it for later use.
Note: You will need to turn on the “Conversational AI” feature in the Agora Console.
This extension supports two TTS vendors: Microsoft Azure and Elevenlabs. Make sure you apply for an API key for the vendor service that works best for you and save the key for later use.
Come back to Dify. Click on the extension, select Create a new API endpoint from the right panel, and input the values as guided.
You can find examples of the TTS parameters (vendor dependent) in JSON format in the plugin’s ReadMe on Dify Marketplace.
When saved, you can now use this URL structure to open the demo page:
https://<YOUR DIFY ENPOINT HOST>/convoai-web/index.html
If you want to define your own UI, you can also use the API directly to start/stop an agent. The API reference can be found here.
Unlike traditional high-latency chatbots, real-time communication (RTC) demands fast, natural interactions—making Agora’s Conversational AI Extension a perfect fit.
As an example, we’ve built a Daily Search Assistant app within Dify. This voice-powered agent acts like a knowledgeable friend, providing quick, concise answers to everyday questions—whether it’s “What’s the weather like today?” or “How do I make a quick dinner?”
Imagine this: You ask, “What’s a good coffee spot nearby?” The assistant instantly responds in a warm, customized voice tone, “Hey, there’s a great café called Brew Haven just two blocks away—perfect for a quick pick-me-up!” Powered by Agora’s ultra-low-latency SD-RTN™ and seamless speech-to-text/text-to-speech integration, the assistant delivers responses in real time, even on spotty networks.
Once your agent or chatflow is published in Dify, you can fine-tune its settings via the endpoint panel. With the Agora extension, this assistant gains real-time conversation capabilities and customizable voice tones, making it ideal for applications like personal assistance, customer service, or sales support.
The launch of Agora’s Conversational AI Extension on Dify Marketplace brings real-time, low-latency voice AI capabilities to developers, making interactive AI experiences more accessible than ever. With seamless integration and high-quality voice interactions, this partnership paves the way for smarter, more engaging AI agents. Try it out today and bring your AI agents to life!
About Dify.AI
Dify.AI is revolutionizing AI-native application development by providing an open-source platform that simplifies the entire lifecycle of AI application creation, deployment, and management. With its extensible plugin ecosystem, Dify.AI enables developers and businesses to seamlessly integrate AI capabilities, customize workflows, and accelerate innovation. By lowering the barriers to AI adoption, Dify.AI empowers users to build intelligent applications with greater efficiency and flexibility.
