This blog summarizes the testing results of Agora versus Vonage for 1:1 Web video calls. The testing covers the most important considerations when assessing video SDKs, from analyzing performance under constrained network conditions to maximizing throughput given available bandwidth while keeping central processing unit (CPU) and random-access memory (RAM) usage as low as possible.
Before we take a deep dive into the results, let’s review the test setup, configuration and scenarios covered in the testing.
In this test we used laptops with the following configuration for the sender and receiver:
All video feeds are set to 640×480 @ 30 FPS with the laptops connected to a stable Wi-Fi network.
For Agora, we tested using the Agora App Builder 2.0 and for Vonage we tested leveraging the most recent version of the Vonage WebRTC Demo, to ensure that Vonage best practices were properly implemented for comparison.
In these tests, we again focused primarily on the effect of packet loss and limiting network conditions on the send and receive frame rates.
As you can see in the graph below, with the network functioning under normal conditions, the frame rate was steady at 28 FPS for Agora and 27 FPS for Vonage. The overall experience for end users was similar under normal network conditions.
When introducing 25% uplink packet loss, Agora remains steady at 15 FPS while Vonage begins lagging at 12 FPS.
With 25% downlink packet loss, Agora continues to maintain 16 FPS while the performance of Vonage is impacted significantly, down to 1 FPS, resulting in choppy video.
A significant variation in latency can occur when sending traffic over an IP network. When simulating conditions of a highly congested network having an uplink jitter of 600ms, Agora outperforms Vonage, holding steady at 9 FPS. In comparison Vonage drops to 6 FPS.
When downlink jitter of 600ms was added, Agora held steady at 13 FPS with Vonage dropping to 5 FPS.
This test starts without bandwidth limitations, and after 60 seconds the network is throttled to 500 Kbps in the upstream direction, and then downstream for 30 seconds. Under these challenging conditions, Agora performed better than Vonage, rapidly recovering to an average of 27 FPS once the limitations were removed. It took Vonage 10 seconds to recover.
This test starts without any bandwidth limitations or simulated packet loss. After 60 seconds, the network is throttled to 500 Kbps in the upstream direction along with 25% simulated packet loss. These conditions are then applied downstream for 30 seconds. While the limitations were applied, Vonage users experienced consistent frozen video for up to 10 seconds at a time.
Once the bandwidth limitation and simulated packet loss conditions were removed, Agora rapidly recovered within about 2 seconds to 28 FPS on average while Vonage struggled for about 50 seconds before recovering to 26 FPS on average.
Agora has several ways to combat network disruptions and costly packet loss. Most notably, these include leveraging our SD-RTN (Software Defined Real Time Network)™ network as an overlay to the public internet, which routes traffic around impairments on the internet using AI algorithms and optimally shapes real-time traffic for the best performance.
Agora also implements technologies to smooth out the effects of packet loss to optimize the end-user experience.
Processor: Intel Core i7-1185G7 @ 3.00 GHz
Agora consumed slightly less CPU resources vs. Vonage in all scenarios, with an average of 4.63% utilization vs. Vonage at an average of 4.84%.
Vonage consumed slightly less RAM than Agora, with an average of 128 MB compared to Agora’s 151 MB.
This blog summarizes the test results covering various real-world scenarios and conditions experienced when implementing Video SDKs for point-to-point Web use cases. When it comes to real-time communication, the ability to deliver a high-quality and consistent end user experience is critical. Our testing shows that Agora consistently outperforms Vonage in common RTC scenarios involving jitter and packet loss. Agora’s advantage in these scenarios comes from our global SD-RTN (Software Defined Real Time Network)™ which uses AI to intelligently route traffic for optimal RTC performance.
At Agora, our customers—ranging from some of the largest social media companies in the world to bootstrapped startups—continue to leverage our SDKs to easily integrate video, voice, and interactive live streaming experiences into any app. We empower developers to deliver best-in-class real-time experiences, with global delivery and scale.
Sign up for free today to start building or contact us for a free consultation.