One of the early problems with live video streaming—first demonstrated at the 1997 NAB Show—was that the images hiccupped and sputtered due to constraints in bandwidth. Yet, even with those annoying imperfections, it was clear from day one that video had a future over the internet. 

Now—25 years later—getting rid of those video interruptions over the net is close to reality. It hasn’t been an easy engineering problem to solve. In live video streaming, it is important to remember that the lower the latency, the less robust the video signal becomes. Low latency video can hiccup, or stop playing completely, after even the tiniest gap in the bandwidth of the stream.

Balancing Act
Since day one, live video streaming has been a balancing act—low latency versus stability of the content stream. (Though things have dramatically improved from the days when virtually every online video was shaky and dropped out frequently.)

Today, depending on the value of the video content, latency takes on varying degrees of importance. With the standard streamed church service or town council meeting, which ranks as the lowest-valued content, segment size can be reduced from 2-4 seconds with little cost or concern. In this class of video, latency can be reduced to between 6–12 seconds.

More valuable, but pre-recorded, broadcast content averages about 5-6 seconds of latency, while demanding real-time content like OTT streaming of live online sports, gambling or gaming demand special low-latency technology. New technologies with complex names are dealing with the latency issue and programming vendors are expected to charge a premium for the service.

Until recently, ultra-low latencies of less than a second were best achieved using UDP-based WebRTC (Web Real-Time Communication), a free and open source protocol introduced by Google in 2011. It provides web browsers and mobile applications with real time communication via program interfaces. 

Until about 2020, the HTTP approach—a competing method—could not provide a low enough latency for interactivity, so WebRTC remained a popular solution. 

Apple vs. Microsoft (Again)
However, the cost and complexity of encoding and storing the same video file twice for the two main computer platforms—Apple and Microsoft—made processing and storage of content expensive. Two versions of the same video stream had to be made either in advance or instantly. With users accessing streams across iPhones, smart TVs, Xboxes and PCs, this expensive complexity became a major issue.

In 2016, Apple and Microsoft suggested that the Moving Pictures Expert Group (MPEG) create a new uniform standard called “Common Media Application Format” to simplify online delivery of HTTP-based streaming media (Fig. 1). It was published in 2018. 

Once the standard was created, manufacturers implemented it quickly. The benefits of encoding, packaging and caching a single container for video delivery was obvious. But CMAF did more than just reduce encoding complexity.

HTTP-based video delivery still lacked the real-time delivery options that viewers wanted. CMAF had to also improve latency. Now, Microsoft and Apple have agreed to reach audiences across the HLS and DASH protocols by using CMAF, a standardized transport container (Fig. 2). 

CMAF represents a coordinated industry-wide effort to lower latency with chunked encoding and transfer encoding. It also supports file encryption and digital rights management. Multiple incompatible DRMs are supported, including FairPlay, PlayReady and Widevine.

Since its creation, CMAF has opened the way for a new generation of low latency technology. These consist of Low Latency HLS (LL-HLS), Low Latency DASH (LL-DASH) and the High Efficiency Stream Protocol (HESP). CMAF works hand-in-hand with these protocols.

LL-HLS, which was announced by Apple in 2020, became the most used technology for streams via HLS. There is a DVB standard for low-latency DASH and there is ongoing work to ensure interoperability for all DASH/CMAF low-latency applications. 

Harmonic and Akamai showed low-latency CMAF demos with a latency of under 5 seconds at the 2017 NAB and IBC shows. Since then, most other encoder and player vendors have integrated the technologies into their products. 

Market Competition
All low-latency systems work in the same basic way. Rather than waiting until a complete segment is encoded—which usually takes between six and ten seconds—the encoder creates much shorter “chunks” that are transferred to the content delivery network as soon as they are complete.

In a new forecast from Rethink TV, a research organization, it is predicted that low latency protocols will quickly find a place in live sports delivery. As time goes on, all content—not just sports—will make use of the protocols, the researcher predicted.

Rethink TV anticipates low-latency delivery will be a very competitive market in the next few years. These low-latency distribution technologies, which can be offered as a premium service to subscribers, are key for a number of competitive video technology vendors and users. Pivotal will be knowing how to optimize both the centralized and edge infrastructure to compete with rivals, the research found. 

As most devices are now totally compatible with CMAF, Rethink TV predicts most will be able to receive video streams packaged in LL-HLS and LL-DASH formats. Competitive forces will drive adoption.

For owners of content, rights holders and streaming services, the reduction of latency for live video can differentiate them from their rivals by dramatically improving the reliability of video service.

This also applies to broadcasters that operate both traditional pay-TV distribution infrastructure and an OTT service. Those broadcasters need to get their latencies down to something nearer their traditional pay-TV competitors.  

Reducing OTT latency is essential, but now for only live content. It will probably remain in the sports and betting arena for the time being. However, all on-demand video programming will eventually migrate to a low-latency technology, probably before the end of this decade. 

Switch Media, a world leader in online video technology, is announcing the launch of MediaHQ Lite. This is an end-to-end OTT platform that provides a comprehensive feature set at a cost-effective price point allowing an OTT service to be delivered swiftly. MediaHQ Lite keeps complexity to a minimum while satisfying core OTT requirements, reducing overheads and providing the opportunity to test new ideas with minimal budget.

Premium OTT services have become complex and fragmented. Many broadcasters and content owners struggle with bespoke integrations, finger pointing between vendors, the high costs of app development and progressively increased overhead costs. MediaHQ Lite is aimed at new OTT offerings where time-to-market is critical, and budgets are realistic. The platform provides the ability to extend reach, free up operational resources and adapt to the changing OTT landscape and consumer expectations.

Using MediaHQ Lite, an OTT service can be launched quickly and easily without any kind of customisation. Users simply rebrand according to their own brand guidelines. Features include secure VOD and live streaming with DRM, a global CDN service, analytics reports, comprehensive metadata, high definition ABR encoding and use of the Switch Media applications, or their own apps if they have them. What really sets MediaHQ Lite apart is a full featured server-side ad insertion integration with AdEase providing uncompromised addressable ad experiences.

Luke Durham, CTO, Switch Media says, “We have been approached by many content owners wanting to launch new OTT services who are overwhelmed by the intricacy and costs. This is especially the case in emerging markets such as South East Asia and Africa, but also the growing collection of content owners who want to augment their revenue streams by going directly to the consumer with a niche offering. With MediaHQ Lite we’ve created an end-to-end solution that keeps the lion’s share of features and value but removes much of the complexity in the setup, and the often-overlooked operational costs.”

The release of MediaHQ Lite follows the successful launch of MediaHQ Enterprise at NAB 2019. MediaHQ Enterprise uses a powerful workflow engine and houses a flexible suite of modular components that integrate seamlessly with existing systems, which are supported by Switch Media’s expert in-house technical team 24/7. Users can upgrade from MediaHQ Lite to MediaHQ Enterprise at any time if their needs or requirements change.

Switch Media will discuss OTT delivery at:

• Asia Video Summit – Singapore - 4-6 November 2019.  

• AfricaCom – Cape town - 12-14 November 2019. 

SAN FRANCISCO—Latency is the most significant issue faced by over half (54%) of video developers, according to Bitmovin’s annual Video Developer Report.

Bitmovin is a provider of video infrastructure for digital media companies and works with companies across the globe to build new video products.

Based on the views of 542 industry professionals in 108 countries, the survey found that 53% expect to achieve live streaming latency of less than 5 seconds, and 30% said their aim was under 1 second.

The report further showed that H.264/AVC is by far the most widely used video codec, used by 91%  of all respondents. Planned usage of AV1 is also set to triple, with 20% expecting to start using it in the coming year.

Meanwhile 24% of video professionals expect to start using AI/ML as part of video workflow solutions before the end of 2019, while 32% plan to do so in 2020.

Bitmovin CEO Stefan Lederer said: “The Bitmovin Video Developer Report is an inside look at the technology adoption plans of companies that are collectively delivering video to huge global audiences. We’re excited to share the results with the community of video developers.

“The findings show a shift toward new breed technologies such as AV1 and artificial intelligence. We’re also seeing the industry continue to face huge issues with latency and ensuring playback on all devices.”

You can download the full report here.