In the early days of digital television some 20 years ago, the only way to encode and multiplex it involved dedicated hardware because standard processors simply didn’t have enough power. But a lot has changed since then; We’ve moved from digital broadcasting to video delivery, and then to multiple platforms.
And of course, as we’ve moved along and the industry has evolved, the technology and methodology behind the scenes has also changed. In the beginning systems architects were building headends using hardware-based encoders, a practice that seemed set to continue. This resulted in a lot of proprietary hardware comprising most networks.
But as standard processors gained power, it became more practical to use them inside dedicated encoding appliances. The temptation remains, however, as existing devices reach their end of life, to simply replace one dedicated, proprietary box with a newer version of the same thing.
Now is the time to break out of this circle.
The solution lies in virtualisation: implementing the functions of an encoder in software, which in turn can run, when necessary, on a virtual machine in a data centre. This is now entirely practical, and it allows us to define systems by functionality, rather than by what dedicated boxes do. In turn, that gives us must greater flexibility to define and vary our workflows and processes to reflect consumer demand and commercial opportunities.
We can call this design philosophy network function virtualisation (NFV). This method of linking software to achieve what we need to do at any moment is also now extended to storage, giving us complete flexibility to scale our operations up and down as we need to.
First, this delivers real commercial benefits. Capex is reduced, because we are simply building, or extending, a server farm based on standardised IT hardware and simple ethernet connectivity. We are not building racks of dedicated hardware with complex SDI cabling. The hardware is lower cost, because we can take advantage of the commoditisation of the IT industry. And building high levels of redundancy means much less investment than duplication of dedicated hardware.
The opex view also changes. For many applications, software will be licensed by use, so there is a direct link between operating costs and revenues. A virtualised environment will have a much smaller physical footprint than one using dedicated appliances, and consequently power and air conditioning costs will be reduced. And support costs can be shared across the whole data centre, not just that part of it which has to deal with dedicated broadcast and delivery technology.
The result is a new elasticity for all operations, and which can be accurately costed per service. Proposed new services can be precisely checked for commercial viability, and brought to market very quickly, perhaps gaining an edge over a competitor.
One of the new phrases which has entered the broadcast lexicon is software-defined networking (SDN). An established technique in other fields of IT, it simply means separating functionality from control. Whereas with traditional hardware the way the devices were interconnected defined the way processes were completed, SDN simply selects the required software packages to complete any task.
This makes SDN and NFV natural partners. NFV allows us to virtualise the functionality; SDN provides the control and monitoring layer that issues instructions, prioritises the use of processor cores, and manages storage, all the while maintaining high availability and high reliability.
One of the potential traps is that the management of virtual machines and their processes originally depended upon proprietary software, which we would prefer to avoid. OpenStack, an open source virtualisation framework, started to emerge in 2010, allowing specialists to build architectures that meet the practical requirements of best-of-breed installations. Configuration done is through a web-based dashboard, command-line tools or, most common, a RESTful API.
While this architecture is widely used in the wider networking industry, leading-edge companies like ATEME are implementing it in the video headend, both for OTT and for traditional broadcast deliveries.
In the real world
To demonstrate the efficiency of this virtualised framework, consider a real-world example: the transcoding of a UHD asset. If we are talking about something at feature length, this could take a day to transcode at high quality on a standalone device. That means tying up expensive hardware for a very long time which will impact other workflows; and you may not have a day to wait before you show the content.
In a virtualised environment the management system, such as the ATEME Management System (AMS), parses the input file and starts as many encoder instances as it requires, or are made available by the system’s business rules. Each instance will be responsible for encoding one segment of the content. After the first pass, the AMS will analyse the result and launch the instances for the second encoding pass to the required quality level and bitrate. Finally, the AMS will aggregate all the encoded segments into a single output asset.
The speed increase will obviously depend upon the number of parallel instances that can be launched. Practical experience shows that, for content segmented into one minute chunks, you can get a hundredfold increase in encoding speed, bringing what was a 24-hour plus timescale down to around 15 minutes. And of course some or all of those instances could be in the cloud, giving your architecture the elasticity it needs for workflows with high processor demand.
The broadcast industry is changing constantly and its evolution will only continue. This means that the challenges of transcoding will increase as a result of the rise in platforms and services. Consider the effect of new formats, like 4K and 8K, and the challenges will become even clearer. Going forward it will be virtualisation that that will help broadcasters overcome these issues and deliver the flexibility and functionality needed to produce results.
By Rémi Beaudouin, vice president of marketing, ATEME