When moving software applications from on-premise hardware to the cloud, it often “just works,” but it’s never guaranteed. This is especially the case for applications that are hardware intensive. This blog post examines what happened when a media company took software for real-time video broadcasts into the cloud. We’ll share how we, Google Cloud, collaborated with media software provider Vizrt to meet the demanding requirements of an eSports broadcaster. Together, we delivered a solution that not only met but exceeded the expected performance from a cloud-based deployment.

Video broadcasting in the cloud

Video broadcasts are a very hardware-intensive workflow. By needing to process and store data streams in near-real-time, broadcasts stress GPU, memory, disk, and CPU. In addition, the performance requirements quickly increase as producers add additional video streams into the mix, such as in this case, an eSports broadcast.

Vizrt’s customer wanted to increase their broadcast production by doubling the amount of camera feeds from 8 to 16, to have a more compelling and elaborate production.

At the heart of the eSports broadcasters’ production was Viz Vectar Plus, Vizrt’s software-based 4K switcher. While the client wanted to move more of its production into the cloud, Viz Vectar Plus was designed initially for on-premise hardware. So, when they tried a straightforward “lift and shift ” to the cloud, it surprised no one that the software didn’t run as well. They turned to Google Cloud and Vizrt to make it run the way they needed it to. 

Troubleshooting lift and shift

Initially, we suspected that the issue could be in the design of the cloud deployment, i.e., the configuration of the VM hosting the software. So the focus of our troubleshooting was to find a cloud configuration that 1) made sure the software worked to spec and 2) did so optimally considering costs, robustness, and performance. Furthermore, we wanted to ensure that all components met performance specifications, particularly throughput, IOPS, and network bandwidth, as this was a video media application. Only after we validated the cloud deployment would we ask Vizrt to investigate the code itself. We would:

1. Set up a test environment.
2. Benchmark the environment.
3. Test various configurations.
4. Validate that the vendor software was optimally using the configuration.  

This high-level methodology is straightforward. However, we approached the details in a particular order, considering we were optimizing for broadcast video. We honed in on the optimal cloud configuration by testing the following elements, prioritized in order of expected impact:  

1. VM type: The VM type largely dictates the available memory and CPU configurations. However, because this was a VM workflow, we had to pick N1’s. Today, they are the only VM type that can be attached to GPUs, which are practically a requirement for broadcast video.  
2. Disk type: Video broadcasts require high I/O speeds to handle high-quality video streams. We went from an HDD to a much-faster SSD. 
3. CPU size: We increased the VM CPU cores from 16 in increments up to 32. Increasing CPU size indeed increased performance, but did not return the level of performance we needed.
4. SSD size: We increased the SSD size (and the accompanying higher IOPS and throughput that comes with increasing the size) enabling more simultaneous recordings. Again, this only partially worked. 
5. Disk count. We noticed read/write problems when the application was reading/writing with a single drive. There are two typical ways to approach this: 1) Separate read/writes tasks among two discs and 2) striping the data streams across discs. Implementing these had improved but marginal improvements in performances.  

After our testing, we arrived at the following optimal configuration:

• VM: n1-standard-32 instance w/ 500Gb boot drive
• GPU: 1 T4 GPU 
• SSD: 1 persistent disk with 1TB*

* We would later determine that two SSDs for separate read and write operations would be more optimal

This configuration was able to produce between 6 – 12 streams. Compared to the on-premise target of 8 streams, this was about as good but was not the customer’s target of 16. So we would need Vizrt to take the ball from here to optimize the software itself.

Optimizing media applications for cloud

We provided Vizrt our recommended configuration, performance notes, and the following best practices that are generally applicable to cloud-based video workloads:

• Separate read and write operations to two different disks to enable higher performance for both operations. 
• A second 1 TB SSD persistent disk can be attached to the VM instance to increase performance.

With this information, Vizrt engineers worked their magic, providing daily patches to test; with each daily iteration the overall solution was found quickly. Not only were they able to meet the broadcaster’s request of 16 feeds, but they were also able to go even further to 44. Over a 5x improvement by optimizing for the cloud! 

Teamwork in troubleshooting 

Because of the specialized nature of media and entertainment, workflow situations across multiple companies are common as specialized applications hand their work from one to another. 

“By working in partnership with Google Cloud we managed to build a system that can scale in ways that probably none of us thought would be possible. This allowed Viz Vectar Plus to run fully in the cloud using NDI and opened up amazing possibilities for making shows,” Dr. Andrew Cross, President R&D, Vizrt Group. “We ended up with great feedback from the customer, who were appreciative of how Google Cloud and Vizrt collaborated on a solution.”

The results speak for themselves: A satisfied customer with over a 5x improvement in results. That’s what we call a good game.

In the last year, there’s been an upward trend in cloud adoption in India. In fact, NASSCOM finds that cloud spending in India is estimated to grow at 30% per annum to cross the US$7 billion mark by 2022.

At Google, in our conversations with customers, discussions have evolved beyond cost savings and efficiencies. While those are still very relevant reasons for adopting cloud technologies, Indian enterprises are looking to Google Cloud to help them drive digital transformation, identify new revenue generating business models, reach previously untapped consumer markets, and build customer loyalty through greater insight and personalization.

Here are some companies and their stories.

Tata Steel: Mining data and maximizing its power

Tata Steel is a great example of an established enterprise from a traditional industry that is modernizing and embracing cloud computing. With an ambition to be a leader in manufacturing in India and a digital-first organization by 2022, Tata Steel believes smart analytics is key to enhancing operational efficiency and gaining business advantage. 

To organize data from siloed systems across the organization and make it easily accessible to all employees, Tata Steel is using Cloud Search and plans to scale it to more than one million documents and 28 disparate enterprise content sources including enterprise resource planning (ERP) and SharePoint. In fact, Tata Steel is one of the first Indian enterprises to harness the power of Cloud Search to meet some of the most aggressive ingestion demands, with indexing durations reduced from weeks to seconds.

They are also leveraging Google Cloud Platform (GCP) services like Google Cloud Storage and BigQuery to build their data lake and enterprise data warehouse so they can take advantage of advanced analytics and machine learning. Managed services such as AI Platform further enable Tata Steel to manage end-to-end AI/ML workflows within the GCP console. This complements their existing on-premise reporting and analytics tools, and brings data management to the forefront of everything they do—from forecasting market demand to predictive equipment maintenance.

“Digital is not just a goal, it’s become a way of life. We are digitizing everything from the deployment of factory vehicles to improving material throughput to marketing and sales. As a result, we have petabytes of structured and unstructured data that is not only waiting to be mined, but that we can generate intelligence from to create opportunities across our multiple lines of business using GCP,” said Sarajit Jha, Chief Business Transformation & Digital Solutions at Tata Steel.

Helping L&T Financial Services reach customers in rural communities

In rural communities, quick access to financial services can make a tremendous difference to livelihoods. L&T Financial Services provides farm-equipment finance, micro loans and two-wheeler finance to consumers across rural India backed by a strong digital and analytics platform. Their digital-loan approval app, which runs on GCP, makes it significantly faster and easier for people to apply for financial assistance to purchase important things such as farming equipment and two-wheelers. It also helps rural women entrepreneurs get quicker access to funds for their businesses through micro loans.

L&T Financial found G Suite to be a far better collaborative tool to help staff work together efficiently. Employees can interact with each other in real time using Hangouts Meet, and the task of information sharing is more seamless and secure through Drive. BigQuery also helps L&T Financial Services generate behavior scorecards to track credit quality of its micro-loan customers.

“Cloud is the technology that enables us to achieve scale and reach. Today there are countless data points available about rural consumers which enable us to personalize our products to serve them better. With access to faster compute power, we can also on-board consumers more efficiently. Our rural businesses have clocked a disbursement CAGR of 60% over the past three years.” said Sunil Prabhune, Chief Executive-Rural Finance, and Group Head-Digital, IT and Analytics, L&T Financial Services.

Creating conversational connections for Digitate’s customers

Digitate, a venture of TCS (Tata Consultancy Services), has integrated Dialogflow into its flagship brand ignio, an award-winning artificial intelligence platform for driving IT operations, workload operations and ERP operations for diverse enterprises. This integration is the next step in ignio’s product development journey, and will enable users to chat or talk with ignio to detect issues, triage problems, resolve them and even predict system behavior.

“ignio combines its unique self-healing AIOps capabilities for enterprise IT and business operations with Dialogflow’s AI/ML-based, easy to use, natural and rich conversational capabilities to create an unparalleled, intuitive and feature-rich experience for our customers,” says Akhilesh Tripathi, Head of Digitate.

Indian enterprises going G Suite

The base of Indian enterprises that are making the switch to G Suite to streamline their productivity and collaboration also continues to grow. Sharechat, BookMyShow, Hero MotorCorp, DB Corp and Royal Enfield are now able to move faster within their organizations, using intelligent, cloud-based apps to transform the way they work.

A hybrid and multi-cloud future in India

IDC predicts that by 2023, 55% of India 500 organizations will have a multi-cloud management strategy that includes integrated tools across public and private clouds. (IDC FutureScape: Worldwide Cloud 2019 Predictions  — India Implications (# AP43922319). We look forward to sharing more success stories of Indian enterprises that have taken the next step in their digital transformation journey.

In order to be successful, research needs to be replicable, so scientists can build on past work and insights. However, an article in Nature warned that as much as 50% of published drug development research could not be reproduced in subsequent trials. As a result, promising drug candidates sometimes led to disappointment, as well as wasted time and money, when key findings could not be replicated. 

The shift to cloud computing helps solve this problem because it allows researchers to use open-source tools that work across platforms. As demand for cloud computing rises, our customers have asked us for more ready-made solutions to assure reproducibility of results by their collaborators, regardless of the platform they are using. They asked for secure and effective collaboration tools as well as faster time-to-insight from any type of data.

We listened. Google’s new research and data insights solution includes three sets of functionalities to address these key challenges. Each can be activated on demand and may be eligible for subscription pricing. “HPC in a box” offers abstract complexity to run high performance computing (HPC) workloads by automatically managing your cluster in the most effective manner. It integrates seamlessly with some of the industry’s most-used schedulers like Slurm and PBS. It makes it easier than ever to answer bigger questions faster by accessing Google’s fast, powerful hardware like TPUs and GPUs, all for one predictable flat fee for eligible workloads. Healthcare Innovation Hub provides healthcare-specific functionality to help ingest, aggregate, and de-identify any type of healthcare data in its original format. It unlocks cross-modality analysis and collaboration and empowers researchers with harmonization tools to overcome healthcare interoperability issues. Google Cloud Real-World Insights (formerly FDA MyStudies) accelerates and streamlines drug development and clinical trials to address urgent medical challenges with reproducible results.

The solution enables researchers to ask new questions, get answers more quickly, and work more collaboratively–with no wait times or down times. Institutions can scale to more ambitious projects and generate actionable, real-time insights from any data source–all while staying within budget.

Many top research centers have already found it faster and more cost effective to shift from downloading and storing data on their own servers to storing and analyzing data on Google Cloud. Here are some of the real-world projects already yielding breakthroughs:

• Clemson analyzed 8,500 hours of traffic camera feeds with 2.1M vCPUs in three hours to improve evacuation routes for disaster planning.
• The Colorado Center for Personalized Medicine saved $2.9M by building their Compass data warehouse on Google Cloud rather than on on-prem.
• The Broad Institute slashed costs of genomic sequencing by 90% with Google Cloud.

Our partners, such as Atos, Burwood, Omnibond, Mavenwave, Quantiphi, and Deloitte, can help you first design and develop, then install and implement your own solution, including training. To assess your institution’s needs and develop a customized plan for your next-generation research solution with research and insights, contact our sales team.

After three migrations to different cloud providers, the company managed to migrate with no system outages for the first time, supported by partner Sky.One.

Results

• Migrated four SAP environments and four servers in just one month with no system outages
• Zero unavailability periods since migrating
• Less time spent worrying about operational issues increases the focus on business

50% savings on monthly cloud costs

Rossi Residencial, one of Brazil’s largest construction companies and real-estate developers, with around 150 employees, hundreds of business and engineering partners, and nationwide service, has used SAP solutions for financial management since 1999. Taxes, accessory obligations, accounting requirements, and other processes are managed through the system in an integrated and automated manner, which provides the business with crucial support.

Over the past few years, the company has begun to promote independent, sustainable business units to focus on strategic locations and products. This prompted its technology team to adapt as well, and they saw the cloud as an opportunity to add flexibility to SAP’s management.

“If I need to open a new branch or break ground on a project, the entire system core is already in the cloud and I don’t have to worry about local infrastructure,” explains Eduardo Araújo, Rossi’s IT Manager. “It also means our operational costs are significantly reduced.”

A few years ago, the company started working with the ECC component in the EHP 8 version, using modules such as FI (financial accounting), CO (controlling), MM (materials management) and TRM (treasury and risk management). But the dollar’s high exchange rate in 2020 increased costs with their then provider too much. The team was also not satisfied with the provider’s service, leading it to look for a new provider and a partner to support migration.

An essential requirement the new provider had to offer was high availability and scalability. Potential partners had to perform migration in a short time window (as the contract with the other service was about to expire) and be familiar with the previous provider to ensure the operation’s success. After spending some time searching, the company chose Google Cloud and Sky.One for the project.

“Out of the cloud options we researched, Google Cloud offered us the best financial conditions and a solution that truly catered to us. And out of the many partners we contacted, Sky.One offered the best work planning and service.”—Eduardo Araújo, IT Manager, Rossi Residencial

First migration with no system outages

The tight migration deadline meant the company would not have the time to install every app in Google Cloud from scratch, so Rossi asked the Sky.One team to mirror its entire previous architecture, that is, migrate the virtual machines from the company’s four SAP environments and four servers from other apps directly to Google Cloud.

After mapping the source structure in detail along with Rossi, the partner was able to complete migration planning in a month. “If you map before migrating and thus understand the customer’s environment well, you are able to prepare the destination so it has every integration and its respective access,” says Ricardo Nunes, Solution Expert at Sky.One.

The tool chosen to move the environments was Migrate for Compute Engine (previously known as Velostrata), which streamlines, facilitates and reduces risks for app migration to Google Cloud. Sky.One selected an expert in this solution to conduct the process, which was also supported by Google Cloud experts to make any needed adjustments.

The process took just a month to complete. The environments were successfully migrated with zero impact on operations, an unprecedented feat for the company. Now SAP environments run in a new infrastructure consisting of Compute Engine, a service for creating and running VMs, and Cloud Storage for data storage.

“This is the first time, after three previous migrations to private and public clouds, that our users have not felt any impact and we didn’t have system outages. It was a six-hands project that worked very well.”—Eduardo Araújo, IT Manager, Rossi Residencial

Flexibility to deal with every business need

Since the migration, Rossi has not suffered system outages or handled related user requests and incidents. Performance has remained high even after the team resized the VMs. The flexibility to add or subtract resources based on the company’s demands proved crucial. “Rossi operates in a segment with elasticity. In any given year, we can have two/three projects or ten. That’s why it’s important to have that resource in the cloud,” says Araújo.

Since the company does not operate 24/7, another benefit from migrating was the ability to schedule when to switch on and off servers, bringing cost savings. Furthermore, billing in reais at a fixed exchange rate with dollars led to a 50% cost reduction versus the previous provider.

The ease of integration between Google Cloud and SAP’s tools pleasantly surprised the team. “We were worried about potential incompatibilities, and we didn’t know if we would be able to work like before. Today we can work even better than before,” says the IT manager. According to Sky.One, the fine adaptation between the solutions becomes noticeable right after migration.

“Google Cloud’s solutions support all SAP migration steps, but after migrating we noticed that daily operations had become even more tightly integrated.”—Ricardo Nunes, Solution Expert, Sky.One

The cloud’s stability and security have streamlined the IT team’s daily routine. They no longer have to go to the company outside business hours to perform updates or repairs. Currently, employees can work remotely with peace of mind and maintain business continuity throughout Brazil.

With more time to focus on business needs instead of operational issues, the team is contemplating the addition of new Google Cloud tools. Rossi’s next challenge is to bolster its business operations and customer service even further using data analytics and AI solutions, making the most of its broad database.