Do you want to fire up a bunch of techies? Talk about multicloud! There is no shortage of opinions. I figured we should tackle this hot topic head-on, so I recently talked to four smart folks—Corey Quinn of Duckbill Group, Armon Dadgar of Hashicorp, Tammy Bryant Butow of Gremlin, and James Watters of VMware—about what multicloud is all about, key considerations, and why you should (or shouldn’t!) do it.

Five important insights came out of these discussions. If you’re on a multicloud journey or considering one, keep reading.

Do: Choose to do multicloud for the right reasons

Don’t do multicloud because Gartner says so, implores Corey Quinn. Before embarking on a multicloud, define a “why” focused on business value journey, says Armon Dadger. For example, you might want to use services from each public cloud because of their differentiated services, according to Tammy Bryant Butow. Armon also calls out regulatory reasons, existing business relationships, and accommodating mergers and acquisitions. On the topic of M&A, Corey points out that if you acquire a company that uses another cloud, it’s usually expensive and difficult to consolidate. It can be smarter to stay put.

https://youtube.com/watch?v=xFSDexQhCUY%3Fenablejsapi%3D1%26

Don’t: Over-engineer for workload or data portability

Thinking that you’ll build a system that moves seamlessly among the various cloud providers? Hold up, says our group of experts. Armon points out that aspects of your toolchain or architecture may be multicloud—think of some of your workflows or global network routing—but that shifting workloads or data is far from simple. Corey says that trying to engineer for “write once, run anywhere” can slow you down, and ignores the inherent uniqueness that’s part of each platform. Specifically, Corey calls out the per-cloud stickiness of identity management, security features, and even network functionality. And data gravity is still a thing, says James, that causes some to dismiss multicloud outright.

If you’re using multiple public clouds, you take advantage of the distinct value each offers, Armon says. Use native cloud services where possible so that you see the benefits from useful innovations, built-in resilience, and baked-in best practices. The value from that cloud-infused workload may outweigh the benefits of seamless portability.

https://youtube.com/watch?v=B1VH56_L8f8%3Fenablejsapi%3D1%26

Do: Recognize different stakeholder interests and needs

James smartly points out that many multicloud debates happen because people are arguing from different perspectives. Context matters. If you’re an infrastructure engineer who invests heavily in a given cloud’s identity and access management model, multicloud looks tricky. Or if you’re a data engineer with petabytes of data homed in a particular cloud, multicloud may look unrealistic. James highlights that many developers default to multicloud because their local tools—where all the work happens—are multicloud. A developer’s IDE and preferred code framework(s) aren’t tied to any given cloud. Be aware that groups within your organization will come at multicloud from distinct directions. And this may impact your approach!

https://youtube.com/watch?v=I9sqXDqkKBM%3Fenablejsapi%3D1%26

Don’t: Go it alone

Corey talks about the importance of asking others what worked, and what didn’t. Tammy offers her best practices around sharing results from experiments. It’s about sharing knowledge and tapping into it for community benefit. Others have probably tried what you’re trying, and can help you avoid common pitfalls. If you’ve just made an architectural choice that didn’t work out, share it, and help others avoid the pain. 

Read research from analysts, go to conferences or watch videos to observe case studies, and join online communities that offer a safe place to share mistakes and learn from others.

https://youtube.com/watch?v=mrSb5vqOfuI%3Fenablejsapi%3D1%26

Do: Experiment first using techniques like multi-region deployments

If you think you can operate systems across clouds, how about you first try doing it across regions in a specific cloud, suggests Corey. Getting a system to properly work across cloud regions isn’t trivial, he says, and that experience can help you uncover where you have architectural or operational constraints that will be even worse across cloud providers.

This is great guidance if your multicloud aspirations involve using multiple clouds to power one application—versus the more standard definition of multicloud where you use different clouds for different applications—but can also surface issues in your support process or toolchain that fail when faced with distributed systems. Start with muti-region deployments and chaos engineering experiments before aggressively jumping into multicloud architectures.

The Google Cloud take

Do the things above. It’s great advice. I’ll add three more things that we’ve learned from our customers.

1. Don’t fear multicloud. You’re already doing it. You don’t single-source everything. As Corey mentioned, you probably already have one cloud for productivity tools, another for source code, another for cloud infrastructure. You’ll use software and application services from a mix of providers for a single app. You have that experience in your team and have been doing that for decades. What people do rightly worry about is using more than one infrastructure service beneath an application, as that can introduce latency, security, and logistical hurdles. Make sure you know which model your team is considering.
2. Embrace the right foundational components, including Kubernetes. Will everything run on Kubernetes? Of course not. Don’t try to do that. But it also represents the closest thing we have to a multicloud API. Companies are using Kubernetes to stripe a consistent experience across clouds. And this isn’t just to orchestrate containers, but also to manage infrastructure and cloud-native services. Also, consider where you need other fundamental consistency across clouds, including areas like provisioning and identity federation.
3. Use Google Cloud as your anchor. Here’s a fundamental question you have to decide for yourself: Are you going to bring your on-premises technology and practices to the cloud, or bring cloud technology and practices on-prem? We sincerely believe in the latter. Anchor to where you’re trying to get to. We offer Anthos as a way to build and run distributed Kubernetes fleets in Google Cloud and across clouds. By using a cloud-based backplane instead of an on-prem one, you’re offloading toil, leveraging managed services for scale and security, and introducing modern practices to the rest of your team.

We learned a lot about multicloud through these discussions, and it seems like others did too. That’s why we’re going to do a second round of interviews with a new crop of experts so that we can keep digging deeper into this topic. Stay tuned!

Getting started with your migration

One of the challenges with cloud migration is that you’re solving a puzzle with multiple pieces. In addition to a number of workloads you could migrate, you’re also solving for challenges you’re facing, the use cases driving you to migrate, and the benefits you’re looking to gain. Each organization’s puzzle will likely get solved in their own unique way, but thankfully there is plenty of guidance on how you can migrate common workloads in successful ways. 

In addition to working directly with our Rapid Assessment and Migration Program (RAMP), we also offer a plethora of self-service guides to help you succeed! Some of these guides, which we’ll cover below, are designed to help you identify the best ways to migrate, which include meeting common organizational goals like minimizing time and risk during your migration, identifying the most enterprise-grade infrastructure for your workloads, picking a cloud that aligns with your organization’s sustainability goals, and more: 

• Get started with this cloud migration guide and checklist
• Key considerations for building a migration factory to Google Cloud
• Understanding the cloud migration strategies at your disposal
• Understanding how to migrate key enterprise workloads to Google Cloud

Which workloads are you moving?

In addition to the guides above which help you through your end-to-end migration, it’s also important to understand the specific workloads you’ve got on-premises (or in other clouds). Each workload has their own unique nuances — what works for one might not work perfectly for another. This is where leveraging the expertise of our RAMP team is crucial, and why we have lots of migration guides for specific workloads and end-states. For each workload, we’re highlighting a few guides that we think could be most helpful, but you can also click each topic to learn more or find more guides. 

Microsoft

• Modernization path for .NET applications on Google Cloud
• Managed Service for Microsoft Active Directory is GA
• Migrating Microsoft workloads to Google Cloud yields results

VMware

• Migrate, scale, and innovate at speed
• Boost Retail Intelligence and Agility in the Cloud
• Retire your tech debt: Move vSphere 5.5+ to Google Cloud VMware Engine
• Financial Services Spotlight:  Elevating agility and security in the cloud

Oracle

• Curious about Google Cloud Bare Metal Solution? Start here
• Getting Started with Google Cloud’s Bare Metal Solution
• Guide – Bring new life to your databases with an Oracle migration

SAP

• SAP on Google Cloud: Migration strategies
• Run your SAP workloads on Google Cloud Bare Metal Solution
• eBook – Google Cloud for SAP: The enterprise cloud for business agility, insights, and innovation

Storage

• How to transfer your data to Google Cloud
• An Overview of the Transfer Appliance
• Migration to Google Cloud: Transferring your large datasets
• Transferring data from Amazon S3 to Cloud Storage using VPC Service Controls and Storage Transfer Service

Databases

• Overview of Database Migration Service
• Database migration: Concepts and principles (Part 1)
• Database migration: Concepts and principles (Part 2)
• Database cloud migrations made easy for PostgreSQL, MySQL

Data Warehouses

• Migrating data warehouses to BigQuery: Introduction and overview
• Oracle to BigQuery migration
• Amazon Redshift to BigQuery migration guide
• IBM Netezza to BigQuery migration guide
• Teradata to BigQuery migration guide

Take the next step

When it comes to migration, we’re committed to meet every organization where they are. We fully understand the nuances and challenges of cloud migration, and at Google Cloud we have one singular goal: to help you realize true business value through your cloud migrations. 

Visit our Migration Architecture Center to find even more guides to use during your migration, or if you’re looking to dive a little deeper into planning, sign up for a free discovery and assessment of your existing IT landscape.

Organizations are pressed with the need to engage, retain, and upskill employees with many positions staying fully or partially remote as the pandemic continues. The Center for Digital Government (CDG) reports that 74% of state and local governments believe they will continue hybrid operations for the long-term. This transition is the latest in a long list of reasons agencies are looking for solutions to help train their workforce digitally. Some have found Google Classroom to be the perfect solution.

The State of Iowa knew about the advantages of digital classrooms even before the pandemic. They were already successfully using Google Classroom for in-person training, making the transition to digital seamless when the state closed down. Jessica Van Heuveln, a Google support specialist for the State of Iowa CIO’s Office, says the switch to digital doesn’t deprive workers of hands-on training. “You can use Google Classroom for many different environments, so if you’re doing self-taught, in-person or virtual training, it’s going to work with all those approaches.”

The logistics of a digital classroom

Iowa uses Google Classroom to onboard and upskill employees as well as train volunteers. When the pandemic shifted the state’s workforce to 70% working from home, they needed a  platform that could not only handle a vast range of topics and teaching styles to support remote workers but also scale to meet their demand. Van Heuveln notes that Google Classroom was particularly helpful for handling compliance training, especially with its integration with Google Meet. These trainings often require an entire sector of the workforce to attend a single class with more than 100 attendees, according to Van Heuveln. The logistics of these larger sessions cuts down on the number of total sessions the state needs to host. Iowa also found that employees were less apprehensive about learning when they could do it from the comfort of their own homes.

Iowa follows a train-the-trainer model to train employees expected to instruct using Google Classroom. Trainers working in departments across the state learn to use Google Classroom to create and host virtual learning experiences specific to their own departments. 

Collaborative classrooms made simple

Google Classroom meets many needs for Iowa, such as setting up training, managing attendance, reviewing uploaded coursework, and communicating with attendees. Both course attendees and trainers have everything they need in one place, and robust engagement tools help attendees stay focused while giving trainers the feedback they need from their lessons. Built-in survey options let trainers gauge attendee knowledge, and the chat function ensures no one ever misses a question. The reporting dashboard gives trainers access to analytics to track engagement and attendance, providing insights that can improve future training sessions.

Google Classroom also makes it easier to ensure attendees stay on board throughout the training program. Coursework can be uploaded directly into Google Classroom, and training sessions can be recorded and archived. This feature allows employees to work at their own pace or lets them catch up when a scheduling conflict means they might miss a session.

The enterprise version of Google Classroom Iowa uses interfaces with other Google Workspace tools such as Google Meet, Google Calendar, Google Drive, and Gmail, which streamlines training and leads to more collaboration between employees and trainers. It can also interface with applications from other providers, further boosting its utility as an effective virtual classroom. Google Drive stores training materials securely. Lastly, Google Classroom enterprise comes with 24/7 support to make sure agencies always have everything they need for success.

Helping employees be better prepared to serve

Google Classroom can be a powerful part of any training program, whether it be digital or in-person. Building virtual connections empowers organizations to deliver better experiences. Google Classroom is helping the State of Iowa accomplish this for their constituents. Designed to scale and be accessible from anywhere, the platform helps public employees better serve the public. Virtual training strategies are essential for agencies that are looking to grow their workforce and build employee skill levels. The most important thing, however, is that training programs enable employees to further your agency’s mission. To learn more about Google Classroom and see more solutions designed with government in mind, check out the Google Cloud for government page.

We’re continuing to expand our global footprint — and we’re doing it rapidly. In 2020, we announced our plans to launch a new cloud region to help accelerate the economic recovery and growth of Spain. Today, we’re excited to announce that our new Google Cloud region in Madrid is officially open.

Designed to help meet the growing technology needs of Spanish businesses, the new Madrid region (europe-southwest1) provides low-latency, highly available cloud services with high international security and data protection standards — all on the cleanest cloud in the industry. The new Madrid region joins our network of 33 regions throughout the globe, helping local Spanish businesses connect with users everywhere. You can join us at our region celebration on May 25 here.

A cloud built for Spain

Google Cloud’s global network of regions is the cornerstone of our cloud infrastructure, enabling us to deliver high-performance, low-latency, sustainable cloud-based services and products to support our customers across the globe.

Built in partnership with Telefónica, the new Madrid region offers Google Cloud’s unique global infrastructure locally, creating new opportunities for digital transformation across various industries and making it easier for organizations at any stage of their cloud journey to securely deliver faster, more reliable customer experiences.

Accelerating digital transformation also requires cloud services that meet regulatory compliance and digital governance requirements. In particular, highly regulated sectors like government, healthcare, and financial services need additional controls to store data and run workloads locally.

“We welcome the Cloud capabilities that the Google Cloud region is bringing to Spain. It is especially important for the alignment with the security levels that public sector organizations demand and as required in the National Security Scheme. They must take advantage of a cloud that is offered locally with the highest security guarantees. The collaboration with hyperscalers is key. It is also essential to continue advancing with best practices adoption, training, security configurations and supervision” Luis Jimenez, Subdirector del Centro Criptológico Nacional.

Having a new region in Madrid helps remove these barriers to cloud adoption, allowing both Spanish businesses and government entities to meet their availability, data residency, and sustainability needs in Spain while also accelerating their digital transformation.

The Madrid region is launching with three cloud zones to prevent service interruptions, and our standard set of products, including Compute Engine, Google Kubernetes Engine, Cloud Storage, Persistent Disk, CloudSQL, and Cloud Identity. . Customers will also get access to smarter analytics capabilities, AI and ML solutions, and application modernization tools that allow them to unleash the full potential of cloud computing.

At the same time, customers will benefit from controls that enable them to maintain the highest security, data residency, and compliance standards, especially those that deal with specific data storage requirements.

“In DIA Group we have always been committed to seeking innovative solutions to improve our customers’ experience while respecting the trust they place on us every day. For this reason we have decided to rely on the new Google Cloud region in Madrid for some of our most critical workloads like our store operations (orders, inventory, product stock, etc). This will guarantee our customers a low-latency service while managing their data within the national borders, as well as optimized performance.” – Carlos Valero, Chief Information Officer, Grupo DIA

“Offering our customers low-latency services while keeping workloads and data management safe, is vital for us. The availability of the new Google Cloud region in Madrid represents a great step forward that will allow us to achieve our goals and meet the expectations of our customers by offering them a premium user experience without neglecting data security and residency.” – Carmen Lopez Herranz, CTO, BBVA

Going beyond with a transformation cloud

At Google Cloud, we’re constantly working to help customers across various industries achieve what was once considered impossible, reinvent themselves, and transform the way they serve their customers using digital technology — all on the cleanest cloud in the industry.

Our transformation cloud is helping businesses become:

Smarter: Google Cloud lets you leverage data for deeper insights with a unified platform that makes it easy to get value from structured or unstructured data, regardless of where it resides.
Open: Google Cloud’s commitment to multicloud, hybrid cloud, and open source provides the freedom to choose the right solutions, allowing developers to build and innovate faster, in any environment.
Connected: Digital transformation isn’t just about technology — it’s about people and culture. In an era where work can happen anywhere, Google Cloud provides the tools needed to be more innovative, productive, and make faster decisions, together.
Trusted: Google Cloud offers strong security capabilities and a zero-trust architecture to help protect data, applications, and infrastructure against potential threats. We also provide specific offerings and work closely with local partners to help address digital sovereignty requirements emerging from both customers and policymakers.

In addition to the launch of our new Madrid cloud region, we’re making other commitments that will pave the way for new business innovations and development in Spain. The Grace Hopper subsea cable landed in September 2021 in Bilbao, connecting Spain and the UK with the United States for increased performance and greater support using the same network that powers Google infrastructure and products.

We’re also helping people develop new skills that will enable society to champion cloud technology and growth in the future. Google has already helped to train more than 1 million people with our Grow with Google program in Spain, and we have future plans to open a center of excellence for cybersecurity in Malaga and support the creation of the AI Lab Granada, in collaboration with Indra Minsait in the coming years.

For more details about the Madrid region, head to our cloud locations page, where you’ll find updates on the availability of additional services and regions.

Editor’s note: Today’s guest post comes from Indian social media platform ShareChat. Here’s the story of how they improved performance, app development, and analytics for serving regional content to millions of users using Google Cloud. 

How do you create a social network when your country has 22 major official languages and countless active regional dialects? At ShareChat, we serve more than 160 million monthly active users who share and view videos, images, GIFs, songs, and more in 15 different Indian languages. We also launched a short video platform in 2020, Moj, which already supports over 80 million monthly active users. 

Connecting with people in the language they understand

As mobile data and smartphones have become more affordable in India, we noticed a large new segment of people, many in rural areas, being welcomed onto the internet. However, many of them didn’t speak English, and when it comes to accessing content and information—language plays a significant role. Instead of joining other social media sites where English reigned supreme, new internet users chose to join language or dialect-specific Whatsapp groups where they felt more comfortable instead.

So, we set out to build a platform where people can share their opinions, document their lives, and make new friends, all in their native language. ShareChat simplifies content and people discovery by using a personalized content newsfeed to deliver language-specific content to the right audience.

Given the high-intensity data and high volume of content and traffic, we rely heavily on IT infrastructure. On top of that, a large number of our users rely on 2G networks to post, like, view, or follow each other. Our platform needs to deliver great experiences to people who are spread out across the country and different networks without any reduction in performance.

The right cloud partner to support future growth

ShareChat was born in the cloud—we already knew how to scale systems to serve a large customer base with our existing cloud provider. But like many companies, we struggled with over-provisioning compute and storage to accommodate unpredictable traffic and avoid running out of storage. With demand rising for local language content and an increase in online interactions in response to the COVID-19 crisis, we realized that we would need a more efficient way to scale dynamically and allocate resources as needed.

Google Cloud was a natural choice for us. We wanted to partner with a technology-first company that would make it easy (and cost-effective) to manage a strong technology portfolio that would allow us to build whatever we wanted. Google is at the forefront of technology innovation and provided everything we needed to build, run, and manage our applications (including creating an efficient DevOps pipeline to fix and release new features quickly). 

We had a few issues in mind at the start of discussions with the Google Cloud team, but over time, as we got information and support from them, we realized that these were the partners we wanted in our corner when it came time to tackle our most challenging problems. In the end, we decided to take our entire infrastructure to Google Cloud.

To support millions of users, we deploy and scale using Google Kubernetes Engine. While we analyze our data using a combination of managed data cloud services, such as Pub/Sub for data pipelines, BigQuery for analytics, Cloud Spanner for real-time app serving workloads, and Cloud Bigtable for less-indexed databases. We also rely on Cloud CDN to help us distribute high-quality and reliable content delivery at low latency to our users. 

We now use just half the total core consumption of our legacy environment to run ShareChat’s existing workloads.

Google Cloud delivers better outcomes at every level 

By moving to Google Cloud, we saw major benefits in several key areas: 

Zero-downtime migration for users

At the time of migration, we had over 70 terabytes of data, consisting of 220 tables—some of which were up to 14 terabytes with nearly 50 billion rows. Due to our data’s interdependencies, moving services over one at a time wasn’t an option for us. 

Even though we were migrating such large volumes of data, we didn’t want to impact any of our customers. Latency spikes for out-of-sync data might affect message delivery. For instance, if a message or notification was delayed, we didn’t want to risk a bad user experience causing someone to abandon ShareChat. 

To prepare for the move, we ran a proof-of-concept cluster for over four months to test database performance in a real-world scenario for handling more than a million queries per second. Using an open-source API gateway, we replicated our legacy data environment into Google Cloud for performance testing and capacity analysis. As soon as we were confident Google Cloud could handle the same traffic as our previous cloud environment, we were ready to execute.

Using wrappers, we were able to migrate without having to change anything in our existing application code. The entire migration of 60 million users to Google Cloud took five hours—without any data loss or downtime. Today, ShareChat has grown to 160 million users, and Google Cloud continues to give us the support we need.

Scaling globally to meet unexpected demand

We rely on real-time data to drive everything on ShareChat by tracking everything that goes on in our app—from messages and new groups to content people like or who they follow. Our users create more than a million posts per day, so it’s critical that our systems can process massive amounts of data efficiently. 

We chose to migrate to Spanner for its global consistency and secondary index. Unlike our legacy NoSQL database, we could scale without having to rethink existing tables or schema definitions and keep our data systems in sync across multiple locations. It’s also cost-effective for us—moving over 120 tables with 17 indexes into Cloud Spanner reduced our costs by 30%.

Spanner also replicates data seamlessly in multiple locations in real time, enabling us to retrieve documents if one region fails. For instance, when our traffic unexpectedly grew by 500% over just a few days, we were able to scale horizontally with zero lines of code change. We were also launching our Moj video app simultaneously, and we were able to move it to another region without a single issue. 

Simplifying development and deployment

On average, we experience about 80,000 requests per second (RPS) –nearly 7 billion RPS per day. That means daily push notifications sent out to the entire user base about daily trending topics can often result in a spike of 130,000 RPS in just a few seconds. 

Instead of over-provisioning, Google Kubernetes Engine (GKE) enables us to pre-scale for traffic spikes around scheduled events, such as holidays like Diwali, when millions of Indians send each other greetings. 

Migrating to GKE has also enabled us to adopt more agile ways of work, such as automating deployment and saving time with writing scripts. Even though we were already using container-based solutions, they lacked transparency and coverage across the entire deployment funnel. 

Kubernetes features, such as sidecar proxy, allows us to attach peripheral tasks like logging into the application without requiring us to make code changes. Kubernetes upgrades are managed by default, so we don’t have to worry about maintenance and stay focused on more valuable work. Clusters and nodes automatically upgrade to run the latest version, minimizing security risks and ensuring we always have access to the latest features.

Low latency and real-time ML predictions

Even though many of our users may be accessing ShareChat outside of metropolitan areas, it doesn’t mean they’re more patient if the app loads slowly or their messages are delayed. We strive to deliver a high-performance experience, regardless of where our users are. 

We use Cloud CDN to cache data in five Google Cloud Point of Presence (PoP) locations at the edge in India, allowing us to bring content as close as possible to people and speeding up load time. Since moving to Cloud CDN, our cache hit ratio has improved from 90% to 98.5%—meaning our cache can handle 98.5% of content requests. 

As we expand globally, we’d like to use machine learning to reach new people with content in different languages. We want to build new algorithms to process real-time datasets in regional languages and accurately predict what people want to see. Google Cloud gives us an infrastructure optimized to handle compute-intensive workloads that will be useful to us both now—and in the future.  

The confidence to build the best platform

Our current system now performs better than before we migrated, but we are continuously building new features on top of it. Google’s data cloud has provided us with an elegant ecosystem of services that allows us to build whatever we want, more easily and faster than ever before. 

Perhaps the biggest advantage of partnering with Google Cloud has been the connection we have with the engineers at Google. If we’re working to solve a specific problem statement and find a specific solution in a library or a piece of code, we have the ability to immediately connect with the team responsible for it. 

As a result, we have experienced a massive boost in our confidence. We know that we can build a really good system because we not only have a good process in place to solve problems—we have the right support behind us.