Explore Google Cloud SQL's 3 Fault Tolerance Mechanism to Ease Data Pro - Build What's Next
Blog

Explore Google Cloud SQL’s 3 Fault Tolerance Mechanism to Ease Data Pro

5211

Of your peers have already read this article.

2:00 Minutes

The most insightful time you'll spend today!

Grow your organization's fault tolerance with Cloud SQL's three fault tolerance mechanism, and ensure data protection as well as recovery human errors, primary instance failures and zonal outages, and regional outages.

If you’re managing a crucial application that has to be fully fault-tolerant, you need your system to be able to handle every fault, no matter the type and scope of failure, with minimal downtime and data loss. Protecting against these faults means juggling numerous variables that can impact performance as well as recovery time and cost.

Today’s managed database services take over the operational complexity that used to exist for database administrators. Growing your organization’s tolerance required adding machines, compute, and storage, plus the operational costs of IT management: performing backups, writing scripts, creating dashboards, and carrying out testing to make sure your platform is ready when problems arise–all in a secure way.

At Google, our Cloud SQL managed database service offers three fault tolerance mechanisms —backup, high availability, and replication—and there are three major factors to consider for each of them:

  • RTO (recovery time objective): When a failure happens, how much time can be lost before significant harm occurs?
  • RPO (recovery point objective): When a failure happens, how much data can be lost before significant harm occurs?
  • Cost: How cost-effective is this solution?  

We’ve heard from customers like Major League BaseballHSBC, and Equifax that they have strict data-protection needs and require highly fault-tolerant multi-region applications—and they’ve all chosen Cloud SQL to meet those needs. 

Let’s take a closer look at how the decision-making process plays out for each recovery solution.  

High availability (HA)

If your application is business critical, you require minimum RTO and zero RPO— a high availability configuration ensures that you and your customers are protected. If the primary instance fails, there’s another standby instance ready to take over with no data loss. There’s an additional cost here, but doing this manually brings a great operational cost, since you have to detect and verify the fault, do the failover, and make sure it’s correct—you can’t have two primary instances or you risk data corruption—then finally connect the application to the new database.

Cloud SQL removes all that complexity. Choose high availability for a given instance and we’ll replicate the data across multiple zones, synchronously, to each zone’s persistent disk. If an HA instance has a failure, you don’t have to think about when to fail over because Cloud SQL detects the failure and automatically initiates failover, for a full recovery and no data loss within minutes. Cloud SQL also moves the IP address during failover so your application can easily reconnect. MLB, for example, uses Cloud SQL high availability to serve prediction data to live games with minimal downtime. Dev/test instances don’t need those same guarantees, but can use local backups to recover from any potential failure.

Cross-region replica

If a whole Google Cloud region goes down you still need your business to continue to run. That’s where cross-region replication comes in, a hot standby replica in another Google Cloud region provides RTO of minutes and RPO typically less than a minute . If you create a read replica in a region separate from your primary instance and you get hit with a regional outage, your application and database can start serving customers from another region within minutes. But this solution can be complex and enabling it yourself can be difficult and time-consuming. Securing cross-geography traffic demands end-to-end encryption and can bring connectivity issues too. 

This is where the fully managed Cloud SQL solution shines. We offer MySQL, PostgreSQL and SQL Server database engines as a cross-region replication solution that’s easily configured and bolstered by Google’s interconnected global network. Just say, “I’m in U.S. East, I want to create a replica in U.S. West,” and it’s done, reliably and securely.

create read replica.jpg

Backup

When you suffer data loss because of an operations error (for example, a bug in a script dropped your tables) or human error (for example, someone dropped the wrong table by accident), backups help you restore lost data to your Cloud SQL instance. Our low cost backup mechanism features point-in-time, granular recovery, meaning that if you accidentally delete data or something else goes wrong, you can ask for recovery of, for example, the state of that database down to the millisecond, such as Monday at 12:53pm. Your valuable data is replicated multiple times in multiple geographic locations automatically. This enables the automatic handling of failover in cases of major failure. You can always rest assured that your database is available and data is secure, even in the times of major failure crises. 

Cloud SQL provides automated and on-demand backups. With automated backups, Google manages the backups so that you can easily restore them when required. Also, the scheduled backing is automatically taken by default. With on-demand backup, you can create a backup at any time. This could be useful if you are about to perform a risky operation on your database, as Cloud SQL lets you select a custom location for your backup data. When the backup is stored in multiple regions, and there’s an outage in the region that contains the source instance, you can restore a backup to a new or existing instance in a different region. This is also useful if your organization needs to comply with data residency regulations that require you to keep your backups within a specific geographic boundary.

cloud sql backups.jpg

Putting it all together

For critical workloads, MLB configures their Cloud SQL instances with backups, high availability, and cross-region replication. Doing so ensures they can recover from many failure types.

  • To recover from human error (“Oops, I didn’t mean to delete that”), MLB uses backups and point-in-time recovery to recovery to a millisecond or specific database transaction
  • To automatically recover from primary instance failures and zonal outages, MLB uses Cloud SQL’s high availability configuration
  • To protect against regional outages, MLB uses cross-region replication

Creating a robust configuration, like MLB did, takes just a few minutes. Get started in our Console or review documentation.

Blog

Explore Google Cloud SQL’s 3 Fault Tolerance Mechanism to Ease Data Pro

5212

Of your peers have already read this article.

2:00 Minutes

The most insightful time you'll spend today!

Grow your organization's fault tolerance with Cloud SQL's three fault tolerance mechanism, and ensure data protection as well as recovery human errors, primary instance failures and zonal outages, and regional outages.

If you’re managing a crucial application that has to be fully fault-tolerant, you need your system to be able to handle every fault, no matter the type and scope of failure, with minimal downtime and data loss. Protecting against these faults means juggling numerous variables that can impact performance as well as recovery time and cost.

Today’s managed database services take over the operational complexity that used to exist for database administrators. Growing your organization’s tolerance required adding machines, compute, and storage, plus the operational costs of IT management: performing backups, writing scripts, creating dashboards, and carrying out testing to make sure your platform is ready when problems arise–all in a secure way.

At Google, our Cloud SQL managed database service offers three fault tolerance mechanisms —backup, high availability, and replication—and there are three major factors to consider for each of them:

  • RTO (recovery time objective): When a failure happens, how much time can be lost before significant harm occurs?
  • RPO (recovery point objective): When a failure happens, how much data can be lost before significant harm occurs?
  • Cost: How cost-effective is this solution?  

We’ve heard from customers like Major League BaseballHSBC, and Equifax that they have strict data-protection needs and require highly fault-tolerant multi-region applications—and they’ve all chosen Cloud SQL to meet those needs. 

Let’s take a closer look at how the decision-making process plays out for each recovery solution.  

High availability (HA)

If your application is business critical, you require minimum RTO and zero RPO— a high availability configuration ensures that you and your customers are protected. If the primary instance fails, there’s another standby instance ready to take over with no data loss. There’s an additional cost here, but doing this manually brings a great operational cost, since you have to detect and verify the fault, do the failover, and make sure it’s correct—you can’t have two primary instances or you risk data corruption—then finally connect the application to the new database.

Cloud SQL removes all that complexity. Choose high availability for a given instance and we’ll replicate the data across multiple zones, synchronously, to each zone’s persistent disk. If an HA instance has a failure, you don’t have to think about when to fail over because Cloud SQL detects the failure and automatically initiates failover, for a full recovery and no data loss within minutes. Cloud SQL also moves the IP address during failover so your application can easily reconnect. MLB, for example, uses Cloud SQL high availability to serve prediction data to live games with minimal downtime. Dev/test instances don’t need those same guarantees, but can use local backups to recover from any potential failure.

Cross-region replica

If a whole Google Cloud region goes down you still need your business to continue to run. That’s where cross-region replication comes in, a hot standby replica in another Google Cloud region provides RTO of minutes and RPO typically less than a minute . If you create a read replica in a region separate from your primary instance and you get hit with a regional outage, your application and database can start serving customers from another region within minutes. But this solution can be complex and enabling it yourself can be difficult and time-consuming. Securing cross-geography traffic demands end-to-end encryption and can bring connectivity issues too. 

This is where the fully managed Cloud SQL solution shines. We offer MySQL, PostgreSQL and SQL Server database engines as a cross-region replication solution that’s easily configured and bolstered by Google’s interconnected global network. Just say, “I’m in U.S. East, I want to create a replica in U.S. West,” and it’s done, reliably and securely.

create read replica.jpg

Backup

When you suffer data loss because of an operations error (for example, a bug in a script dropped your tables) or human error (for example, someone dropped the wrong table by accident), backups help you restore lost data to your Cloud SQL instance. Our low cost backup mechanism features point-in-time, granular recovery, meaning that if you accidentally delete data or something else goes wrong, you can ask for recovery of, for example, the state of that database down to the millisecond, such as Monday at 12:53pm. Your valuable data is replicated multiple times in multiple geographic locations automatically. This enables the automatic handling of failover in cases of major failure. You can always rest assured that your database is available and data is secure, even in the times of major failure crises. 

Cloud SQL provides automated and on-demand backups. With automated backups, Google manages the backups so that you can easily restore them when required. Also, the scheduled backing is automatically taken by default. With on-demand backup, you can create a backup at any time. This could be useful if you are about to perform a risky operation on your database, as Cloud SQL lets you select a custom location for your backup data. When the backup is stored in multiple regions, and there’s an outage in the region that contains the source instance, you can restore a backup to a new or existing instance in a different region. This is also useful if your organization needs to comply with data residency regulations that require you to keep your backups within a specific geographic boundary.

cloud sql backups.jpg

Putting it all together

For critical workloads, MLB configures their Cloud SQL instances with backups, high availability, and cross-region replication. Doing so ensures they can recover from many failure types.

  • To recover from human error (“Oops, I didn’t mean to delete that”), MLB uses backups and point-in-time recovery to recovery to a millisecond or specific database transaction
  • To automatically recover from primary instance failures and zonal outages, MLB uses Cloud SQL’s high availability configuration
  • To protect against regional outages, MLB uses cross-region replication

Creating a robust configuration, like MLB did, takes just a few minutes. Get started in our Console or review documentation.

Whitepaper

The Pathway to Innovation: Migrating SAP to the Cloud

DOWNLOAD WHITEPAPER

3442

Of your peers have already downloaded this article

5:30 Minutes

The most insightful time you'll spend today!

While innovation remains a top priority across all industries, many companies are not achieving the results they want from their innovation efforts. As companies migrate their SAP enterprise resource planning (ERP) systems to the cloud, technology leaders see this as an opportunity to reimagine business processes and propel their innovation strategies.

This paper will explore the benefits that companies have reaped from their SAP cloud migration, such as using IT resources more effectively, gaining deeper insights from data, and improving innovation. It will also examine the approach organizations are taking to gain buy-in from other stakeholders in their operations, positioning the SAP migration for a successful outcome.

3235

Of your peers have already watched this video.

20:00 Minutes

The most insightful time you'll spend today!

Webinar

The Transformative Journeys of Financial Firms on Google Cloud: Watch Video

The reliance on cloud-based architectures, high performance computing, big data and more are accelerating in the banking, capital, insurance and financial services industries. Google Cloud had a strong role in transforming many businesses especially in the pandemic to smoothly transition into the digital space and understand their customers. Two years since then, financial firms have been able to design better products based on intelligent, real-time insights and leverage many capabilities of Google Cloud to deliver tailored experiences. So, how big of an impact Google Cloud has on the future of the financial services? The answer is huge and endless.

Watch this video to dive into the state of global financial services companies that leveraged modern cloud architecture for their sensitive data, platforms, devices and products while they increase revenues, stay compliant and curb costs.

Case Study

Indian social media platform ShareChat saw a 50% reduction in costs after migrating to Google Cloud

4345

Of your peers have already read this article.

6:30 Minutes

The most insightful time you'll spend today!

As India’s premier social media platform, ShareChat saw significant engagement from its 60 million monthly active users during the lockdown. Bhanu Pratap Singh, Co-founder, ShareChat, talks about why they decided to migrate to Google Cloud and how the move shrunk costs by 50%.

One of the key trends that emerged from the lockdown brought about by the COVID-19 outbreak was the significant rise in people seeking entertainment online.

According to data released by Carat India, smartphone usage increased by 1.5 hours a week and social media consumption nearly doubled to 280 minutes a day. Of India’s 670 million internet users, a significant percentage live in rural areas, which saw a surge in demand for local language content.

As India’s premier social media platform, ShareChat saw significant engagement from its 60 million monthly active users (MAU) during the lockdown. The platform now has surpassed 120 million MAU post the government banning 59 Chinese apps in the last week of June.

ShareChat was founded by Ankush Sachdeva (co-founder and Chief Executive Officer), Farid Ahsan (co-founder and Chief Operating Officer), and Bhanu Pratap Singh (co-founder and Chief Technical Officer), in 2015.

In a recent conversation with YourStory, Bhanu spoke about content consumption during COVID-19, how they are reaching out to the country’s vernacular audience and their recent transition to Google Cloud.

Read the Full Story on YourStory

Blog

Google and Fervo Agreement to Shape-up Plans for 24/7 Carbon-free Energy by 2030

4790

Of your peers have already read this article.

1:30 Minutes

The most insightful time you'll spend today!

Google and Fervo, a clean-energy startup, recently signed their corporate agreement to build a next-generation geothermal power project that will power an “always-on” carbon-free resource to bring down the dependency on fossil fuels. Learn more.

When Google announced our plan to go beyond purchasing renewable power for 100% of our energy usage and operate on 24/7 carbon-free energy by 2030, we noted that achieving this goal will require new transaction structuresadvancements in clean energy policy, and innovative new technologies. Today, we’re pleased to announce that one of these new technologies—a first-of-its-kind, next-generation geothermal project—will soon begin adding carbon-free energy to the electric grid that serves our data centers and infrastructure throughout Nevada, including our Cloud region in Las Vegas.  

Google and clean-energy startup Fervo have just signed the world’s first corporate agreement to develop a next-generation geothermal power project, which will provide an “always-on” carbon-free resource that can reduce our hourly reliance on fossil fuels. In 2022, Fervo will begin adding “firm” geothermal energy to the state’s electric grid system, where Google’s commitments already include one of the world’s largest corporate solar-plus-storage power purchase agreements. 

Importantly, this collaboration also sets the stage for next-generation geothermal to play a role as a firm and flexible carbon-free energy source that can increasingly replace carbon-emitting fossil fuels—especially when aided by policies that expand and improve electricity markets; incentivize deployment of innovative technologies; and increase investments in clean energy research, development, and demonstration (RD&D). 

Next-generation geothermal technology

Traditional geothermal already provides carbon-free baseload energy to a number of power grids. But because of cost and location constraints, it accounts for a very small percentage of global clean energy production. 

That’s one reason this new approach is so exciting; by using advanced drilling, fiber-optic sensing, and analytics techniques, next-generation geothermal can unlock an entirely new class of resource. And the US Department of Energy has found that with advancements in policy, technology, and procurement, geothermal energy could provide up to 120 GW of firm, flexible generation capacity in the US by 2050. 

As part of our agreement, Google is partnering with Fervo to develop AI and machine learning that could boost the productivity of next-generation geothermal and make it more effective at responding to demand, while also filling in the gaps left by variable renewable energy sources. Although this project is still in the early stages, it shows promise.

gcp sustainability.gif
Click to enlarge

Using fiber-optic cables inside wells, Fervo can gather real-time data on flow, temperature, and performance of the geothermal resource. This data allows Fervo to identify precisely where the best resources exist, making it possible to control flow at various depths. Coupled with the AI and machine learning development outlined above, these capabilities can increase productivity and unlock flexible geothermal power in a range of new places. 

This won’t be the first time that Google is applying software solutions to clean energy applications: we’ve just announced an update to our carbon-intelligent computing program that helps us reduce emissions associated with running applications at Google data centers. And other forms of AI and machine learning are currently being used to increase the value of wind energy

Already this year, Google has taken significant strides toward sourcing 24/7 carbon-free energy for all our data centers, office campuses, and Cloud regions. On Earth Day, our CEO Sundar Pichai announced that for the first time, five of our global data center sites operated near or at 90% carbon-free energy in 2020. 

Not only does this Fervo project bring our data centers in Nevada closer to round-the-clock clean energy, but it also acts as a proof-of-concept to show how firm clean energy sources such as next-generation geothermal could eventually help replace carbon-emitting power sources around the world.

More Relevant Stories for Your Company

Case Study

There are 2 Key Traits You Need to Battle the Slowdown. FM Logistic Know How to Enable Them

FM Logistic provides its international customers with complete logistics solutions that cover everything from warehousing and handling, to transport and distribution, co-packing and co-manufacturing, and supply chain optimization. Operating in 14 countries including France, Russia, Poland, India, Vietnam, Brazil, and China, FM Logistic supports its clients by offering specialized services across

Blog

Google Cloud Featured at TechCrunch Disrupt 2021

Startups need to move quickly and focus their limited resources on areas where they can differentiate. If infrastructure isn’t your differentiator, don’t put a lot of energy into your infrastructure when someone else can do it for you. What’s more, time-to-market matters to startups more now than ever. Successful early

Case Study

Cloud Bigtable Helps Fraud-detection Company Meet Scalability Demands and Secure Customer Data

Editor’s note: Today we are hearing from Jono MacDougall , Principal Software Engineer at Ravelin. Ravelin delivers market-leading online fraud detection and payment acceptance solutions for online retailers. To help us meet the scaling, throughput, and latency demands of our growing roster of large-scale clients, we migrated to Google Cloud and its

Blog

Titanium: A Robust Foundation for Workload-optimized Cloud Computing

Google Cloud is built on world-class technical infrastructure that supports services that are loved and relied on by billions of people across the globe: Google Search, YouTube, Gmail, Google Maps and more. A core tenet at Google Cloud is to leverage Google’s experience building and operating highly available and highly

SHOW MORE STORIES