Google had Enough of Flooding in India. Here’s What It Did About It - Build What's Next

5773

Of your peers have already watched this video.

4:50 Minutes

The most insightful time you'll spend today!

Case Study

Google had Enough of Flooding in India. Here’s What It Did About It

Over the last century, floods have become the most common and deadly natural disaster on the planet.

Many countries currently lack effective early warning systems and alerts. Today, 20 percent of flood fatalities occur in India.

To help, Google sent a team to study the Ghaghara River, near Patna.

“In India, where we’re running our first pilot program, the government has thousands of people who measure water levels, every hour, in rivers across India, with what is effectively very long measuring sticks. They are called stream gauges. This allows them to know whether the river will overflow and flood. But it doesn’t yet allow them to understand exactly what areas are going to be affected, what neighborhoods, or even what villages,” says Sella Nevo, Tech Lead, Google Flood Forecasting.

“The big technical question was: Do we have enough information to try to do forecasting that would be accurate enough to make a difference?” says Yossi Matias, VP of Engineering and Crisis Response Lead, Google.

This is their incredible story. It includes collecting thousands of satellite images and generating hundreds of thousands of simulations of how a river could possibly behave.

Case Study

Google Cloud’s Virtual Appointment Scheduling Tool (VAST) Helps State of Arizona Recover from Unemployment Situation

6542

Of your peers have already read this article.

2:00 Minutes

The most insightful time you'll spend today!

The state of Arizona partnered with Google Cloud and SADA to build Virtual Appointment Scheduling Tool (VAST) to expedite form uploading, virtual career counselling and other administrative tasks for citizens to find jobs during the pandemic phase!

When the world was forced to go primarily online, state governments also faced the reality of needing to provide community services without the health risk of meeting in person. Old systems that relied on interpersonal contact could not keep up. An unprecedented number of displaced workers swamped every unemployment system. The capacity challenges weren’t limited to state labor departments either. Everything from birth certificates and marriage licenses to apostilles and court system services that could usually be handled by a simple walk-in had to be scheduled in advance. Both internal and external communication suffered. 

To meet these challenges, many organizations turned to new technology solutions and innovative approaches.

How VAST helped Arizona get back to work

The State of Arizona had tens of thousands of constituents who relied on pandemic unemployment insurance and would also need tools to reenter the workforce.Tim Tucker, Deputy Administrator of the Workforce Development Administration for the Arizona Department of Economic Security, started preparing in late 2020. He collaborated with Google Cloud and SADA to introduce the Virtual Appointment Scheduling Tool (VAST) to State of Arizona staff members. Using VAST reduced the excessive workload taken on by the Workforce Development Administration as they got Arizona back to work. VAST lets constituents book an appointment, upload documents and forms, and conduct career counseling virtually. This helped constituents move through the system faster so they could successfully reenter the workforce.

That preparation paid off. As of September 2021, Arizona had recovered the majority of the jobs lost during the pandemic. It has also seen one of the smallest percent change in employment compared with pre-pandemic numbers. Even more impressive, Arizona is one of only five states where unemployment claims are now lower than pre-pandemic numbers. Using VAST helped them get people back to work faster and has become a permanent part of their unemployment program.

Bringing streamlined services to the community

To fully realize a solution to the challenges faced by our public sector customers, we focused on three key areas in which we knew we needed VAST to excel:

  • Efficient staff allocation
  • Streamlined internal meetings
  • Confident constituent interactions

We also knew our customers needed to get VAST online fast, and it needed to work with existing infrastructure without requiring a total overhaul. These areas informed the design of VAST’s features and have allowed us to meet the challenges faced by agencies such as the Arizona Department of Economic Security.

Virtual Agent support and integrations

VAST gives constituents 24×7 virtual agent support powered by  Google Cloud’s contact center AI virtual agents. Virtual agents are custom programmed to fit the specific needs of each agency and community they serve. It’s easy to add new options and information whenever an update is needed. Virtual agents can be designed to understand the user’s intent and serve up relevant content for a smooth user experience on both ends of the system. Virtual agents run at scale and offer multi-language support, ensuring they can serve everyone in the community. By pairing these with VAST, constituents can experience seamless self-service. 

6 week deployment time

Most of our public sector clients needed a solution yesterday. VAST can be deployed rapidly, taking about six weeks from start to finish, which includes everything–even staff training time.

 Integration with Google Workspace and Chrome

VAST securely integrates with other Google solutions, such as Google Workspace and Chromebooks. We work to ensure VAST is fully functional within your existing systems.

Collaboration and support

SADA collaborates with each organization to ensure that the design, development, and functionality of VAST align with their needs. SADA specializes in helping public sector customers migrate to Google Cloud. 

Analytics

Application administrators have access to analytic data gathered by VAST and options to customize and add additional datasets.This data helps organizations find blind spots in coverage, fix service bottlenecks, and better organize internal resources. Leveraging this data gives organizations the power to make changes, resulting in everything from a smoother customer experience to cost savings.

To learn more about how Google Cloud has supported Arizona during the pandemic, check out this blog on how their vaccination distribution system leveraged Google Cloud to get the vaccine to more people. For more information on how VAST can streamline a customer experience.

Trend Analysis

Cloud and AI Paves the Future of Finance: Excerpts from FIA Boca 2022

6608

Of your peers have already read this article.

4:00 Minutes

The most insightful time you'll spend today!

Majority of businesses in the financial markets offer services on cloud. As cloud consumption mostly increases over the next few months, there are new ways technologies can help lay the foundation for the finance industry. Read more!

Financial markets were among the first to adopt new technologies, and that has certainly been true of the derivatives markets, which were early adopters of electronic trading. Going forward, new capabilities will transform the way industry participants communicate, analyze, and trade.

I sat down with Google Cloud’s Phil Moyer and former SEC Commissioner, Troy Paredes, for a fireside chat at FIA Boca 2022 to discuss the future of markets and policy, the new technologies that are already paving the way for greater speed and transparency, and how cloud can help promote greater resiliency, performance, and security to enable the long-term vision for the market. The following is a summary of our discussion.

The current state of cloud technology


When it comes to technology adoption, we’re seeing the market and participants adopt cloud technologies, and increasingly, machine learning (ML) on a wider scale. Cloud technology allows for easier, faster, and much more secure experimentation with large datasets and ML.

A recent Google sponsored study by Coalition Greenwich (September, 2021) showed that more than 93% of trading systems, exchanges, and data providers are in some way providing services on the cloud. The same study, revealed that about 72% of the financial industry across the buy side and sell side, intend to consume public cloud-data based market data within the next 12 months.

Data-driven decision-making and risk management have always been, and continue to remain, the cornerstones of the financial markets. Over time, technology innovation has facilitated access to better insights from data, and therefore, better decision-making and the ability to manage risk. That expectation is now mainstream, and will continue to grow in sophistication.

The multi-phased technology trajectory


The movement of exchanges to the cloud will occur in a “crawl-walk-run” fashion, with low-hanging fruits the first to be picked in the near term while bigger, paradigmatic changes will occur over the medium and long term. Some organizations are starting all three stages simultaneously, understanding that each will move at an independent cadence.

The “crawl” phase is one in which foundations are built, starting with organizations moving data to the cloud and experimenting with some degree of analytics. It’s one of the most important phases because it’s where the opportunity to increase transparency and risk management takes shape.

In moving to the cloud, the infrastructure – which in the past relied on a combination of people, processes, and some technology – becomes the code that runs applications. This early phase is key to empowering organizations to shift to a cloud-based, agile-first operating model that makes it easier and more seamless to launch new products in the future, including by freeing up people and resources from IT management to more mission-focused work.

Establishing the cloud operating model simplifies the “walk” and “run” phases where compliance is more automated, latency-sensitive applications are more readily available, and the next generation of exchanges, market participants, and regulators is better prepared to meet future challenges.

The “walk” phase is where much of the innovation happens. Exchanges are making significant progress in leveraging foundational data decisions in the “crawl” phase and innovations in the cloud to improve settlement, clearing, risk management, collateral management, and compliance, and launch new products.

And finally, the “run” phase is where organizations will start to move the latency-sensitive markets to the cloud, as the markets increasingly will demand low-latency and high performance along with transparency and analytics to solve historical obstacles to market access.

Opportunities for both regulators and market participants


Any time significant technological change takes place, regulators explore its implications, particularly with respect to their ability to meet their regulatory objectives.

Increasingly, we are seeing technological change driving more opportunities for regulators and market participants alike. Such changes may also allow better protection of the marketplace, with greater integrity and transparency.

Over time, regulatory regimes – rules, regulations, statutes, interpretations, and guidance – will also adjust to new technologies, both benefiting the marketplace and advancing regulatory goals.

As one example, the cloud is increasing the ability to meet compliance obligations by allowing compliance to be built into transactions. Moreover, predicated on the vision of real-time regulatory reporting, and given the pace of technological change in the marketplace over the last several years, various regulators have been using more advanced analytics. This trend will continue to help them more effectively and efficiently meet their objectives, and monitor and meet the expectations they have for the entire market.

Machine learning’s role in the financial markets


Google Cloud’s head of AI and Industry Solutions, Andrew Moore, said that ML will be doing three key things for us in the next 10 years: giving us meaning, providing concierge services, and serving as a guardian. Extracting information that is critical to investor decision-making can be extremely important. With more data than ever, ML can increase the ability to process it while also becoming more accessible in the cloud and better supporting regulatory objectives.

The technology will likely manifest in trading and anti-money laundering activities as they relate market functions, as well as managing a wide variety of risks – supporting the interests of both investors and regulators in terms of decision-making, surveillance, and protections.

Rather than taking individuals out of the equation, the digitization of markets, assets, and guard rails combined with ML will allow people to focus their expertise in different ways to achieve key objectives.

Building the market foundation for the future


The goals of operational resiliency, security, and privacy will continue to be critical for building the market foundation for both participants and regulators. While technology promises to create advantages in concrete, tangible ways, it will be important to scrutinize potential risks and concerns.

Priority one for technology providers is to build an environment of trustless security, including encryption at motion and encryption at rest, ensuring that markets are operationally resilient while instilling confidence for any exchange that runs on top of that infrastructure. Multicloud architectures and approaches are likely also to be part of the solution for operational resilience.

Throughout time, liquidity has been the outcome of improved access, transparency, and security. Technology providers are responding by sharing both the responsibility for, and fate of, the markets of the future to build an efficient, faster, and more transparent and secure financial industry.

You can learn more about our approach in our newest white paper, Building the financial markets foundation for the future.

Case Study

KLM’s Doubles Bookings With the Same Spend With Machine Learning

3938

Of your peers have already read this article.

4:30 Minutes

The most insightful time you'll spend today!

As the flag carrier airline of the Netherlands, the vision of KLM’s marketing programme is to humanise advertising through personalisation and relevance at scale. Its experiments with machine learning revealed it could lower cost per booking by 40%, achieve more than twice as many bookings at the same spend, and drive a 1.4x click-through rate.

GOALS

  • Develop smarter, more effective media buying models through data
  • Drive relevant advertising
  • Scale predictive modelling across all touchpoints in the customer journey

APPROACH

Combined contextual data to create a predictive model with granular layers

Activated data in real-time

RESULTS

  • 40% lower cost per booking
  • More than twice as many bookings at same spend
  • 1.4 times higher click-through rate for test group than control

KLM partnered with Relay42, whose data management platform (DMP) empowers marketers to achieve data-driven personalisation at scale.

The Relay42 DMP works by stitching together all touchpoints and data sources (including all Google solutions), orchestrating customer journeys in real-time and then activating the unified data to drive business and user experience results.

klm chartv2
Fig. 1: By collating and enriching data sources and touchpoints, the Relay42 DMP serves as KLM’s customer journey orchestration engine. This approach helps KLM meet its objective of humanising advertising through agile and connected data.

Relay42 and KLM created a data flow setup with the Relay42 DMP at the core. Thanks to Relay42’s tag management system, all customer interactions on KLM’s website and app, as well as relevant indicators from other channels and data sources such as email, social, CRM, call center and affiliates can be tracked and synced in Google Analytics 360.

Data gathered via Relay42’s own tags and DoubleClick Floodlight tags can also be sent from the DMP to the DoubleClick platform so that relevant ads can be targeted to appropriate audiences.

In order to perform deep-dive analyses, KLM simply exports raw-level data (from DoubleClick using Data Transfer and from Google Analytics 360 through seamless integration) to BigQuery. BigQuery can then correlate site behaviour with ad impressions, which enables Relay42 to activate the data and inform the build of predictive models.

“We believe that data in combination with technological innovation is bound to make advertising smarter and more relevant on every touchpoint. By combining data sources, leveraging first-party data and activating this in real-time, advertising can turn into a personal dialogue, a rewarding one-to-one interaction instead of one-to-many push messaging.”

– Kevin Duijndam, Cross Channel Marketing Manager, KLM

A Predictive Model to Improve Display Remarketing

KLM decided to test a new approach to remarketing.

“Our goal was to get rid of irrelevant ads, as they are simply annoying”, explains Kevin Duijndam, the airline’s Cross Channel Marketing Manager.

“Our assumption was that people who fly with us often already know us, so it would be irrelevant to tell them about flying with us again. However, we were wondering when exactly someone is a ‘frequent flyer’. The more we thought about it, the more complex the set of business rules became, so in the end we realized we couldn’t just focus on frequent flyers, but instead should use machine learning to understand when ads are irrelevant.”

KLM developed a real-time buying setup to include predictive modelling. In this setup, website and app interactions are tracked in the DMP thanks to the Relay42 tag management system.

Relevant consumer behaviour can be streamed in real-time to a prediction engine developed by KLM in the Google Cloud Platform, with the outputs then streamed straight back to the DMP. From here, the DMP can activate rule-based segments based on the prediction outcome. And by syncing this with DoubleClick, ads can be served and targeted to maximise relevance.

klm chartv22
Fig. 2: KLM linked the Relay42 DMP customer interaction data to their predictive model to predict how relevant their ads would be. The setup enabled a decision to be made in real-time whether or not to serve a specific ad to a user.

The team tested their new predictive model to assess any gains in performance. KLM deliberately chose to measure the results in an A/B setup within a defined period rather than measuring the differences year over year or month over month. Such comparisons are less reliable due to rapid changes relating to seasonality, internal capacities and external factors caused by competitors.

Business Gains and Customer Experience Wins

In the test, KLM linked the Relay42 DMP customer interaction data to their predictive model to predict how relevant their ads would be. The setup enabled a decision to be made in real-time whether or not to serve a specific ad to a user.

Through the A/B tests it became clear that the new model in fact did generate a significant uplift in bookings. With the cost per booking 40% lower during the test period, KLM was able to achieve more than twice as many bookings at the same spend.

 The test produced wins in terms of customer experience, too. The click-through rate for the test group was more than 1.4 times higher than for the control group, indicating that the new model was successfully reaching users with messages they found to be relevant rather than annoying.

 The success goes beyond improving KLM’s display remarketing efforts, though.

“Even more importantly, we’ve laid the IT data flow foundation in such a way that KLM is now able to execute on our data through all of our digital marketing channels and apply our prediction models at scale”, Kevin says. “So we can be flexible to plug in other models but can also now scale through other online media channels like search or video.”

Whitepaper

ESG Did the Math: It’s Cheaper and Smarter to Migrate Enterprise Data Warehouses to Google BigQuery. Way Smarter

DOWNLOAD WHITEPAPER

6477

Of your peers have already downloaded this article

11:30 Minutes

The most insightful time you'll spend today!

Enterprise data warehouses (EDWs) are often deemed the most valuable asset in the data center, serving as the backbone of the business. The ongoing insight gained from these solutions has justified the significant up-front capital investments and ongoing operational costs, but the rigidity of the traditional EDW is forcing organizations to reevaluate their approach to analytics and business intelligence.

While legacy EDW solutions were all about throwing as much computational power as possible at a relatively static data set, with the inflow of new and valuable sources of data and the emergence of all-encompassing analytics initiatives, the success of today’s EDW solutions depends more on operational and resource agility than raw horsepower.

Being able to dynamically adjust to the needs of the business, integrate into operational processes, and quickly react to emerging opportunities can place an organization at a distinct competitive advantage.

Today’s EDW solutions must act as a global repository of information, provide the agility to scale up or down on demand, and seamlessly integrate with other analytics tools and services used throughout a data-driven organization.

Over the last two years, ESG has conducted detailed studies quantifying the economic value of Google data analytics services. The first evaluated Google BigQuery compared to on-premises Hadoop and AWS redshift. The second focused on Google DataProc compared to DIY Spark and Hadoop approaches. Here’s the next iteration of our economic analysis, extending the BigQuery study to incorporate a comparison to legacy enterprise data warehouses, both on-premises and in the cloud.

Through publicly available pricing and in-depth qualitative customer interviews, ESG was able to assert a base set of assumptions that power a dynamic model, incorporating up-front capital investments, deployment and migration costs, expected monthly cloud costs, administrative costs, and operational costs associated with legacy on-premises EDWs, cloud-based EDWs, and Google BigQuery.

The crux of the results show organizations can save up to 52% by using BigQuery over on-premises EDWs and up to 41% over cloud-based EDWs. Unlike legacy on-premises EDWs, BigQuery provides organizations with the key abilities that are essential to delivering a modern EDW solution, most notably the ability to integrate across other Google Cloud Platform services, including its market leading AI-based solutions and services.

Although not called t out directly in the published report, ESG’s models indicate that the savings achieved by migrating an on-premises EDW solution to Google BigQuery may actually be more cost effective than simply continuing to operate an existing on-premises EDW solution.

Case Study

Rubin Observatory Leverages Google Cloud to Power Astronomical Research

6065

Of your peers have already read this article.

2:00 Minutes

The most insightful time you'll spend today!

The Vera C. Rubin Observatory launched its the first preview of new Rubin Science Platform (RSP) for an initial cohort of astronomers, powered by Cloud Storage, Google Kubernetes Engine (GKE), and Compute Engine to drive astronomical researches.

This week, the Vera C. Rubin Observatory is launching the first preview of its new Rubin Science Platform (RSP) for an initial cohort of astronomers. The observatory, which is located in Chile but managed by the U.S. National Science Foundation’s NOIRLab in Tucson, AZ and SLAC in California, is jointly funded by the NSF and the U.S. Department of Energy. The platform provides an easy-to-use interface to store and analyze the massive datasets of the Legacy Survey of Space and Time (LSST), which will survey a third of the sky each night for ten years, detecting billions of stars and galaxies, and millions of supernovae, variable stars, and small bodies in our Solar System.

The LSST datasets are unprecedented in size and complexity, and will be far too large for scientists to download to their personal computers for analysis. Instead, scientists will use the RSP to process, query, visualize, and analyze the LSST data archives through a mixture of web portal, notebook, and other virtual data analysis services. An initial launch with simulated data, called Data Preview 0, builds on the Rubin Observatory’s three-year partnership with Google to develop an Interim Data Facility (IDF) on Google Cloud to prototype hosting of the massive LSST dataset. This agreement marks the first time a cloud-based data facility has been used for an astronomy application of this magnitude.

Bringing the stars to the cloud

For Data Preview 0, the IDF leverages Cloud StorageGoogle Kubernetes Engine (GKE), and Compute Engine to provide the Rubin Observatory user community access to simulated LSST data in an early version of the RSP. The simulated data were developed over several years by the LSST Dark Energy Science Collaboration to imitate five years of an LSST-like survey over 300 square degrees of the sky (about 1,500 times the area of the moon). The resulting images are very realistic: they have the same instrumental characteristics, such as pixel size and sensitivity to photons, that are expected from the Rubin Observatory’s LSST Camera, and they were processed with an early version of the LSST Science Pipelines that will eventually be used to process LSST data. “This will be the first time that these workloads have ever been hosted in a cloud environment. Researchers will have an opportunity to explore an early version of this platform,” says Ranpal Gill, senior manager and head of communications at the Rubin Observatory.

Broadening access for more researchers

Over 200 scientists and students with Rubin Observatory data rights were selected to participate in Data Preview 0 from a pool of applicants that represents a wide range of demographic criteria, regions, and experience level. Participants will be supported with resources such as tutorials, seminars, communication channels, and networking opportunities—and they will be free to pursue their own science at their own pace using the data in the RSP. 

“The revolutionary nature of the future LSST dataset requires a commensurately innovative system for data access and analysis paired with robust support for scientists,” says Melissa Graham, lead community scientist for the Rubin Observatory and research scientist in the astronomy department at the University of Washington. “I’m personally excited to enhance my own skills by using the RSP’s tools for big data analysis, while also helping others to learn and to pursue their LSST-related science goals during Data Preview 0.” 

At the same time, the fact that the RSP is hosted in the cloud provides researchers at smaller institutions access to state-of-the-art astronomy infrastructure that is comparable to that of the largest national research centers.

The launch benefits the observatory too: the development team can learn what researchers are interested in while also testing and debugging the platform. Graham says that “the platform is still in active development so researchers using it will be able to follow along in the progress, and provide feedback on ways that we can optimize the development of the tools.”

Next steps

The LSST aims to begin the ten-year survey in 2023-24 and expects it to include 500 petabytes of data. Through the cloud, Google aims to help make this extraordinary project scalable and accessible to researchers everywhere. To learn more about Data Preview 0, watch this video.


Want to ramp up your own research in the cloud? We offer research credits to academics using Google Cloud for qualifying projects in eligible countries. You can find our application form on Google Cloud’s website or contact our sales team.

More Relevant Stories for Your Company

Blog

Google’s Record-breaking Performance Tops the MLPerf Benchmark Results

The latest round of MLPerf benchmark results have been released, and Google's TPU v4 supercomputers demonstrated record-breaking performance at scale. This is a timely milestone since large-scale machine learning training has enabled many of the recent breakthroughs in AI, with the latest models encompassing billions or even trillions of parameters

Case Study

How a Mid-Sized Firm is Shrinking Inventory Carryovers 50% with AI

For more than 10 years, NMK Textile Mills has manufactured bed linens for major retailers in the United States and Canada. As e-commerce exploded, the company’s co-founder saw an opportunity to grow the business. So, in addition to manufacturing bed linens wholesale for retail customers, NMK Textile Mills reworked its complete supply

Blog

AI Solutions for Government Organizations: How to Get Started

Cloud-native features are helping public sector teams innovate faster than ever. Ideas discussed in a morning meeting can be a working proof of concept later that day. Managed services can remove administrative burden and reduce the steps needed to design and provision cloud infrastructure. Security can be built-in from the

E-book

The 40 Most Astounding Stories of Tech-Enabled Innovation

These business and technology innovators are leveraging cloud computing, machine learning, APIs, collaborative platforms, among others to advance healthcare, financial services, retail, media and entertainment, manufacturing, and government. They include some of the biggest brands in the world, as well as some you've probably never heard of. But they all

SHOW MORE STORIES