At Google Cloud, we’re committed to making generative AI useful for everyone. Doing so requires more than making powerful foundation models available to businesses, governments, and developers. Models also need to be backed by platforms that make adoption faster and safer, with onramps to meet organizations wherever they are, regardless of their software or data science expertise. 

Today, we’re excited to announce general availability of Generative AI support on Vertex AI, giving customers access to our latest platform capabilities for building and powering custom generative AI applications. With this update, developers can access our text model powered by PaLM 2, Embeddings API for text, and other foundation models in Model Garden, as well as leverage user-friendly tools in Generative AI Studio for model tuning and deployment. Backed by enterprise-grade data governance, security, and safety features, Vertex AI can make it easier than ever for customers to access foundation models, customize them with their own data, and quickly build generative AI applications.

Vertex AI powers generative AI model customization for enterprise developers, data scientists, and everyone in between 

Foundation models are the starting point for creating customized generative AI applications—but models alone are not sufficient. That’s why in March, we announced Generative AI support on Vertex AI, the biggest-ever update to our machine learning platform, and began working with trusted testers. Now generally available to customers, Model Garden and Generative AI Studio leverage Google Cloud’s tight partnership with Google Research and Google DeepMind, making it easy for developers and data scientists to use, customize, and deploy models. 

Model Garden lets customers access and experiment with foundation models from Google and its partners, with over 60 models available and many more to come. In addition to making Model Garden, PaLM 2, and Embeddings API for text generally available, we’re also making our recently-announced Codey model for code completion, generation, and chat available for public preview. 

Along with these and other foundation models, Vertex AI offers a full ecosystem of tools to help builders tune, deploy, and govern models in production. For example, in May, we were the first enterprise ML platform to provide Reinforcement Learning with Human Feedback, or RLHF, which helps improve model usefulness and reduce cost. We’ve also upgraded Vertex AI’s suite of MLOps tools for model development and maintenance for customers who need to manage large models. With Generative AI Studio generally available, customers can now leverage an even wider range of tools, including multiple tuning methods for large models, that can significantly accelerate development of custom generative AI applications. 

We’re already seeing innovative results from early adopters via our trusted tester program and preview period. For example, leading global airline supplier GA Telesis is using our PaLM model on Vertex AI to build a data extraction solution that automatically synthesizes email orders and provides customers a quote. This eliminates the need for their sales teams to manually cross-reference emails with inventory availability. GitLab is leveraging our Codey model on Vertex AI for their “Explain this Vulnerability” feature, which gives their users a natural language description of code vulnerabilities, along with recommendations for resolving them. Canva, the visual communication platform, is using Google Cloud’s rich generative AI capabilities in language translation to better support its non-English speaking users, letting users easily translate presentations, posters, social media posts, and more into over a hundred languages. The company is also testing ways that Google’s PaLM technology can turn short video clips into longer, more compelling stories. 

And today, we’re pleased to share that Typeface, and DataStax are also building new generative AI capabilities with Vertex AI.    

Now is the time to build 

These announcements add to our news yesterday that we’ve added expanded access to Enterprise Search on Generative AI App Builder (Gen App Builder), allowing businesses to create custom chatbots and search engines that combine generative AI with Google’s semantic search technologies. Gen App Builder offers out-of-box solutions to common generative AI use cases, Vertex AI’s expansive platform capabilities can accelerate wide-ranging innovation, and growing ecosystem support from partners help our customers build freely. Together, these technologies and partnerships mean the full spectrum of developers and data scientists, from novices to seasoned experts, can build generative AI apps with enterprise-ready services on Google Cloud. 

As with our entire Cloud portfolio, Vertex AI and Gen App Builder help give customers complete control over their data; it doesn’t need to leave the customer’s tenant, is encrypted both in transit and at rest, and is not shared or used to train Google models. Google rigorously evaluates our new models to ensure they meet our Responsible AI Principles, and all of our generative AI offerings include the user security, data management, and access controls Google Cloud customers have come to expect. 

We’re grateful to our trusted testers for their integral role in bringing Generative AI support on Vertex AI to market, and we look forward to seeing what customers across all industries create with our growing catalog. To learn more about Google Cloud’s generative AI products, visit our solutions page, and to keep up with our latest AI news, don’t miss “The Prompt” or our generative AI primer for executives on Transform with Google Cloud.

Verve Group is an ecosystem of demand and supply technologies fusing data, media, and technology to deliver results and growth to both advertisers and publishers – no matter the screen or location, no matter who, what, or where a customer is. Classifying massive amounts of this unstructured data at scale is the first step in helping to surface relevant, high-quality content to users—and that’s where natural language processing (NLP) comes in.

Verve Group uses the NLP API from Google Cloud’s Vertex AI to fetch data for their internal content classification quality verification and as an additional source for building categorization models. By leveraging the NLP API’s Content Classification models, which are now generally available and offer Google’s latest large language model (LLM) technology, Verve Group powers classification through an updated and expanded training data set with over 1,000 labels and support for 11 languages (Chinese, French, German, Italian, Japanese, Korean, Portuguese, Russia, Spanish, and Dutch join previously-available English). 

Verve Group has been using Google Cloud’s NLP API since day one, because of both the ease of implementation and the quality compared to competing NLP products. With documentation that is “comprehensive and self-explanatory,” the NLP API “allows for fast adoption and implementation, from test models all the way to production,” said Rami Alanko, GM of Verve Group.

Leveraging the NLP API has facilitated Verve Group’s fast go-to-market motions by enabling its customers to quickly discover and classify new content. “Operating on a global level with tens of different regions and languages, we have still been able to maintain high quality for our product and high retention rates with our clients,” Rami shared. “In a recent client case, we achieved 82% improvement in CTR when optimized with content quality measurements enabled by the API. In another client case, we drove brand safety risk down to 0.16% from 4% thanks to classification quality. Along with the new functionalities of the Google NLP, I can only see this trend continuing to strengthen.”

Verve Group is excited to further expand their NLP use cases by leveraging the new Content Classification models, which have already helped them expand their classification inventory, improve the quality and performance of their quality verification for customers, and unlock new use cases for NLP. “Our classification model accuracy improved 41% using Google NLP as a verification partner,” said Rami.  

Additionally, Verve Group is now using the API for metadata analysis on a  large image database. “We browse the database and run the image metadata via our classification. This flow enables us to classify images reliably aligned with our standard classification.  We pretty much use the same data flow for our runtime in-app textual content analysis, therefore allowing for close to real-time consumer engagement,” Rami added.

To learn more about how companies are leveraging NLP API from Google Cloud Vertex AI, click here, and to learn more about Google Cloud’s work with foundation models and generative AI, read The Prompt on Transform with Google Cloud.

Communication service providers (CSPs) are at an inflection point. From stagnating revenues, to network strain in meeting the demands of 5G, to challenges in delivering innovative customer experiences, there’s enormous pressure on the telecommunications industry to transform.

Over the past few years, CSPs around the globe have turned to artificial intelligence (AI) to address some of these challenges, but the lion’s share of an operator’s operational expenses are still spent on infrastructure and data management. This has limited their ability to capitalize on core data assets and develop differentiated customer experiences that meet individual needs. 

Enter generative AI, a type of machine intelligence that’s received enormous attention as of late. We’ve all marveled over its ability to generate text that reads like it was written by a person, to create new images, and to build even musical scores. It’s a riveting addition to the AI toolset — and one that complements machine learning (ML) and its ability to identify patterns to make predictions, spot efficiencies, or interpret large data sets. 

But while there’s a lot of hype around generative AI, at Google Cloud we view it through a much more practical lens for the telecommunications industry. Generative AI can accelerate the transformation already underway, with its potential to streamline many of the tools and processes that CSPs engage with daily, bringing a new level of natural interaction between people and computers, and enabling machines to be programmed to carry out an action with a spoken request, and respond in natural, interactive ways. 

Generative AI builds on existing Google Cloud data, AI, and ML services. For example, Contact Center AI, with human-like interactions between callers and computers, has been successfully adopted by CSPs for many years, increasing the satisfaction of both customers and call center workers. As we add generative AI to this technology, CSPs and their customers will see even greater capabilities and impact, for example, virtual agents that not only provide helpful information, but also let customers make payments and execute other transactions. With generative AI, CSPs will be able to harness customer call summaries to better understand customer sentiment and identify cross-sell and up-sell opportunities. CSPs could also easily and quickly build and deploy virtual agents informed by customer conversations that enable more innovative and personalized customer interactions. And that’s just the start.

Three key areas

The contact center is just one of the areas where practical and generative AI will help drive new value. When reflecting on the key challenges facing CSPs today, three areas in particular stand out where generative AI may be transformative:

1. Personalized experiences: In addition to further improvements in customer call center interactions, generative AI can deliver improved personalization in ecommerce interactions — a big factor in helping customers sort through their choices of phones and calling plans. Personalization is also important for lowering churn, offering relevant new services, and managing the customer lifecycle. For example, generative AI could enable CSPs to produce marketing campaign content customized for select themes, and target individual customers with customized text and images. 
2. Autonomous networks: Generative AI will also help to pave the way for autonomous networks by connecting multiple complex AI/ML models used across network planning and operations with large language models (LLMs) that can understand network behaviors and create action plans in areas including network capacity planning and performance. For example, generative AI will enable CSPs to train models with customer experience and sentiment data to build better prediction capabilities. Importantly, the customer data sets used to tune these models are not public, but curated internal customer data — significantly enhancing privacy, factuality, and relevance, while protecting intellectual property. In addition, generative AI will be able to help network planning and design, which requires high levels of reporting and analysis.
3. Streamlined operations: Both operations center uptime and field service efficiency are crucial for managing costs and improving customer satisfaction. In particular, applying generative AI to field service devices can speed up diagnostics and analysis, and can even help with installation, parts, and troubleshooting, and minimizing the number of times companies have to send out trucks and improve field-service training. Generative AI will also provide a productivity boost to IT development processes, enabling code generation and troubleshooting to deliver reliable software products and services.

Data security and reliability

An under-discussed area in generative AI is the importance of data quality and data security in building and training the LLMs that power the technology. Many CSPs are rightly concerned about intellectual property leaking both into and out of LLMs, risking the security of their systems and their intellectual property. We’ve long offered industry-leading data security and privacy technologies, and with generative AI integrated with Vertex AI, we can ensure all data is secured within the CSP’s environment.

Meanwhile, to ensure that their LLMs generate accurate information, CSPs are building out scenarios and use cases for training on smaller, controlled amounts of their own data, sometimes accompanied by highly trusted sources from partners and others. Google Cloud also provides tools including Prompt Engineering, Tuning, and Reinforcement Learning from Human Feedback to further ensure data factuality and reliability. This will likely result in the first generative AI applications targeted to smaller, high-impact problems, like optimizing network topologies. 

The human element

Of course, people are critical to the success of generative AI, whether that means solving problems in call centers, field service workers combining AI information with their own knowhow, marketing and creative teams brainstorming with generative AI to make new presentations and marketing materials, or operations engineers augmenting and approving an AI suggestion. We’ve built a lot of amazing technology to help augment what people cannot do: synthesize millions, if not billions, of records and sources to help energize new workflows and productivity.

Telecommunications is a fast-changing industry that is tech savvy and hungry to learn and deploy the best possible new technologies, and that includes generative AI. Each meeting with a CSP inspires new ideas, sparks more use cases, and leads to more industry-changing initiatives. It’s exciting to see this pace of change, and we are only just getting started.

We look forward to showing you more soon as we deep dive into some of the exciting CSP industry use cases in upcoming blog posts. We also invite you to find out more about how Google Cloud is partnering with CSPs around the world to deliver a holistic cloud transformation.

As consumer expectations grow for more personalized, relevant, and assistive experiences, machine learning is becoming an invaluable tool to help meet those demands.

It’s helping marketers create smarter customer segmentations, deliver more relevant creative campaigns, and measure performance more effectively. In fact, 85% of executives believe AI will allow their companies to obtain or sustain a competitive advantage.¹

We created this guide to help you optimize your machine learning marketing efforts — whether you’re just starting out or you want to discover more benefits of machine learning.

Go to the Guide Now!

Google Cloud’s Professional Services Organization (PSO) engages with customers to ensure effective and efficient operations in the cloud, from the time they begin considering how cloud can help them overcome their operational, business or technical challenges, to the time they’re looking to optimize their cloud workloads. 

We know that all parts of the cloud journey are important and can be complex.  In this blog post, we want to focus specifically on the migration process and how PSO engages in a myriad of activities to ensure a successful migration.

As a team of trusted technical advisors, PSO will approach migrations in three phases:

1. Pre-Migration Planning
2. Cutover Activities
3. Post-Migration Operations

While this post will not cover in detail all of the steps required for a migration, it will focus on how PSO engages in specific activities to meet customer objectives, manage risk, and deliver value.  We will discuss the assets, processes and tools that we leverage to ensure success.

Pre-Migration Planning

Assess Scope

Before the migration happens, you will need to understand and clarify the future state that you’re working towards.  From a logistical perspective, PSO will be helping you with capacity planning to ensure sufficient resources are available for your envisioned future state.

While migration into the cloud does allow you to eliminate many of the considerations for the physical, logistical, and financial concerns of traditional data centers and co-locations, it does not remove the need for active management of quotas, preparation for large migrations, and forecasting.  PSO will help you forecast your needs in advance and work with the capacity team to adjust quotas, manage resources, and ensure availability. 

Once the future state has been determined, PSO will also work with the product teams to determine any gaps in functionality.  PSO captures feature requests across Google Cloud services and makes sure they are understood, logged, tracked, and prioritized appropriately with the relevant product teams.  From there, they work closely with the customer to determine any interim workarounds that can be leveraged while waiting for the feature to land, as well as providing updates on the upcoming roadmap.  

Develop Migration Approach and Tooling

Within Google Cloud, we have a library of assets and tools we use to assist in the migration process.  We have seen these assets help us successfully complete migrations for other customers efficiently and effectively.

Based on the scoping requirements and tooling available to assist in the migration, PSO will help recommend a migration approach.  We understand that enterprises have specific needs; differing levels of complexity and scale; regulatory, operational, or organization challenges that will need to be factored into the migration.  PSO will help customers think through the different migration options and how all of the considerations will play out.

PSO will work with the customer team to determine the best migration approach for moving servers from on-prem to Google Cloud. PSO will walk customers through different migration approaches, such as refactoring, lift-shift, or new installs. From there, the customer can determine the best fit for their migration. PSO will provide guidance on best practices and use cases from other customers with similar use cases. 

Google offers a variety of cloud native tools that can assist with asset discovery, the migration itself, and post-migration optimization. PSO, as one example, will help work with project managers to determine the best tooling that accommodates the customer’s requirements for migrating servers. PSO will also engage Google product team to ensure the customer fully understands the capabilities of each tool and the best fit for the use case. Google understands from a tooling perspective, one size does not fit all, thus PSO will work with the customer on determining the best migration approach and tooling for different requirements. 

Cutover Activities

Once all of the planning activities have been completed, PSO will assist in making sure the cutover is successful.

During and leading up to critical customer events, PSO can provide proactive event management services which deliver increased support and readiness for key workloads.  Beyond having a solid architecture and infrastructure on the platform, support for this infrastructure is essential and TAMs will help ensure that there are additional resources to support and unblock the customer where challenges arise.

As part of event management activities, PSO liaises with the Google Cloud Support Organization to ensure quick remediation and high resilience for situations where challenges arise.  A war room is usually created to facilitate quick communication about the critical activities and roadblocks that arise.  These war rooms can give customers a direct line to the support and engineering teams that will triage and resolve their issues.

Post-Migration Activities

Once cutover is complete, PSO will continue to provide support in areas such incident management, capacity planning, continuous operational support, and optimization to ensure the customer is successful from start to finish.

PSO will serve as the liaison between the customer and Google engineers. If support cases need to be escalated, PSO will ensure the appropriate parties are involved and work to get the case resolved in a timely manner. Through operational rigor, PSO will work with the customer in determining if certain Google Cloud services will be beneficial to the customer objectives. If services will add value to the customer, PSO will help enable the services so it aligns with the customer’s goal and current cloud architecture. In cases where there are missing gaps in services, PSO will proactively work with the customer and Google engineering teams to close the gaps by enabling additional functionality in the services.  

PSO will continue to work with the engineering teams to consistently review and provide recommendations on the customer’s cloud architecture in ensuring the most optimal and cost efficient design along with adhering to Google’s best practices guidelines. 

Aside from migrations, PSO is also responsible for providing continuous training of Google Cloud to customers. To ensure consistent development of Google Cloud, PSO will work with the customer to jointly develop a learning roadmap to ensure the customer has the necessary skills to succeed in delivering successful projects in Google Cloud.

Conclusion

Google PSO will be actively engaged throughout the customer’s cloud journey to ensure the necessary guidance, methodology, and tools are presented to the customer. PSO will engage in a series of activities from pre-migration planning to post migration in key areas such as capacity planning to ensure sufficient resources are allocated for future workloads to providing support on technical cases for troubleshooting. PSO will serve as a long-term trusted advisor who will be the voice of the  customer and provide the reliability and stability of the customer’s Google Cloud environment.

Click here if you’d like to engage with our PSO team on your migration. Or, you can also get started with a free discovery and assessment of your current IT landscape.