Answering the 4 Common FAQs on Compute Engine - Build What's Next
Blog

Answering the 4 Common FAQs on Compute Engine

3860

Of your peers have already read this article.

1:30 Minutes

The most insightful time you'll spend today!

Running and creating VMs on Google infrastructure with Compute Engine initially involves many questions and what ifs. We have tracked the four most popularly asked questions on Compute Engine. Read blog to learn and refer our resources!

Compute Engine lets you create and run virtual machines (VMs) on Google’s infrastructure, allowing you to launch large compute clusters with ease. When it comes to getting started with Compute Engine, our customers have lots of questions—but some questions come up more often than others. 

We looked at an internal list of the most popular Compute Engine documentation pages over a 30-day period to find out what topics were explored by users again and again. Here are the top four questions users have about Compute Engine, in order.

1. What are the different machine families

Compute Engine lets you select the right machine for your needs. You can choose from a curated set of predefined virtual machine (VM) configurations optimized for specific workloads, ranging from small-level purpose to large-scale use cases or create a machine type customized to your needs with our custom machine type feature. 

Compute Engine machines are categorized by machine family, including: 

  • General-purpose: Best price-performance ratio for a variety of standard and cloud-native workloads 
  • Compute-optimized: Highest performance per core for compute-intensive workloads, such as ad serving or media transcoding  
  • Memory-optimized: More compute and memory per core than any other family for memory-intensive workloads, such as SAP HANA or in-memory data analytics 
  • Accelerator-optimized: Designed for your most demanding workloads, such as machine learning (ML) or high performance computing (HPC)

Read the documentation to learn more about each machine family category.


2. How to connect to VMs using advanced methods

In general, we recommend using the Google Cloud Console and the gcloud command-line tool to connect to Linux VM instances. However, some of our customers want to use third-party tools, or require alternative connection configurations. 

In these cases, there are several methods that might fit your needs better than the standard connection options:

  • Connecting to instances using third-party tools (e.g. Windows PuTTY, Chrome OS Secure Shell app), or MacOS or Linux local terminal) 
  • Connecting to instances without external IP addresses
  • Connecting to instances as the root user Manually connecting between instances and running commands as a service account

Read the documentation to learn about advanced methods for connecting Linux VMs.


3. How to set up OS Login

OS Login lets you use IAM roles and permissions to manage access and permissions to VMs. 

OS Login is the recommended way to manage users across multiple instances or projects. OS Login provides:

  • Automatic Linux account lifecycle management
  • Fine-grained authorization using Google IAM without having to grant broader privileges
  • Automatic permissions updates to prevent unwanted access
  • Ability to import existing Linux accounts from Active Directory (AD) and Lightweight Directory Access Protocol (LDAP)

You can also add an extra layer of security by setting up OS Login with two-factor authentication or manage organization access by setting up organization policies.


Read the documentation to learn how to configure OS login and connect to your instances.


4. How to manage SSH keys in metadata 

Compute Engine allows you to manually manage SSH keys and local user accounts by editing public SSH key metadata.

You can add  public SSH keys to instance and project metadata using: 

  • The Google Cloud Console The gcloud command-line tool 
  • API methods from the Google Cloud Client Libraries

Read the documentation to learn how to manually manage SSH keys and local user accounts in metadata.


Don’t see your question here? Check out the Compute Engine documentation for all of our recommended guides, tutorials, and resources.

Case Study

AgroStar: Small farms in India getting big help from the cloud

13215

Of your peers have already read this article.

3:30 Minutes

The most insightful time you'll spend today!

AgroStar launched a multilingual mobile app using Google Cloud Platform that is helping to boost crop yields and increase income for small farmers in India.

AgroStar has launched a cloud-based mobile app that is helping to boost crop yields and encourage best practices for small farmers in India. Launched as an on-premises ecommerce platform selling farm tools in 2008, the firm turned to Google Cloud Platform (GCP) to expand its offering. It now uses cloud-based analytics and is deploying ML models to provide timely advice in five languages on everything from seed optimization, crop rotation, and soil nutrition to pest control.

2018 survey underscored the demand for agricultural planning for Indian farmers. While farming remains a dominant sector in India, employing half of its labor force, 70 percent of small farmers – those cultivating fewer than three acres – said their crops are damaged by unforeseen weather and pests. An even higher number – 74 percent – say they lack access to farming-related information.

Widening that gap is the relative lack of access to new, higher yield seeds and improved soil analyses for small farmers, who must otherwise rely on traditional methods. “It could take a few years for innovative information to trickle down from universities to small, grassroots farmers,” says Pritesh Gudge, AgroStar Software Engineer. “Today, just by clicking through our Android application, farmers learn about new, effective farming practices and receive advice customized to their crop and soil.”

Connecting a million farmers in the cloud

Operating in the Indian states of Gujarat, Maharashtra, Rajasthan, Orissa, Bihar, and Karnataka, AgroStar is closing the knowledge gap with a full-service, cloud-based SaaS solution – the only one of its kind in India. It combines agronomy, data science, and analytics to help farmers by providing a variety of resources.

AgroStar has reached over a million farmers through its Android app, the AgroStar Agri-Doctor. The mobile client is available as a web-based or full-featured native app. Both provide access to the firm’s knowledge base hosted on GCP, a Q&A forum that connects farmers to each other to help understand and better solve problems and to learn about innovative practices and products. Farmers can also click through to follow local and national market trends that help forecast crop prices.

In addition to the self-service knowledge base, AgroStar provides access to agronomy experts who use cloud-based analytics tools and historical data to provide season-and locale-specific advice to each farmer. “We are now tracking thousands of calls in 5 languages each day,” says Pritesh.

The AgroStar app also provides links to purchase and then track the delivery of farm tools and supplies such as cultivators and fertilizers. An in-house platform manages fulfillment centers and a doorstep delivery network simplifies the supply chain while giving farmers what they need, when they need it. By procuring directly from the manufacturers and primary distributors of farm supplies, Agrostar is achieving cost savings, which it passes on to farmers.

Build fast, pivot faster

From the start, the human and environmental variables of farming in India, not to mention the volume of AgroStar’s few hundred thousand monthly active users, made a highly scalable cloud-based solution inevitable. Farmers rely on the firm’s Agri-Doctor app to provide advice in multiple languages on topics that range widely throughout three growing seasons, each with distinct crop nutrition and rotation cycles and farm implementation requirements.

“For farmers, the focus keeps changing every month, and every season,” says Pritesh. “To serve our growing community, we needed a platform that could process images at high volume, fulfill tools and seed orders across thousands of miles, and respond to multilingual queries. We quickly moved away from spreadsheets and server-based solutions – we needed to build fast and pivot faster.”

Ending late-night deployments

The firm’s first cloud experience was with an AWS solution. At the time, AWS was the only cloud provider in India, but AgroStar wanted to find a solution that was easier to use and offered better integration with Android devices. “Deployment and processing costs were very high, and the developer tools and documentation were not as intuitive as we needed,” says Pritesh.

When GCP service arrived in India in October 2017, AgroStar embarked on a platform re-implementation that made possible dramatic changes in the way it developed and deployed its solution. Using Google Kubernetes Engine (GKE) for crop advice management and Compute Engine for its production application services, the firm built the backend for the Agri-Doctor discussion forum in only three weeks. The platform’s microservice architecture is implemented in Python and Golang and deployed on GCP.

AgroStar began to realize significant efficiencies in its build, deploy, and test cycles. “We previously needed to work overnight to deploy to production,” says Pritesh. “Now using Google for Kubernetes containers and a rolling update strategy, we can deploy during the day without any problems or interruptions to service.”

The move to GCP streamlined AgroStar’s stack. “We were running 12 independent instances on AWS,” says Pritesh. “With Google Kubernetes Engine, we are deployed on a single cluster at a cost savings of $1,300 per month and growing.”

Improving customer response times by 85 percent

With a managed deployment capability, AgroStar can devote more time and resources to executing on its platform and Agri-Doctor app development plan. A strategic goal was managing customer response times as the firm grew its base. GCP has helped the firm meet that goal, achieving an 85 percent improvement in customer response times even as traffic grew significantly.

“With our on-premises solution, we could handle around 100 customers daily, which took 30 to 50 minutes for each customer,” says Pritesh. “We now handle thousands of customers daily, taking only 4 to 5 minutes for each one.”

AgroStar used Firebase to implement its Agri-Doctor app. A real-time cloud database, Firebase provides an API that enables the Agri-Doctor advice forum to be synchronized across all its far-flung mobile clients, effectively sharing knowledge base updates with one million users in near real time.

Using cloud tools to manage and monitor

Cloud Pub/Sub, Kafka, and Cloud Dataflow manage data ingestion and queueing of event and transaction data to the analytics layer. BigQuery fetches and persists data to Cloud StorageCloud SQL and dashboards powered by Tableau deliver farmer crop and soil profiles within minutes.

Cloud IAM helps AgroStar control access to all its cloud resources. And Stackdriver, the integrated logging aggregation capability for GCP, helps monitor and speed debugging on every tier of the AgroStar solution.

Machine learning to enhance yields

AgroStar is developing a variety of ML components to improve responsiveness and extend its platform offerings.

To speed up the diagnosis of and treatment for crop blight, AgroStar is building a deep learning pipeline using TensorFlow. The pipeline relies on GoogLeNet models that use multi-layered convolutional visual pattern recognition. It will assess uploaded images to support a disease-detection capability on the mobile app. Based on the commercially successful AI algorithms that automated postal code processing, GoogLeNet offers improved performance and computational efficiencies by using a creative layering technique that distinguishes them from older, sequential recognition engines.

To improve its customer search experience, AgroStar is developing an ML pipeline that shrinks fetch times by suggesting tags mapped to stored data. Processed using TPUs, Cloud Natural Language and Video AI, the tags provide a metadata layer that supports queries in any of the ten natural languages that AgroStar farmers can use.

The AgroStar search pipeline consists of Long Short-Term Memory (LSTM) models of Recurrent Neural Networks. Recurrent networks exhibit “memory” through iterative processing and are distinguished from feedforward networks by a feedback loop connected to their past decisions, ingesting their own outputs moment after moment as input.

Implementing a recommendation engine

The firm is also adapting the Random Forests TensorFlow AI model to develop a crop and product recommendation engine. The model is trained by consuming numerical (rainfall, humidity, water availability per acre) and categorical (soil type, water sources) parameters to suggest appropriate products by season, region, and locale.

To simplify the product suggestion experience, AgroStar developers are testing Cloud Dialogflow, the Google Cloud conversational interface, to build a chatbot capability into its mobile app. The bot will track a farmer’s crop schedules and answer simple questions by linking to the recommendation engine.

AgroStar is also extending its analytics platform with AI-powered sales planning and forecasting. Using linear regression models implemented in TensorFlow and powered by Cloud ML Engine, the capability will enhance supply chain logistics as the company scales its operations across India.

To provide a credit on-demand offering for a range of seed-to-harvest cycle products, AgroStar is attempting to use Vision API to create an AI model that will convert uploaded photos of customer application records into standard data formats. The firm’s credit policy features a grace period in which farmers begin paying back loans after harvested crops go to market.

A versatile and friendly development ecosystem

AgroStar credits the convivial tools and documentation that GCP offers and its incremental, pay-as-you-go pricing model for both the firm’s success and its ability to manage growth.

“What Google Cloud offers is extremely good documentation and extremely simple-to-use tools and interfaces across all services,” says Pritesh. “It helped us initially deploy our platform and at every scale that we have required since then, and its cost effectiveness enabled us to staff up to meet new feature milestones.”

Blog

Google and NetApp Partnership Expansion to Ease Customers’ Cloud Migration

3659

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

At the Next 21 event last week, Google Cloud announced expansion of its strategic partnership with NetApp to ease customers' cloud migration journey and run business critical applications on Google Cloud. Learn more!

As organizations continue to evolve to meet the needs of their stakeholders, they are increasingly looking to adopt the cloud and digitally transform their business. Since our partnership with NetApp began in 2018, we’ve been focused on delivering the infrastructure, tools, and services to help customers on their cloud migration journey and benefit from their data to better serve their customers. 

“Customers are looking to adopt flexible and scalable solutions that meet the needs of their business,” said Ronen Schwartz, SVP & GM, Cloud Volumes, NetApp. “Our long-standing partnership with Google Cloud continues to deliver innovative solutions for customers as they look to migrate and run their business critical applications in the cloud while unlocking the power of their data with industry-leading cloud services.”

Innovative, industry-first solutions have become the standard for our partnership. From the general availability of NetApp Cloud Volumes Service (CVS) for Google Cloud in 2019, to our collaboration on new architectures in 2020 with the release of the software-defined CVS powered by Google Kubernetes Engine (GKE), we continue to deliver first-of-its-kind enterprise file storage services together. In 2021, the pace of innovation has only increased—together, we delivered volume replication powered by SnapMirror, which efficiently copies volume data from one Google Cloud region to another for data consistency, development, testing, or disaster recovery. 

We’ve also made our services available globally—you can now run Cloud Volumes ONTAP in all 28 Google Cloud regions, and CVS is now available in 19 regions, allowing you to access our services wherever you are around the globe. All of this is backed up by a 99.99% SLA for CVS, enabling high availability for your enterprise workloads.

Hundreds of customers including MailerLite, a leader in marketing automation, have benefitted from our joint services. MailerLite was looking to move millions of files to the cloud without disruption as they were facing availability, management, and maintenance challenges as their business scaled. By leveraging NetApp CVS on Google Cloud, MailerLite was able to migrate over 100 million files to Google Cloud in about an hour, removing their ongoing infrastructure overhead, saving developer hours, and eliminating the scalability limitations they previously experienced. 

Expanding our partnership

Last week at Google Cloud Next ‘21, we announced we are expanding our strategic partnership in two ways to make it even easier for customers to migrate and run business critical applications on Google Cloud. First, NetApp will provide storage infrastructure for the newly announced Google Distributed Cloud Hosted, where data resides in customer-owned data centers and colocation facilities. This enables a safe and secure way to modernize an on-premises deployment while still meeting data security and privacy requirements.

Additionally, for customers looking to migrate their VMware workloads to Google Cloud, we announced preview access for NetApp Cloud Volumes as datastores for Google Cloud VMware Engine. By providing customers with the choice to scale compute and storage independently, customers can now reduce costs and complexity when migrating and running storage-bound workloads. This also allows customers to address regional disaster recovery use cases, making it easier and more cost-effective to move on-premises workloads into Google Cloud. To get started, you can sign up for preview access using the Registration for Preview Access form.

Looking forward

We’re excited for what’s to come with our partnership and committed to delivering value to customers across industries. Google Cloud is a Gold sponsor at this week’s NetApp Insight, and we invite you to join our spotlight session featuring Google Cloud and NetApp leaders. Additionally, we are leading multiple breakout sessions where you will hear from our product team on how you can accelerate cloud adoption with Google Cloud and NetApp. You can also learn more and get started today by visiting our NetApp on Google Cloud website.

3361

Of your peers have already watched this video.

2:00 Minutes

The most insightful time you'll spend today!

Case Study

Twitter Charts #HybridCloud Journey With Google Cloud

Social media giant Twitter needs no introduction. The 24/7 live platform, which crunches massive volumes of data every second, was using its data centers for a lot of its infrastructure and used the cloud for some of what it does.

However, it needed ever more storage and compute resources and looked at the cloud. The task involved transferring an estimated 300-400 petabytes of data to the cloud.

So, Twitter embarked on a rigorous evaluation process to determine if that was even possible. It did in-depth analysis with many engineers over many months. Finally, the company went to Google and it became obvious that this was a high-performance, high-quality cloud. When Twitter aggregated the network differences, the savings from having more flexible resources, the resulting difference was dramatic.

As a result, Twitter was impressed with Google Cloud’s performance, the flexibility it offered in scaling both storage and compute independently, and the suite of products that Google provided.

See how this move enabled Twitter to separate compute and storage needs and merge enthusiastically into a hybrid cloud strategy for the future.

Blog

What’s New in Retail: Bits from Google Cloud’s Retail & Consumer Goods Summit

7953

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

Google Cloud transforms the retail industry with solutions for digital and omnichannel growth, data-driven and customer-focused experiences, and operational improvement.

Today we’re hosting our Retail & Consumer Goods Summit, a digital event dedicated to helping leading retailers and brands digitally transform their business. For me, this is a personally exciting moment, as I see tremendous opportunities for those companies that choose to focus on their customers and leverage technology to elevate experiences.

Our event includes breakout sessions to help retailers and brands become customer centric, embrace the digital moment and transform their operations. Some of my favorite sessions include: 

I’ll be speaking in our Retail Spotlight session, discussing the current retail landscape and our industry approach, followed by conversations with Albert Bertilsson, Head of Engineering – Edge at IKEA Retail (Indga Group) and Neelima Sharma, Senior Vice President, Technology Ecommerce, Marketing and Merchandising at Lowe’s. 

Let me share a bit more about the topics we’ll discuss in that session.

In retail specifically, digital-first shopping journeys are blurring the lines between the physical and digital brand experience. Shoppers want to know what’s available before they visit your stores, and they expect fulfillment options like curbside pickup. We see this when tracking trends for interest in curbside pickup or in-stock items.

google search results.jpg

This has left many retailers asking how they can get smarter with their data, tackle the $300 billion dollar problem of “search abandonment,” move faster to create new customer experiences, and do a better job of connecting their employees and customers – with confidence.

Our team has been spending time thinking about how we can rise and succeed in this new era together. We continue to focus on areas where we can bring the best of our capabilities to our retail customers around the world. And we’re focused on ways we can bring the best of what Google has to offer through cloud integrations.

Our goal is to help retailers become customer-centric and data-driven, capture digital and omni-channel revenue growth, create the modern store and drive operational improvement.

ways we're helping retailers transform.jpg

Let’s dig into each of these strategic pillars in a bit more detail. 

Become customer centric and data driven

Customers today expect experiences that are timely, targeted, and tailored for them and their needs, and reject experiences that can’t deliver these features. Data modeling, legacy technology, and siloed systems often prevent retailers from providing that level of personalized experience. 

At Google Cloud, we work with global retailers and our ecosystem partners to activate and bring value from first-party data, particularly in the field of customer data platforms (CDPs). This includes integrations from Google Cloud, such as our business intelligence platform Looker and other popular platforms to power one source of customer data through the organization. We also help retailers modernize their data warehouse with Looker for gathering business intelligence across their organization. This is important not just for consumer data, but inventory, supply chain, and store operations as well. 

Capture Digital and Omnichannel Growth 

We power some of the largest e-commerce sites in the world, helping them scale for Black Friday, Cyber Monday, and other holiday events. While scale is critically important, it’s also important to consider the quality of the online experience. How do your customers find products? How can you help deliver seamless online and omnichannel experiences? 

To help, we’re building product discovery solutions that bring together the best of our technologies that help retailers drive engagement with their consumers. Retail Search, for example, gives retailers the ability to provide Google-quality search on their own digital properties – search that is customizable for their unique business needs and built upon Google’s advanced understanding of user intent & context. 

The imperative is clear. Recent research found that retailers lose more than $300 billion to search abandonment — when purchase intent is not converted into a sale due to bad search results — every year in the US alone. 

Today, we announced that Retail Search is available to a larger set of retailers. If you are interested in learning more about Retail Search you can contact your sales representative for additional details.

Create the modern store  

With the rise of buying trends like curbside pickup and proximity-based search, our Google Maps Platform team is working on new products and features to help raise inventory awareness for your shoppers. We want to help you make it easier for them to understand what’s available to purchase in their channel of choice.

With Product Locator, each product page connects customers with information they need for local pickup and delivery options. This ensures customers are aware of pickup and delivery options throughout the buying journey—not just checkout. 

Awareness of local inventory can boost a wide range of key metrics for your business. Shopify recently shared that shoppers who opt for local pickup over delivery had a +13% higher conversion rate and that 45% of local pickup customers make an additional purchase upon arrival.

This is just one quick example of how our Google Maps Platform team can improve experiences for your shoppers.

Operational improvement

It can be challenging to operate in a world and at a time when consumer behavior and supply chains are so disrupted and volatile, and where entire retail teams had to go remote during the pandemic and beyond. 

We’re working with retailers to leverage artificial intelligence (AI) to improve consumer experience through chat bots or conversational commerce that solves problems for customers from anywhere. You can learn more about these offerings in our Conversational Commerce with Google breakout session, featuring Albertsons.

As the need for digital transformation continues to accelerate, Google Cloud is helping retailers stay ahead of the curve with solutions for digital and omnichannel growth, data-driven and customer-focused experiences, and operational improvement. For every era of cloud technologies, from the past into the future, Google Cloud is committed to providing solutions to retailers.

Read more about our solutions for retail, and check out additional sessions, including the CPG Industry Spotlight Session How To Grow Brands in Times of Rapid Change – Featuring L’Oréal at our Retail & Consumer Goods Summit.

Whitepaper

A CIO’s Guide to Application Migration

DOWNLOAD WHITEPAPER

3520

Of your peers have already downloaded this article

6:30 Minutes

The most insightful time you'll spend today!

A well-executed digital transformation should do much more than keep you competitive… it should also position you to excel by untethering IT staff from low value, labor-intensive tasks, allowing them to focus on innovation and high-impact projects.

Also, replacing (or supplementing) legacy systems with modern technologies can reduce complexity and cost, while also positioning you to leverage cloud-native tools to achieve enhanced business intelligence and key strategic insights.

Finally, with nearly unlimited scalability at your fingertips, applications can scale up and scale down on demand, while you pay only for what you consume. This allows you to maintain a continuously right-sized cost profile, while also accelerating development and reducing procurement cycles.

Download this whitepaper to get a simple, prescriptive guidance to assist with the most important part of your digital transformation: the beginning.

More Relevant Stories for Your Company

Explainer

Managing Change in an SAP World

Change is a constant for SAP customers. Now more than ever, SAP customers need solutions that provide them business agility, rock solid availability, enhanced security, and true economic value. Learn how Google Cloud can guide your SAP journey to the cloud with simple and no cost migrations, powerful infrastructure, and

Whitepaper

What CFOs Need to Do to Prepare for 2021

In 2020, we’ve witnessed tremendous change not only to our daily lives, but also how businesses work.A key lesson for CFOs and finance leaders: Those who digitized early found faster and most lasting success.The growth we are likely to witness in 2021 is also going to need digitization, but of

Case Study

Johnson & Johnson Increases it’s Ability to Find Highly Qualified Staffers for Business Critical Roles by 41% with Easy-to-Use AI

Job seekers can often feel lost or disconnected—like the right opportunity is out there, but they don’t know where or how to look. Employers face a similar challenge when trying to attract the right candidates. Many companies, especially large enterprises, face a talent shortage across a range of critical roles. For global

Blog

Strategic Consulting, Training & Implementation Guidelines with Public Sector PSO Helps Governments Stay Compliant

Did you know that by 2025, enterprise IT spending on public cloud computing will overtake traditional IT spending? In fact, 51% of IT spend in application software, infrastructure software, business process services, and system infrastructure will transition to the public cloud, compared to 41% in 20221.. As enterprises continue to

SHOW MORE STORIES