My passion for neurodiversity began 10 years ago, when I became involved with Els for Autism, an organization that works with children and adults who have autism, as well as their families. At the time, I had a friend who was struggling to find resources for his son with autism. The foundation promotes acceptance and inclusion for people on the spectrum, helping them live independently and find jobs that harness their talents and skills. The organization’s focus on autism in the workplace resonated deeply with me, due to the rich experiences I had working with individuals with autism over the course of my career.

Approximately two percent of the population has autism, but it’s estimated this number is actually quite low as many individuals go undiagnosed. Of those that have been diagnosed, only 29% have had any sort of paid work in their lives. Personally, I find this tragic, because individuals with autism can be highly-functioning and contributing professionals in any organization. Too often, though, the interview process can pose challenges due to unconscious bias from a hiring manager or interviewer, for example, if the candidate doesn’t look an interviewer in the eyes or asks for additional time to complete a test. This bias often unintentionally marginalizes great candidates and means businesses miss out on valuable talent who can contribute and enrich the workplace. 

Introducing Google Cloud’s Autism Career Program 

It is in that spirit that I am excited to announce the launch of Google Cloud’s Autism Career Program, designed to hire and support more talented people with autism in the rapidly growing cloud industry.

We are working with experts from the Stanford Neurodiversity Project (part of the Stanford University School of Medicine), which provides consultation services to employers to advise on opportunities and success metrics for neurodiverse individuals in the workplace.

One key pillar of our program is to train up to 500 Google Cloud managers and others who are involved in hiring processes. Our goal is to empower these Googlers to work effectively and empathetically with autistic candidates and ensure Google’s onboarding processes are accessible and equitable. Stanford will also provide coaching to applicants, as well as ongoing support for them, their teammates and managers once they join the Google Cloud team.

We’re taking this approach to break down the barriers that candidates with autism most often face. In addition to bias, there may be challenges with how interviews are structured or conducted without the right tools. For these reasons, we will offer candidates in this program reasonable accommodations like extended interview time, providing questions in advance, or conducting the interview in writing in a Google Doc rather than verbally on a call. These accommodations don’t give those candidates an unfair advantage. It’s just the opposite: They remove an unfair disadvantage so candidates have a fair and equitable chance to compete for the job.

This program is just one example of Google Cloud’s commitment to inclusion, and it is an important step forward to building a more representative team and creating value for customers and stakeholders.

At Google Cloud, we believe you get most benefits from the cloud when you scale infrastructure based on changing demand. Compute Engine allows you to configure autoscaling to save costs during periods of low demand, and add capacity to support peak loads. 

When you use a managed instance group (MIG), you can have an autoscaler automatically create or delete virtual machine (VM) instances based on increases or decreases in load. However, if your application takes several minutes to initialize, creating VMs in response to growing load might not increase your application’s capacity quickly enough. For example, if there’s a large increase in load (like when users first wake up in the morning), some users might experience delays while your application is initializing on new instances.

A good way to solve this problem would be to create VMs ahead of demand so that your application has enough time to initialize beforehand. This requires knowing upcoming demand. If only we could predict the future… Well, now we can!

Introducing predictive autoscaling

Predictive autoscaling uses Google Cloud’s machine learning capabilities to forecast capacity needs. It creates VMs ahead of growing demand allowing enough time for your application to initialize.

How does it work?

Predictive autoscaling uses your instance group’s CPU history to forecast future load and calculate how many VMs are needed to meet your target CPU utilization. Our machine learning adjusts the forecast based on recurring load patterns for each MIG. 

You can specify how far in advance you want autoscaler to create new VMs by configuring the application initialization period. For example, if your app takes 5 minutes to initialize, autoscaler will create new instances 5 minutes ahead of the anticipated load increase. This allows you to keep your CPU utilization within the target and keep your application responsive even when there’s high growth in demand. 

Many of our customers have different capacity needs during different times of the day or different days of the week. Our forecasting model understands weekly and daily patterns to cover for these differences. For example, if your app usually needs less capacity on the weekend our forecast will capture that. Or, if you have higher capacity needs during working hours, we also have you covered.

Why should you try it?

Predictive autoscaling continuously adapts forecasted capacity to best match upcoming demand. Autoscaler checks the forecast several times per minute and creates or deletes VMs to match its prediction. The forecast itself is updated every few minutes to match recent load trends so if your growth rate is higher or lower than usual we will adjust the forecast accordingly. This gives you capacity needed to cover peak load while saving on cost when demand goes down. 

You can start using predictive autoscaling without worry as it’s fully compatible with the current autoscaler. Autoscaler will calculate enough VMs to cover both forecasted as well as real-time CPU load—whichever is higher. This works with other autoscaling features as well: you can scale based on schedule, your Load Balancer request target or Cloud Monitoring metrics. Autoscaler provides enough capacity to all of your configurations by taking the highest number of VMs needed to meet all your targets.

Getting started

You can enable predictive autoscaling in the Google Cloud Console. Select an autoscaled MIG from the instance groups page and click Edit group. Change predictive autoscaling configuration from Off to Optimize for availability.

To better understand whether predictive autoscaling is good for your application, click the link See if predictive autoscaling can optimize your availability. This will show you a comparison of the last seven days with your current autoscaling configuration vs. with predictive autoscaling enabled.

In the above chart, 

• Average VM minutes overloaded per day shows how often your VMs exceed your CPU utilization target. This happens when demand is higher than available capacity. Predictive autoscaling can reduce this by starting VMs ahead of anticipated load. 
• Average VMs per day is a proxy for cost. This shows how much additional VM capacity you need to keep your CPU utilization within the target you have set. You can optimize your cost by adjusting Minimum instances andCPU utilization as explained below. 

Optimizing your configuration

Make sure your Cool down period reflects how long it takes for your application to initialize from VM boot time until it’s ready to serve the load. Predictive autoscaling will use this value to start VMs ahead of forecasted load. If you set it to 10 minutes (600 seconds) your VMs will start 10 minutes before the load is expected to increase.

Review your autoscaling CPU utilization target and Minimum number of instances. With predictive autoscaling you no longer need a buffer to compensate for the time it takes for a VM to start. If your application works best at 70% CPU utilization you don’t need to set target to a much lower value as predictive autoscaling will start VMs ahead of usual load. A higher CPU utilization and lower Minimum number of instances allows you to reduce the cost as you don’t need to pay for additional capacity to prepare for growing demand.

Try predictive autoscaling today

Predictive autoscaling is generally available across all Google Cloud regions. For more information on how to configure, simulate and monitor predictive autoscaling, consult the documentation.