IBM Spectrum LSF and Google Collab: Leverage Google Cloud's Scalability and Compute Engine Infrastructure - Build What's Next
Blog

IBM Spectrum LSF and Google Collab: Leverage Google Cloud’s Scalability and Compute Engine Infrastructure

3582

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

IBM Spectrum LSF and Google Cloud collab will help manufacturers and semiconductor businesses to take advantage of Google Cloud's scalability, secure compute engine, and networking and storage infrastructure. Learn more about the partnership.

High Performance Computing (HPC) is prevalent today across many industries, including financial services, life sciences, higher education research, manufacturing, and energy. More and more businesses are deploying HPC workloads in the cloud to take advantage of its elasticity, scalability, and availability. Job schedulers are critical for HPC applications given the nature of these workloads that create, process, and tear down thousands, and sometimes millions, of vCPU and network resources with TB to PB of storage capacity. Job scheduling tools lead to improved operational efficiency and a degree of certainty that a particular HPC job, which can run for hours to weeks, will complete successfully. 

IBM Spectrum LSF is used extensively in the manufacturing and semiconductor industry to manage Electronic Design Automation (EDA) workloads. Dynamically running workloads on-premises and in the cloud, also known as cloud bursting, is becoming a more common practice to address capacity and provisioning time constraints within data centers and enable enterprises to take advantage of virtually unlimited resources. 

However, the challenge with cloud bursting is integrating and maintaining operational consistency across on-premises and cloud environments. IBM Spectrum LSF, in combination with Google Cloud, addresses this problem head on. 

Google Cloud is excited to announce, in collaboration with IBM, enhanced capabilities to IBM Spectrum LSF that enables organizations to integrate their on-premises job scheduling scripts with resources deployed in Google Cloud. Customers are now able to fully leverage Google Cloud’s highly scalable and secure Compute Engine, networking and storage infrastructure. 

The LSF-Google Cloud resource connector patch supports key Google Cloud differentiators including Local SSDs, GCE instance templates, Preemptible VMs, and more: 

  • Bulk API support– Deploy large fleets of VM instances in a matter of seconds.
  • Instance Templates – Simplify VM configuration by creating reusable templates. 
  • All Machine Types – Supports all GCE VM families and machine types, including Custom Machine Types.
  • GPUs – Attach up to 16 GPUs per instance, including the largest A2 instances with up to 16 NVIDIA A100 GPUs
  • Preemptible VMs – Preemptible VMs are provisioned from excess Compute Engine capacity and is a significant way to save money on GCE resources.
  • Local SSD – Attach up to 9TB of NVMe SSD per instance
  • Hyperthreading – Supports the “threads-per-core” option in GCE, which allows per-VM hypervisor level Hyperthread configuration (when supported by Instance Templates)
  • Images – Supports custom disk images, including full support for Windows, for all attached Persistent Disks
  • Placement Policies – Control where the instances are physically located relative to each other within a zone for improved low-latency performance
  • Labels – Supports GCE Labels, which can be used for management of firewall rules, tracking billing, etc
  • Minimum CPU Platform – Supports the ability to specify a minimum CPU Platform for your Virtual Machines.
IBM LSF Architecture
Google Cloud – IBM Spectrum LSF Resource Connector Architecture

Getting Started

This improvement to the IBM LSF Resource Connector was developed by IBM in coordination with Google. Find out more about the new supported features and their operation in the official IBM Spectrum LSF Resource Connector Documentation. You can also find additional documentation and download the software in the IBM Spectrum Computing Community. If you have further questions, you can contact IBM, or Google Cloud Sales.

Special thanks to Annie Ma-Weaver, Mark Mims, and Wyatt Gorman for their contributions.

Blog

Google Extends Support for Windows Server Containers on Anthos for Faster App Modernization and Consistent Dev Experience

5603

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

Google announced support for Windows Server containers running on Google Kubernetes Engine (GKE). This year, Google took a step ahead with support for Windows Server on Anthos to help achieve similar experience across hybrid and cloud environs.

Today, many applications in organizations’ data centers run on Windows Server. Modernizing these traditional Windows apps onto Kubernetes promises a host of benefits: a consistent platform across environments, better portability, scalability, availability, simplified management and speed of deployment, just to name a few. But how? Rewriting traditional .NET applications to run on Linux with .NET Core can be challenging and time-consuming. There is, however, a lower-toil, more developer friendly option.

Last year, we announced support for Windows Server containers running on Google Kubernetes Engine (GKE), our cloud-based managed Kubernetes service, which lets you take the advantage of containers without porting your apps to .NET core or rewriting them for Linux. Today, we’re going a step further with support for Windows Server containers on Anthos clusters on VMware in your on-premises environment. Now available in preview, you can consolidate all your Windows operations across on-prem and Google Cloud.

Bringing Windows Server support to our family of Kubernetes-based services—GKE running on Google Cloud, and Anthos everywhere—with the same experience, lets you modernize apps faster and achieve a consistent development and deployment experience across hybrid and cloud environments. Further, by running Windows and Linux workloads side by side, you get operational consistency and efficiency—no need to have multiple teams specializing in different tooling or platforms to manage different workloads. The single-pane-of-glass view and the ability to manage policies from a central control plane simplifies the management experience, while bin packing multiple Windows applications drives better resource utilization, leading to infrastructure and license savings.

Google Cloud Console.jpg
Google Cloud Console provides a single pane of glass view for managing your clusters in different environments

With all these benefits, it’s no surprise that customers such as Thales, a French multinational firm specializing in aerospace and security services, have been able to reap significant benefits by moving Windows applications to GKE. 

“We moved our Windows applications from VMs to Windows containers on GKE and now have a unified mechanism for Linux and Windows-based application management, scaling, logging, and monitoring. Earlier, setting up these applications in VMs and configuring them for high availability used to take up to a week, and the applications were not easily scalable,” said Najam Siddiqui, Solutions Architect at Thales. “Now with GKE, the setup takes only a few minutes. GKE’s automatic scaling and built-in resiliency features make scaling and high-availability setup seamless. Also, manually maintaining the VMs and applying security patches used to be tedious, which is now handled by GKE.” 

Let’s take a deeper look at the architecture that lets you run your Windows container-based workloads on-prem. 

Windows Server running on-prem with Anthos 

The diagram below illustrates the high-level architecture of running Windows container-based workloads in an on-prem GKE cluster with Anthos. Windows server node-pools can be added to an existing or new Anthos cluster. Kubelet and Kube-proxy run natively on Windows nodes, allowing you to run mixed Windows and Linux containers in the same cluster. The admin cluster and the user cluster control plane continue to be Linux-based, providing you a consistent orchestration experience and management ease across Windows and Linux workloads.

Windows Server and Linux containers.jpg
Windows Server and Linux containers running side-by-side in the same Anthos on-prem cluster

Get started today

When considering modernizing your on-prem Windows estate, we recommend running Windows Server containers on Anthos in your own data center. If you are new to Anthos, the Anthos getting started page and the Coursera course on Architecting Hybrid Cloud with Anthos are good places to start. You can also find detailed documentation on our website, and our partners are eager to help you with any questions related to the published solutions, as is the GCP sales team. And as always, please don’t hesitate to reach out to us at anthos-onprem-windows@google.com if you have any feedback or need help unblocking your use case.

3074

Of your peers have already watched this video.

6:00 Minutes

The most insightful time you'll spend today!

Blog

How Ambrook and Google Cloud Ensure Sustainability and Profits for Farmers

Ambrook is one of the leading innovators in the agriculture sector that offers farm accounting and management software to help farmers grow finances and resources to be more sustainable and profitable. In this video session with Google Cloud, learn how Ambrook broke the gap between profitability and sustainability in the natural resource industry, allowing farmers ease back office paperwork and finance management challenges with their easy-to-use, book-keeping software with the tools and spending cards to save producers time and money. Also, watch to learn how the firm uses Google Cloud to make sustainability profitable!

4897

Of your peers have already watched this video.

11:30 Minutes

The most insightful time you'll spend today!

Explainer

Driving Business Transformation in Manufacturing, Industrial, and Transportation Using Google Cloud and AI/ML

Google Cloud partners closely with manufacturing, industrial, and transportation organizations to drive business transformation.

In this video, Mandeep Waraich, Head of Product – Industrial AI, Google Cloud, shares customer stories as well as Google Cloud’s differentiated AI products and solutions.

Waraich covers the current state of automation and industrial efficiency and how artificial intelligence is revealing an entirely new universe of possibilities.

He also speaks about Google Cloud’s approach to bringing these AI technologies to the market, and Google Cloud’s “deploy anywhere” methodology that helps achieve the impact of AI at a global enterprise scale.

Whitepaper

Google Leads the Pack in Cloud Data Warehouse: Forrester Research

DOWNLOAD WHITEPAPER

3953

Of your peers have already downloaded this article

3:30 Minutes

The most insightful time you'll spend today!

Cloud data warehouse solutions are changing the way firms build and support data platforms for insights. From provisioning a cloud data warehouse in minutes without requiring any technical expertise to allowing business analysts and other nontechnical users to access, store, and process large amounts of data for insights, they allow users to focus on business issues rather than deal with technical complexity.

No wonder, technology leaders rate cloud data warehouses as critical for their data management strategy. As a result, cloud data warehouse deployments are on the rise as firms across industries look at lowering costs, supporting new accelerated insights, and simplifying data management.

Analyst firm Forrester Research in its recent report on the Cloud Data Warehouse market has named Google Cloud a leader in this space as it offers large and complex cloud deployments, supports a broader set of use cases, and delivers high performance, scale, and automation.

Download this Forrester Research report to understand why enterprises are turning to cloud data warehouses and why Google Cloud is a leader in this space.

Case Study

Google Cloud and Univision Partnership to Up the Ante in UX for Spanish-speaking Audience

6881

Of your peers have already read this article.

1:00 Minutes

The most insightful time you'll spend today!

Consumption of content from streaming platforms grew exponentially in the last year, driving entertainment and media platforms to make meaningful usage of audience data for personalization, better UX and enhanced viewing experience. Spanish-language content and media company, Univision leveraged Google Cloud's AI, ML and data analytics tools to unveil useful insights that enhance engagement of it's global, Spanish-speaking audience.

The past year has given everyone lots to think about—about our priorities as people and as businesses. As the world retreated behind closed doors, we saw how shared interests and experiences can bring us together. As the world grappled with a common enemy, we witnessed just how differently individuals, communities and indeed entire countries can experience a situation. And as we faced seemingly unending obstacles to making it through the pandemic, we saw how making smart decisions based on data can drive meaningful solutions—fast.

That’s why we here at Google Cloud are so proud to partner Univision, the country’s leading Spanish-language content and media company. By partnering with Google Cloud, Univision will be able to accelerate growth across its portfolio of properties, deliver an enhanced user experience for Spanish-speaking audiences and provide the enterprise solutions needed to create the Spanish-language media company of the future.

According to Instituto Cervantes, there are over 580 million Spanish language speakers worldwide. Those viewers, like people everywhere, are avid consumers of streaming content. In Q4 of 2020 alone, viewing time for that content increased by 44%1, and in 2020, from 50%2 more sources. With that surge in demand, Univision needed a cloud provider whose infrastructure could reach Hispanic viewers around the world. With two-plus decades spent building out its network and data centers, as well as global content-delivery capabilities, Google Cloud has the infrastructure Univision needs to reach viewers across the Spanish-speaking world.

At the same time, with such a diverse audience for their content, Univision needs to target that content to viewers’ specific preferences. By applying Google Cloud’s artificial intelligence (AI) and machine learning (ML) technology across its content, Univision intends to personalize content based on shows users have previously watched, enhancing their engagement and viewing experience. 

And as Univision transforms the user experience, it can use Google Cloud’s data and analytics suite to garner deeper insights into its audience and forge stronger relationships with them on an individual basis. With Looker and BigQuery, Univision employees will have access to real-time data to help them make business decisions about programming.

Univision will also migrate video distribution and production operations to Google Cloud, where we’ll help them streamline media workflows and develop innovative new capabilities. Meanwhile, Google Cloud’s tight business and technical integration with other Google services will help ensure Univision reaches viewers on the device of their choice, wherever they are in the world. For example, in the coming years, Univision will expand its global YouTube partnership and will integrate with entertainment features on Google Search that help people better discover TV shows and movies. The company will also use Google Ad Manager for global ad decisioning and Google’s Dynamic Ad Insertion for PrendeTV and future video-on-demand offerings. Finally, Univision will distribute its content and services on Google Play across Android phones and tablets, as well as Google TV and other Android TV OS devices.

We’re thrilled to partner with Univision to help them reach the Spanish-speaking world with their content. With our cloud portfolio, we can help them reach individual viewers around the world, with personalized content that they can consume however they see fit. Best of all, together, we can help them achieve this vision fast, leveraging established cloud, content delivery, and data analytics technologies. You can learn more about the partnership here.

More Relevant Stories for Your Company

Explainer

What’s Google Cloud Firestore Database and What are it’s Benefits for Business and Developers?

Cloud Firestore is a NoSQL document database that simplifies storing, syncing, and querying data for your mobile and web apps at global scale. Cloud Firestore is a fast, fully managed, serverless, cloud-native NoSQL document database that simplifies storing, syncing, and querying data for your mobile, web, and IoT apps at

Blog

Google and Fervo Agreement to Shape-up Plans for 24/7 Carbon-free Energy by 2030

When Google announced our plan to go beyond purchasing renewable power for 100% of our energy usage and operate on 24/7 carbon-free energy by 2030, we noted that achieving this goal will require new transaction structures, advancements in clean energy policy, and innovative new technologies. Today, we’re pleased to announce that one of

How-to

30 Guides to Ease Your Cloud Migration Journey

Getting started with your migration One of the challenges with cloud migration is that you’re solving a puzzle with multiple pieces. In addition to a number of workloads you could migrate, you’re also solving for challenges you’re facing, the use cases driving you to migrate, and the benefits you’re looking to gain.

Blog

Google’s Research and Data Insights Solutions to Power Drug Development and Clinical Research

In order to be successful, research needs to be replicable, so scientists can build on past work and insights. However, an article in Nature warned that as much as 50% of published drug development research could not be reproduced in subsequent trials. As a result, promising drug candidates sometimes led to disappointment,

SHOW MORE STORIES