IBM Spectrum LSF and Google Collab: Leverage Google Cloud's Scalability and Compute Engine Infrastructure - Build What's Next
Blog

IBM Spectrum LSF and Google Collab: Leverage Google Cloud’s Scalability and Compute Engine Infrastructure

3570

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

IBM Spectrum LSF and Google Cloud collab will help manufacturers and semiconductor businesses to take advantage of Google Cloud's scalability, secure compute engine, and networking and storage infrastructure. Learn more about the partnership.

High Performance Computing (HPC) is prevalent today across many industries, including financial services, life sciences, higher education research, manufacturing, and energy. More and more businesses are deploying HPC workloads in the cloud to take advantage of its elasticity, scalability, and availability. Job schedulers are critical for HPC applications given the nature of these workloads that create, process, and tear down thousands, and sometimes millions, of vCPU and network resources with TB to PB of storage capacity. Job scheduling tools lead to improved operational efficiency and a degree of certainty that a particular HPC job, which can run for hours to weeks, will complete successfully. 

IBM Spectrum LSF is used extensively in the manufacturing and semiconductor industry to manage Electronic Design Automation (EDA) workloads. Dynamically running workloads on-premises and in the cloud, also known as cloud bursting, is becoming a more common practice to address capacity and provisioning time constraints within data centers and enable enterprises to take advantage of virtually unlimited resources. 

However, the challenge with cloud bursting is integrating and maintaining operational consistency across on-premises and cloud environments. IBM Spectrum LSF, in combination with Google Cloud, addresses this problem head on. 

Google Cloud is excited to announce, in collaboration with IBM, enhanced capabilities to IBM Spectrum LSF that enables organizations to integrate their on-premises job scheduling scripts with resources deployed in Google Cloud. Customers are now able to fully leverage Google Cloud’s highly scalable and secure Compute Engine, networking and storage infrastructure. 

The LSF-Google Cloud resource connector patch supports key Google Cloud differentiators including Local SSDs, GCE instance templates, Preemptible VMs, and more: 

  • Bulk API support– Deploy large fleets of VM instances in a matter of seconds.
  • Instance Templates – Simplify VM configuration by creating reusable templates. 
  • All Machine Types – Supports all GCE VM families and machine types, including Custom Machine Types.
  • GPUs – Attach up to 16 GPUs per instance, including the largest A2 instances with up to 16 NVIDIA A100 GPUs
  • Preemptible VMs – Preemptible VMs are provisioned from excess Compute Engine capacity and is a significant way to save money on GCE resources.
  • Local SSD – Attach up to 9TB of NVMe SSD per instance
  • Hyperthreading – Supports the “threads-per-core” option in GCE, which allows per-VM hypervisor level Hyperthread configuration (when supported by Instance Templates)
  • Images – Supports custom disk images, including full support for Windows, for all attached Persistent Disks
  • Placement Policies – Control where the instances are physically located relative to each other within a zone for improved low-latency performance
  • Labels – Supports GCE Labels, which can be used for management of firewall rules, tracking billing, etc
  • Minimum CPU Platform – Supports the ability to specify a minimum CPU Platform for your Virtual Machines.
IBM LSF Architecture
Google Cloud – IBM Spectrum LSF Resource Connector Architecture

Getting Started

This improvement to the IBM LSF Resource Connector was developed by IBM in coordination with Google. Find out more about the new supported features and their operation in the official IBM Spectrum LSF Resource Connector Documentation. You can also find additional documentation and download the software in the IBM Spectrum Computing Community. If you have further questions, you can contact IBM, or Google Cloud Sales.

Special thanks to Annie Ma-Weaver, Mark Mims, and Wyatt Gorman for their contributions.

Blog

Highnote Build the First Flexible, End-to-end Embedded Finance Platform on Google Cloud

3256

Of your peers have already read this article.

3:00 Minutes

The most insightful time you'll spend today!

Highnote, a financial services startup leverages Google Cloud platform to build an all-in-one, embedded platform to quickly create payments cards, wallets, innovative reward programs, credits and other financial products without building a new org!

The ability to quickly introduce and evolve payment options for products or services is essential for businesses, as nearly 50% of consumers who can’t use a preferred payment method abandon their purchase. At the same time, gift cards, branded credit cards and rewards programs are critical tools that companies rely on to build more loyal and lasting customer relationships. With Highnote, companies have an all-in-one embedded platform to quickly create payment cards and wallets, offer innovative rewards programs and credit, and provide sustainable wage access. It is the first platform that allows enterprises to make card issuance an embedded capability of their product without creating an entirely new (and costly) organization.

Creating an exciting fintech future with Google Cloud


When thinking about building the industry’s first end-to-end embedded finance platform, we quickly realized Highnote would only be successful if it enabled companies to truly innovate and quickly roll out new programs. To do so, the platform would have to be built on scalable infrastructure capable of securely delivering services with speed and reliability while offering easy access to actionable Big Data analytics.

Working closely with the team at the Google for Startups Cloud Program, we successfully implemented Google Cloud as a versatile, future-proof foundation of our platform—and built Highnote from the ground up in just one year. Highnote’s GraphQL-based API platform reinvents the card issuance process. Utilizing the developer-friendly Highnote platform, product and engineering teams at digital enterprises of all sizes can easily and efficiently embed virtual and physical payment cards (commercial and consumer prepaid, debit, credit, and charge), ledger, and wallet capabilities into their existing products. This creates compelling value while growing revenue and building a unique and differentiated brand.

We leverage Cloud Spanner, BigQuery, and Google Kubernetes Engine (GKE) to create a unified and highly secure PCI DSS-compliant platform with GraphQL APIs that provide rapid and flexible money transfers. This gives us a reliable platform to deliver and test customer experiences, respond to outcomes, and make better business decisions. Powered by Google Cloud, our data models and application domains are architected to support configurations and customizations that unlock a diverse set of new use cases across industries, including retail, travel, logistics, healthcare, and sustainable wage access programs.

We are especially proud to highlight our enablement of sustainable wage access, as this program helps the 50% of Americans living paycheck to paycheck. Embedding this program within payroll systems provides a viable alternative to payday lenders who often charge exorbitant fees and interest rates. In real world terms, this means Highnote helps people access earned wages before payday at no cost.

The other customer we just went live with was Tillful, and their Tillful card helps small businesses build their business credit. This program will help new and emerging businesses as well as underrepresented owners of small businesses by making the credit ecosystem accessible. Highnote’s platform is designed to support multiple use cases across many industries. For example, we also help the trucking and logistics companies to develop fleet and fuel cards, and spend management companies who are looking to uplevel offerings.

Delivering high-performance transactions with Cloud Spanner


Building one of the world’s most modern card platforms would not have been possible without Cloud Spanner. We needed a solution that would keep our massive petabyte databases from buckling and more securely deliver data anywhere in the U.S. Cloud Spanner does all this and more, as it routinely connects purchases from millions of customers to tens of thousands of vendors. We also wanted to reduce overhead by 80% by eliminating manual sharding, partitioning, and optimization of data. These processes are automatic with Cloud Spanner so we can operate at maximum efficiency.

We specifically selected Cloud Spanner as our distributed SQL database management and storage solution because of its outstanding availability, zero plan maintenance downtime, security certifications, and the highest consistency guarantees of any scale-out database. We continue to optimally scale without any downtime or compromises to the integrity or security of our data. This is key for us because we can address unexpected spikes, long-term growth, and new services without costly rearchitecting.

Highnote is designed to perform over billions of transactions on Cloud Spanner, and the average latency of less than 250 ms is a testament to the robustness of Google Cloud services.

Enabling actionable customer insights at scale


BigQuery is another key Google Cloud solution that we rely on to deliver deep insights and visibility for our customers on a highly secure and scalable platform. When building Highnote, we knew we needed a cost-effective solution that excelled at data analytics. This is particularly critical for accurately measuring the performance—whether profitability or efficacy—of any program or card.

Using BigQuery, we successfully run analytics at scale with as much as a 34% lower three-year TCO than cloud data warehouse alternatives. Over the past year, BigQuery has enabled our customers to unlock data-rich capabilities with a ledger that tracks money in real time and serves up complete debit and credit entries for every event across their accounts. Companies also access real time balances for revenue, fees, customer accounts, and available funds management without complicated spreadsheets.

To quickly and efficiently roll out Highnote to our customers, we needed a simple way to automatically deploy, scale, and manage Kubernetes. When selecting a Kubernetes management tool, our top priorities were rapidly spinning up and securely scaling across multiple sites. As part of Google Cloud’s expansive ecosystem, Google Kubernetes Engine (GKE) was the top choice due to seamless and automatic Kubernetes scaling and management.

We quickly got off the ground with single-click clusters and scaled up by using the high-availability control plane—including multi-zonal and regional clusters—to easily accommodate multiple active-active regions (which other solutions cannot do). As an embedded finance platform, stringent security protocols were obviously a key consideration for us. GKE is secure by default and runs routine vulnerability scans of container images and data encryption. Further security assistance was provided by Google Cloud partners 66degrees and DoiT International to help us rapidly validate VPC PCI compliance and ensure the uninterrupted performance of thousands of transactions per second.

Winning in fintech with Google for Startups


Building the industry’s first end-to-end embedded finance platform would have been extremely challenging without the extensive Google Cloud support. By working closely with our Startups team and Google partners, we had access to Google Cloud services to more easily validate VPC PCI compliance and address most issues before we exited stealth. Their responsiveness is incredible and stands out compared to support services we’ve seen from other technology providers.

Our participation in the Google for Startups Cloud program has been instrumental to our success. With Google Cloud, we are making embedded payments accessible to our customers without a big budget price tag. By doing so, we help unleash the creativity of emerging enterprises by enabling them to innovate with payment services and rewards programs to reach new markets and customers. If companies can dream, we can enable them to realize it on Highnote. Our platform really is that flexible. We’re excited where we can go and grow with Google Cloud.

If you want to learn more about how Google Cloud can help your startup, visit our page here to get more information about our program, and sign up for our communications to get a look at our community activities, digital events, special offers, and more.

Blog

7 Fantastic Ways Google Cloud VMWare Engine Stands Out from the Rest for Running VMWare Workloads in the Cloud!

3577

Of your peers have already read this article.

2:00 Minutes

The most insightful time you'll spend today!

Google Cloud migration for VMware workloads impacts savings 38 percent in TCO. Still considering the pros of Google Cloud VMWare Engine? Here are seven customer-centric innovations in its infrastructure that makes its ideal for Vsphere workloads!

Google Cloud VMware Engine delivers an enterprise-grade, cloud-native VMware experience that is built on Google Cloud’s highly performant and scalable infrastructure. By enabling a consistent VMware experience, the service allows customers to adopt Google Cloud rapidly, easily, and with minimal modifications to their vSphere workloads, bringing the best of VMware and Google Cloud together on one platform for a variety of use-cases. These include rapid data center exit, application lift and shift, disaster recovery, virtual desktop infrastructure, or modernization at your own pace.

Here are seven ways VMware Engine outshines alternatives for running your VMware workloads in the cloud, simplify your operations, and help you innovate faster:

  1. Dedicated 100Gbps east-west networking
    Google Cloud VMware Engine nodes come with redundant switching and dedicated 100Gbps east-west networking with no oversubscription of bandwidth, unlike other options where there is generally oversubscription. This is especially important when it comes to running latency-sensitive workloads.
  2. Four 9’s of availability in a single zone
    The service offers 99.99% uptime SLA for a cluster in a single Zone with five to 16 nodes and FTT=2 or more without the need for stretched clusters, which is higher than the alternatives. Further, dedicated connectivity for core service functions such as vSAN and vMotion enables better solution stability and availability. This enables the service to support the needs of enterprise workloads that require high availability.

Note: “Cluster” means a deployment of three or more dedicated bare metal nodes running VMware ESXi and associated networking managed via management interfaces.

  1. Global networking without complex routing
    Google Cloud VMware Engine networking is built based on Google Cloud’s powerful networking architecture. With simplified regional and global routing modes—which allow a VPC’s subnets to be deployed in any region where our service is available—you can architect global networks without the need or overhead of creating and connecting regional network designs. You get instant, direct Layer 3 access between them. In alternative cloud environments, you may have to configure special networking between regions, often requiring VPN-based tunnels over the WAN to enable global uniform network communication. This adds to the deployment and operational complexity, in addition to cost.
  2. Integrated multi-VPC networking
    Users often have application deployments in different VPC networks, such as separate dev/test and production environments or multiple administrative domains across business units. The service supports “many-to-many” access from VPC networks to Google Cloud VMware Engine networks with multi-VPC networking, allowing you to retain existing deployed architectures and extend them flexibly to your VMware environments. In addition, by providing multi-VPC networking, you can pool their VMware needs—say for QA and dev—to a smaller set of clusters, effectively reducing their costs.

For more information about the end-to-end networking capabilities and services available in Google Cloud VMware Engine, please refer to the Private Cloud Networking for Google Cloud VMware Engine whitepaper. Here, you’ll find details about network flows, configuration options, and the differentiated benefits of running your VMware workloads in Google Cloud.

  1. Unified, cloud-integrated model
    Google Cloud VMware Engine is a fully managed Google first-party service, operated and supported by Google and its world-class team. With fully integrated identities, billing, and access control, you have a simpler end-to-end experience that is different from other services. You access Google Cloud VMware Engine service via the Google Cloud console, like any other Google Cloud service. You can also access other native Google Cloud services privately from your VMware private cloud running in Google Cloud VMware Engine over local connections.
  2. Flexibility in third-party ecosystem compatibility
    With Google Cloud VMware Engine, you can set up existing VMware on-premises third-party tools or products that require additional privileges by using a solution user account. This uniquely enables operational consistency, ensuring that the tools you have invested in and used over the years work on Google Cloud VMware Engine. Furthermore, in key areas such as vSAN data encryption, you have the choice of not only using Google Cloud Key Management Service (KMS)—which is turned on by default on vSAN datastores—but also external KMS providers such as HyTrust, Thales, and Fortanix.
  3. Dense nodes with high storage:core and memory:core ratios and fast provisioning
    Google Cloud VMware Engine nodes are dense. Each node is powered by Intel® Xeon® Scalable Processors and comes with 36 cores, 72 hyperthreaded cores, 768 GB memory, 19.2 TB NVMe data and 3.2 TB NVMe cache storage. This, along with oversubscription, leads to high consolidation ratios and compelling storage:core per dollar and memory:core per dollar. In addition, you can rapidly spin up these nodes in a VMware private cloud often in under an hour, enabling on-demand, VMware-consistent capacity in Google Cloud for your needs.

These are just a few examples of customer-centric innovation that set Google Cloud VMware Engine infrastructure apart. In addition, migrating to Google cloud can save you up to 38% in TCO. Get started by learning about Google Cloud VMware Engine and your options for migration, or talk to our sales team to join the customers who have embarked upon this journey.

The authors would like to thank the Google Cloud VMware Engine product team for their contributions on this blog.

Explainer

Rely on Google Cloud for SAP

DOWNLOAD EXPLAINER

3478

Of your peers have already downloaded this article

1:30 Minutes

The most insightful time you'll spend today!

Reduce risks, increase uptime, and free up working capital with Google Cloud’s SAP Business Continuity Program. Working closely with our experienced partner community, we will ease the lift and shift of your on premises or hosted SAP environments with simple, no-cost migrations.

Gain a future-proof digital business platform with integrated artificial intelligence, machine learning, and advanced analytics that deliver deep insights for all who need them.

Get the performance, compute power, flexibility, scalability, availability, and security you need for your current and future business needs with SAP on Google Cloud. Download this factsheet to learn more.

Blog

How to Get Your Cloud Migration Journey Started Off on the Right Foot

3595

Of your peers have already read this article.

2:30 Minutes

The most insightful time you'll spend today!

While it can be tempting to believe in a universally correct strategy for change management, there is no one-size-fits-all answer. But, here are some core strategies that are relevant and useful across a broad range of businesses.

When moving to the cloud, many organizations concentrate their focus on the change in technology, and overlook an area just as complex: cultural change. 

At Google, we’ve spent years nurturing our culture and workforce to best operate in the cloud, and the Google Cloud Professional Services team leverages the lessons we’ve learned for the benefit of enterprise customers embarking on their own cloud journeys. 

While it can be tempting to believe in a universally ‘correct’ strategy for change management, there is no one-size-fits-all answer. Every organization will have its own unique considerations. But with that said, there are some core strategies we’ve found to be relevant and useful across a broad range of businesses. 

1. Define your purpose for moving to Cloud
While pockets of cloud use and experimentation can evolve independently and in parallel across an organization, it’s important to make some deliberate decisions before starting a larger migration. At this stage, we recommend having a detailed answer to two key questions to ensure a successful cloud migration:

  • Where do you want to go? (Or “What’s your cloud vision?”) 
  • How do you plan to get there?

Start by having a conversation with leaders and those who will be key to the journey about how far you want to push your cloud vision. This alignment ensures everyone is on the same page—and will provide greater direction, allowing more deliberate action. 

2. Find the change path which is right for you 
Whether a ‘lift and shift’ approach to the cloud is right for you, or a more transformative approach with a lot of re-architecting—the most important thing is to find the flavor of change which is appropriate to your context and level of ambition.This will both shape your key migration activities, but also the level of impact to be managed within your organization.  

There are many ways to embark on a change journey for cloud migration (which one can find in the chart below). It is important to deeply understand the needs of your business and its people and determine what strategy makes the most sense.

Five common change paths.png

3. Learn from best practices
Based on the lessons we’ve learned along our own journey, and the work we’ve done with customers, there are a number of recommendations we can share that can make a cloud migration more successful. We go into these in more detail in our new whitepaper, but below you can find the ones we think are most relevant: 

  • Share the vision—and measure, measure, measure. Once you’ve crystallised your cloud vision with leadership and key stakeholders, share that vision widely. Set success goals and communicate them to hold yourself accountable.  
  • Be clear about the capabilities you will need in the future—and where you’ll get them. For example, if your vision is to become a cloud-first, data and AI-led organization, ensuring you have the right data science skills and machine learning capabilities in your organization to achieve that vision becomes a critical step—be they home-grown or bought-in.
  • Find the right balance between capabilities that should be under central control, and capabilities that should be decentralized, or agile. For example, should machine learning be something that sits centrally, or should it be spread across your organization? For every business, the solution will be a little different, and there’s no “one true answer.” There’ll be lots of different opinions about this, so the sooner the conversation starts, the better.  
  • Start thinking about the needed tech and non-tech skills now, and how you’ll fill the gaps. Building the tech skills will take time, and not everyone will feel comfortable with the future picture of collaboration, innovation, and agility. 

To help businesses navigate their own cloud journeys, Google Cloud Professional Services has released a new whitepaper that can help guide organizations. “Managing Change in the Cloud” is closely aligned with the Google Cloud Adoption Framework and is a practical guide for organizations looking to maintain momentum in their cloud adoption. You can download the whitepaper here.

3598

Of your peers have already watched this video.

10:42 Minutes

The most insightful time you'll spend today!

Case Study

The Inside Story of How PayPal Became an Innovator in a Competitive Market

PayPal is an American company operating a worldwide online payment system that supports online money transfers and serves as an electronic alternative to traditional paper methods like checks and money orders. The company enables over 29 million payments or transactions on a peak day. in over 200 markets around the world.

PayPal wanted to scale its business. It had achieved a 25% payment growth across the world. It wanted to ensure it’s available wherever its customers are and enable seamless transactions. PayPal also wanted to ensure flexibility. “There are huge variations in the amounts of payment that happen every day of the week or every week of the year. We wanted to ensure our systems are capable of keeping up with these variations,” says Sri Shivananda, SVP and CTO, PayPal.

The company also had to meet regulatory compliance needs across its 200 markets and increase its efficiency. It wanted to get rid of hardware on-premises which it wasn’t using on a regular basis. And above all, the company wanted to innovate quickly to beat the competition.

This is why PayPal turned to Google Cloud. Watch how it made the transition and reaped the benefits.



More Relevant Stories for Your Company

Blog

Explore The New Era of Flexibility: Streamlined AWS-to-Google Cloud Migration

As an IT leader, you’re asked to do it all: innovate and optimize your tech stack for business outcomes — all while being secure and compliant. It takes heroic efforts to achieve innovation and progress while also tightening budgets and teams. This is why many of you are considering migrating applications

Blog

How Google Cloud and SAP Address Global Supply Chain Initiatives

With SAP Sapphire kicking off today in Orlando, we’re looking forward to seeing our customers and discussing how they can make core processes more efficient and improve how they serve their customers. One thing is certain to be top of mind – the global supply chain challenges facing the world

Case Study

Southwire Completes SAP Migration to Google Cloud as a First Step of its Tech Evolution

“Talk about tough times, right?” That’s how Dan Stuart, Senior Vice President of IT Services at Southwire Company, refers to the months following a December 2019 ransomware event, and the COVID crisis that began in spring of 2020. Those events hit just as the company was preparing for an overhaul

Case Study

Fitbit’s Zero-Downtime Migration to GCP

In 2019, Fitbit moved all of its production operations from managed hosting to Google Cloud Platform without any downtime. The Fitbit experience is provided by a monolithic application backed by 200+ data stores, making the task of moving service by service impossible. So, Fitbit decided to run services in both

SHOW MORE STORIES