Where should you run your workload? It depends…Choosing the right infrastructure options to run your application is critical, both for the success of your application and for the team that is managing and developing it. This post breaks down some of the most important factors that you need to consider when deciding where you should run your stuff!

What are these services?

• Compute Engine – Virtual machines. You reserve a configuration of CPU, memory, disk, and GPUs, and decide what OS and additional software to run.
• Kubernetes Engine – Managed Kubernetes clusters. Kubernetes is an open-source system for automating deployment, scaling, and management of containerized applications. You create a cluster and configure which containers to run; Kubernetes keeps them running and manages scaling, updates and connectivity.
• Cloud Run – A fully managed serverless platform that runs individual containers. You give code or a container to Cloud Run, and it hosts and auto scales as needed to respond to web and other events.
• App Engine – A fully managed serverless platform for complete web applications. App Engine handles the networking, application scaling, and database scaling. You write a web application in one of the supported languages, deploy to App Engine, and it handles scaling, updating versions, and so on. 
• Cloud Functions – Event-driven serverless functions. You write individual function code and Cloud Functions calls your function when events happen (for example, HTTP, Pub/Sub, and Cloud Storage changes, among others). 

What level of abstraction do you need?

• If you need more control over the underlying infrastructure (for example, the operating system, disk images, CPU, RAM, and disk) then it makes sense to use Compute Engine. This is a typical path for legacy application migrations and existing systems that require a specific OS. 
• Containers provide a way to virtualize an OS so that multiple workloads can run on a single OS instance. They are fast and lightweight, and they provide portability. If your applications are containerized then you have two  main options. 
  • You can use Google Kubernetes Engine, or GKE, which gives you full control over the container down to the nodes with specific OS, CPU, GPU, disk, memory, and networking. GKE also offers Autopilot, when you need the flexibility and control but have limited ops and engineering support. 
  • If, on the other hand, you are just looking to run your application in containers without having to worry about scaling the infrastructure, then Cloud Run is the best option. You can just write your application code, package it into a container, and deploy it.  
• If you just want to code up your HTTP-based application and leave the scalability and deployment of the app to Google Cloud then App Engine — a serverless, fully-managed option that is designed for hosting and running web applications — is a good option for you. 
• If your code is a function and just performs an action based on an event/trigger, then deploying it with Cloud Functions makes sense. 

What is your use case? 

• Use Compute Engine if you are migrating a legacy application with specific licensing, OS, kernel, or networking requirements. Examples: Windows-based applications, genomics processing, SAP HANA.
• Use GKE if your application needs a specific OS or network protocols beyond HTTP/s. When you use GKE, you are using Kubernetes, which makes it easy to deploy and expand into hybrid and multi-cloud environments. Anthos is a platform specifically designed for hybrid and multi-cloud deployments. It provides single-pane-of-glass visibility across all clusters from infrastructure through to application performance and topology. Example: Microservices-based applications. 
• Use Cloud Run if you just need to deploy a containerized application in a programming language of your choice with HTTP/s and websocket support. Examples: websites, APIs, data processing apps, webhooks.
• Use App Engine if you want to deploy and host a web based application (HTTP/s) in a serverless platform. Examples: web applications, mobile app backends
• Use Cloud Functions if your code is a function and just performs an action based on an event/trigger from Pub/Sub or Cloud Storage. Example: Kick off a video transcoding function as soon as a video is saved in your Cloud Storage bucket.

Need portability with open source? 

If your requirement is based on portability and open-source support take a look at GKE, Cloud Run, and Cloud Functions. They are all based on open-source frameworks that help you avoid vendor lock-in and give you the freedom to expand your infrastructure into hybrid and multi-cloud environments.  GKE clusters are powered by the Kubernetes open-source cluster management system, which provides the mechanisms through which you interact with your cluster. Cloud Run for Anthos is powered by Knative, an open-source project that supports serverless workloads on Kubernetes. Cloud Functions use an open-source FaaS (function as a service) framework to run functions across multiple environments. 

What are your team dynamics like?

If you have a small team of developers and you want their attention focused on the code, then a serverless option such as Cloud Run or App Engine is  a good choice because you won’t have to have a team managing the infrastructure, scale, and operations. If you have bigger teams, along with your own tools and processes, then Compute Engine or GKE makes more sense because it enables you to define your own process for CI/CD, security, scale, and operations. 

What type of billing model do you prefer? 

Compute Engine and GKE billing models are based on resources, which means you pay for the instances you have provisioned, independent of usage. You can also take advantage of sustained and committed use discounts. 

Cloud Run, App Engine, and Cloud Functions are billed per request, which means you pay as you go. 

Conclusion

It’s important to consider all the relevant factors that play a role in picking appropriate compute options for your application. Remember that no decision is necessarily final; you can always move from one option to another.

To explore these points in more detail, please take a look at the “Where Should I Run My Stuff?” video.

For more #GCPSketchnote, follow the GitHub repo &  thecloudgirl.dev. For similar cloud content follow us on Twitter at @pvergadia and @briandorsey

Tradier uses the Apigee API management platform from Google to abstract the legacy complexities of capital markets so that developers can build FinTech applications in an agile, nimble, and quick fashion at minimal cost. The company embodies the evolution of what cloud technology can enable in the form of an API-first business delivered as a service.

The rise of API-powered FinTech

Historically, companies that wanted to build systems, applications, or services to interact with the stock market would have to build an entire brokerage operation from scratch. This would include data infrastructure, compliance infrastructure, and storage capabilities. It could take years and massive capital expense to accomplish everything that was required to be ready to serve customers.

Tradier provides this infrastructure as an API-based service so that the same companies can launch investor applications in as little as a few weeks. This democratized access means that FinTech innovation can come from anywhere, giving the same opportunities to create new products to everyone, from enterprise customers to startups.

“Financial markets are becoming fundamentally decentralized and unbundled,” says Dan Raju, co-founder, CEO, and chairman at Tradier. “The services that large legacy banks and brokerage firms used to offer are being supplanted by Tradier’s microservices and APIs, which power innovation.”

More than 200 companies use Tradier to develop and launch new products, or to add new features and functions that they traditionally would not have offered in existing products. With a large and diverse user base, Tradier faced the challenge of managing its partners in way that helps ensure it can grant credentials, track, monitor, and report in an efficient and equitable manner.

At the same time, the company recognized the inherent value of its partners for their power to leverage Tradier APIs to innovate. Tradier’s fundamental market disruption is the partner ecosystem, where the company is engaged along with its partners to deliver value to the entire ecosystem in the form of new products and services.

Embracing an API-powered ecosystem

Tradier has moved beyond providing great APIs toward engaging its ecosystem. If a customer wants a specific dataset, the company doesn’t automatically build a new product. Instead, Tradier looks to the ecosystem to build the product. With this approach, Tradier has taken its capabilities and multiplied them by hundreds.

“The fundamental difference between thinking about an API ecosystem versus an API product is the difference between being a participant who’s enabling innovation and not just a company delivering a set of technical capabilities,” Raju says.

Tradier takes an outside-in approach toward engaging its API ecosystem. Constantly listening to participants and helping to enable and empower them to create value is fundamental to the company’s business model. Rather than simply focusing on building new capabilities on its own, Tradier listens to what functionalities customers need and facilitates development. In many cases, the ecosystem generates the requested product organically rather than Tradier needing to do it.

“I love APIs because they allow you to empower others to create value. The concept of empowering others to create value along with you is what is the most satisfying, and the most fascinating, thing about APIs,” says Raju.

Delivering value at scale

Tradier handles between 500 million to 1 billion API calls and a billion dollars in transactions a month, and all of them run through the Apigee API management platform. Apigee’s last mile forms the single layer that manages Tradier’s infrastructure, including security, analytics, developer interactions, and execution. The company also uses Apigee to comply with an array of regulatory reporting, mandated by Tradier’s status as a FINRA (Financial Industry Regulatory Authority)-regulated entity.

“Apigee is integral to the Tradier offering. They have been great partners and have always collaborated and enabled us to innovate at a pace that helped Tradier attract developers and innovative companies. We see tremendous potential in the synergy of Apigee and Google as it brings to the market a vast extended capability set based on the Google Cloud Platform.”

Tradier is an API-centric ecosystem that delivers value to an entire set of players where the nucleus is the Apigee API management suite, which helps deliver, innovate, publish, manage, monitor, and secure the ecosystem on a day-to-day basis. Simplicity combined with product evangelism is the key to success in the API space, Raju says.

Tradier’s capabilities to innovate, iterate, and travel the journey with its customers, partners, and developers has yielded many rewards. The company’s long history of working with Apigee has enabled it to assemble a set of people and resources for creating engagement, as well as to create a winning set of APIs for delivering FinTech capabilities.

Considering the transformative future

Looking toward a future in which the financial services industry will experience ongoing disruption, Raju predicts that Tradier will continue to leverage APIs to lead the way.

“I think traditional banks are under attack. They are being replaced by a set of nimble, agile players that are offering a lot of new functionality to customers. This is forcing banks to think about how they can digitize their products through APIs so that they can provide the same functionalities as newer players.”

With companies like Tradier and others offering functionality that used to be in-house and exposing it outside, traditional brokerage firms are also being forced to rethink their model. Raju believes that this line of thinking also extends to the Blockchain.

“Exposing Blockchain-like capabilities through APIs is going to be a disruptive influence, and it will be critical for companies to think about how APIs, and more importantly Blockchain, can create value for us.”

Black Knight is a leading provider of technology, data, and analytics to the mortgage industry, catering to both large and mid-tier banks in the United States. Over the past few decades, we tended to manage customer integrations on a case-by-case basis. Whenever a bank needed to connect with a Black Knight app, we’d launch another integration project. Lather, rinse, repeat. Needless to say, this was inefficient; we knew we had to do something to centralize this process.

Building versus buying an API management platform
To start, we created some homegrown API solutions. Despite being largely successful with one of these solutions, we saw that technology advances were outpacing our capacity to update our solutions in-house. We knew we needed to move toward an API platform that would support RESTful architecture and that would fully enable mobile solutions. It also had to be extremely secure. Knowing how complicated such a platform would be to build ourselves, we decided that our developers were better off focusing on providing core solutions to Black Knight clients; engaging with an outside provider was the right way for us to advance our API strategy. 

After a lengthy proof-of-concept process, we went into production with the Apigee API Management Platform from Google Cloud in 2018. In our opinion, Apigee was the most complete, robust, technically sound and full-featured option from among all of the API management tools we evaluated. Its ease of use was the deciding factor for our developers, and the Apigee analytics capabilities provided considerable insight into the anatomy of an API call—something the other platforms we considered didn’t do as well. 

Choosing Apigee meant that we didn’t have to focus on developing and maintaining a tool or spend enormous amounts of money trying to keep up with security patching. For a large company like Black Knight, an API management tool is something we don’t want to spend a lot of time on. We know that Google Cloud devotes tremendous resources to it, and it would be difficult to replicate that in-house. 

Black Knight has more than 150 client-facing applications. Almost half of them now are built with APIs that are externally facing, and many of these apps use APIs that integrated with other Black Knight applications. Add to that the huge number of applications out there that come from clients and third-party vendors, and suddenly, we had a management challenge from an API perspective.

Driving cultural change
We came to Apigee with the goal of containing and empowering our huge ecosystem of APIs, customers, third parties, and internal users.  

Given Black Knight’s size, our developers and customers understandably each have different business goals, so getting everyone to come to a centralized platform is a great opportunity. My role is to help people consider other options so they can be open to the benefits that Apigee brings us.

Now that we’ve engaged with Apigee for over a year, we see two big benefits. First, the huge reduction in point-to-point integrations has produced tremendous efficiencies for us and our customers, who now get instant integration once they’ve been authorized for a particular API. Second, Apigee’s capacity for mobile enablement lets us satisfy our customers’ needs for secure mobile apps.  

Simplifying security
From a technical perspective, security is complicated for mobile apps. We’re often accessing sensitive information on a mobile device that can’t always be trusted. This kind of scenario requires us to implement a number of security precautions to help ensure confidential information remains protected.  

The Apigee API management platform addresses these needs in the simplest way possible. It solves complex problems related to security without having to deploy a new API proxy each time we need to support a particular mobile device upgrade. Our back-end applications remain protected because Apigee helps manage security, requests, access tokens, and authorizations. Today, our back-end applications work with Apigee to communicate with mobile devices or servers coming over the internet. 

Apigee has also enabled us to do a better job sharing a variety of APIs. The developer portal lets us stitch together APIs and get more creative about how we can innovate and build new solutions based on these collections of APIs. At this point, anybody that has a nondisclosure agreement with us can register for the developer portal. The nature of our business is such that we can’t just open up our APIs to anybody, but it’s available to our contracted third parties.

Our Apigee journey has been exciting, and we’re making great progress. I’m looking forward to what innovations we will come up with next, thanks to the way Apigee enables us to create, implement, and deliver.