ShareChat Builds its Diverse, Hyperlocal Social Network. Thanks to Google Cloud
9256
Of your peers have already read this article.
3:00 Minutes
The most insightful time you'll spend today!
Editor’s note: Today’s guest post comes from Indian social media platform ShareChat. Here’s the story of how they improved performance, app development, and analytics for serving regional content to millions of users using Google Cloud.
How do you create a social network when your country has 22 major official languages and countless active regional dialects? At ShareChat, we serve more than 160 million monthly active users who share and view videos, images, GIFs, songs, and more in 15 different Indian languages. We also launched a short video platform in 2020, Moj, which already supports over 80 million monthly active users.
Connecting with people in the language they understand
As mobile data and smartphones have become more affordable in India, we noticed a large new segment of people, many in rural areas, being welcomed onto the internet. However, many of them didn’t speak English, and when it comes to accessing content and information—language plays a significant role. Instead of joining other social media sites where English reigned supreme, new internet users chose to join language or dialect-specific Whatsapp groups where they felt more comfortable instead.
So, we set out to build a platform where people can share their opinions, document their lives, and make new friends, all in their native language. ShareChat simplifies content and people discovery by using a personalized content newsfeed to deliver language-specific content to the right audience.
Given the high-intensity data and high volume of content and traffic, we rely heavily on IT infrastructure. On top of that, a large number of our users rely on 2G networks to post, like, view, or follow each other. Our platform needs to deliver great experiences to people who are spread out across the country and different networks without any reduction in performance.
The right cloud partner to support future growth
ShareChat was born in the cloud—we already knew how to scale systems to serve a large customer base with our existing cloud provider. But like many companies, we struggled with over-provisioning compute and storage to accommodate unpredictable traffic and avoid running out of storage. With demand rising for local language content and an increase in online interactions in response to the COVID-19 crisis, we realized that we would need a more efficient way to scale dynamically and allocate resources as needed.
Google Cloud was a natural choice for us. We wanted to partner with a technology-first company that would make it easy (and cost-effective) to manage a strong technology portfolio that would allow us to build whatever we wanted. Google is at the forefront of technology innovation and provided everything we needed to build, run, and manage our applications (including creating an efficient DevOps pipeline to fix and release new features quickly).
We had a few issues in mind at the start of discussions with the Google Cloud team, but over time, as we got information and support from them, we realized that these were the partners we wanted in our corner when it came time to tackle our most challenging problems. In the end, we decided to take our entire infrastructure to Google Cloud.
To support millions of users, we deploy and scale using Google Kubernetes Engine. While we analyze our data using a combination of managed data cloud services, such as Pub/Sub for data pipelines, BigQuery for analytics, Cloud Spanner for real-time app serving workloads, and Cloud Bigtable for less-indexed databases. We also rely on Cloud CDN to help us distribute high-quality and reliable content delivery at low latency to our users.
We now use just half the total core consumption of our legacy environment to run ShareChat’s existing workloads.
Google Cloud delivers better outcomes at every level
By moving to Google Cloud, we saw major benefits in several key areas:
Zero-downtime migration for users
At the time of migration, we had over 70 terabytes of data, consisting of 220 tables—some of which were up to 14 terabytes with nearly 50 billion rows. Due to our data’s interdependencies, moving services over one at a time wasn’t an option for us.
Even though we were migrating such large volumes of data, we didn’t want to impact any of our customers. Latency spikes for out-of-sync data might affect message delivery. For instance, if a message or notification was delayed, we didn’t want to risk a bad user experience causing someone to abandon ShareChat.
To prepare for the move, we ran a proof-of-concept cluster for over four months to test database performance in a real-world scenario for handling more than a million queries per second. Using an open-source API gateway, we replicated our legacy data environment into Google Cloud for performance testing and capacity analysis. As soon as we were confident Google Cloud could handle the same traffic as our previous cloud environment, we were ready to execute.
Using wrappers, we were able to migrate without having to change anything in our existing application code. The entire migration of 60 million users to Google Cloud took five hours—without any data loss or downtime. Today, ShareChat has grown to 160 million users, and Google Cloud continues to give us the support we need.
Scaling globally to meet unexpected demand
We rely on real-time data to drive everything on ShareChat by tracking everything that goes on in our app—from messages and new groups to content people like or who they follow. Our users create more than a million posts per day, so it’s critical that our systems can process massive amounts of data efficiently.
We chose to migrate to Spanner for its global consistency and secondary index. Unlike our legacy NoSQL database, we could scale without having to rethink existing tables or schema definitions and keep our data systems in sync across multiple locations. It’s also cost-effective for us—moving over 120 tables with 17 indexes into Cloud Spanner reduced our costs by 30%.
Spanner also replicates data seamlessly in multiple locations in real time, enabling us to retrieve documents if one region fails. For instance, when our traffic unexpectedly grew by 500% over just a few days, we were able to scale horizontally with zero lines of code change. We were also launching our Moj video app simultaneously, and we were able to move it to another region without a single issue.
Simplifying development and deployment
On average, we experience about 80,000 requests per second (RPS) –nearly 7 billion RPS per day. That means daily push notifications sent out to the entire user base about daily trending topics can often result in a spike of 130,000 RPS in just a few seconds.
Instead of over-provisioning, Google Kubernetes Engine (GKE) enables us to pre-scale for traffic spikes around scheduled events, such as holidays like Diwali, when millions of Indians send each other greetings.
Migrating to GKE has also enabled us to adopt more agile ways of work, such as automating deployment and saving time with writing scripts. Even though we were already using container-based solutions, they lacked transparency and coverage across the entire deployment funnel.
Kubernetes features, such as sidecar proxy, allows us to attach peripheral tasks like logging into the application without requiring us to make code changes. Kubernetes upgrades are managed by default, so we don’t have to worry about maintenance and stay focused on more valuable work. Clusters and nodes automatically upgrade to run the latest version, minimizing security risks and ensuring we always have access to the latest features.
Low latency and real-time ML predictions
Even though many of our users may be accessing ShareChat outside of metropolitan areas, it doesn’t mean they’re more patient if the app loads slowly or their messages are delayed. We strive to deliver a high-performance experience, regardless of where our users are.
We use Cloud CDN to cache data in five Google Cloud Point of Presence (PoP) locations at the edge in India, allowing us to bring content as close as possible to people and speeding up load time. Since moving to Cloud CDN, our cache hit ratio has improved from 90% to 98.5%—meaning our cache can handle 98.5% of content requests.
As we expand globally, we’d like to use machine learning to reach new people with content in different languages. We want to build new algorithms to process real-time datasets in regional languages and accurately predict what people want to see. Google Cloud gives us an infrastructure optimized to handle compute-intensive workloads that will be useful to us both now—and in the future.
The confidence to build the best platform
Our current system now performs better than before we migrated, but we are continuously building new features on top of it. Google’s data cloud has provided us with an elegant ecosystem of services that allows us to build whatever we want, more easily and faster than ever before.
Perhaps the biggest advantage of partnering with Google Cloud has been the connection we have with the engineers at Google. If we’re working to solve a specific problem statement and find a specific solution in a library or a piece of code, we have the ability to immediately connect with the team responsible for it.
As a result, we have experienced a massive boost in our confidence. We know that we can build a really good system because we not only have a good process in place to solve problems—we have the right support behind us.
3471
Of your peers have already watched this video.
3:30 Minutes
The most insightful time you'll spend today!
Rightmove’s Right Move to Google Cloud
In 2020, Rightmove, UK’s renowned property website app saw over a billion minutes from users and clocked about 100 busy days in 2021. To continue innovating their products and improve customer experiences while achieving sustainability goals, Rightmove chose Google Cloud to migrate their infrastructure!
The property search application platform already boasts of dedicated tech teams running heavily code-driven multi-data center infrastructure and high velocity CI/CD platform. To reduce time to product and time to market, Rightmove selects Google Cloud. Watch further to learn how Google Cloud Products helped them add new features, update their existing services and adhere to sustainability objectives.
Macy’s Uses Google Cloud to Streamline Retail Operations
3614
Of your peers have already read this article.
2:15 Minutes
The most insightful time you'll spend today!
As retailers strive to meet the growing expectations of shoppers, they are turning to Google Cloud to transform their businesses and tackle opportunities in an increasingly challenging industry. From optimizing inventory management to increasing collaboration between employees across locations and roles, to helping build omnichannel experiences for their customers, we are working together with retailers to help make the shopping experience as seamless and personalized as possible.
A standout Google Cloud customer is Macy’s, one of the world’s largest retailers. Founded in 1858, Macy’s operates approximately 680 Macy’s and Bloomingdale’s, and 190 specialty stores including Bloomingdale’s The Outlet, Bluemercury and Macy’s Backstage. And through macys.com, bloomingdales.com, and bluemercury.com, it also serves millions of customers across more than 100 countries.
By moving its infrastructure to the cloud, and taking advantage of Google Cloud data warehousing and analytics solutions, Macy’s is streamlining retail operational functions across its network.
With the opening of its new approximately 675,000 square-foot distribution center in Columbus, Ohio, Macy’s is leveraging the scalability of Google Cloud to ensure that merchandise is accurately and efficiently received, sorted, ticketed, picked, packed and shipped from the distribution center to the stores—even during peak retail seasons like back to school and the holidays.
“Powered by software developed at Macy’s technology, this new distribution center is a fantastic first step in our cloud journey. Working with Google Cloud allows us to be more nimble, efficient and flexible in how we utilize our warehouses,”
Naveen Krishna, CTO, Macy’s
Leveraging Google Cloud’s data management and analytics solutions, Macy’s new warehouse management system will initially service 200+ Macy’s Backstage off-price stores at launch. Macy’s will begin rolling out this software solution to additional distribution centers that service its nationwide fleet of Macy’s and Bloomingdale’s department stores, as well as Macys.com and Bloomingdales.com direct-to-customer orders.
Our continued work with Macy’s reflects their investment in technology to improve digital and mobile experiences, site stability, store technology, fulfillment, and logistics, and integrate its front line and back office to reinvent retail. I look forward to deepening our partnership with Naveen and his team to help them achieve these goals.
Attract Investor Funding by Harnessing the Power of Cloud Operations, Billing, and Customer Care
1390
Of your peers have already read this article.
4:30 Minutes
The most insightful time you'll spend today!
More and more startups are choosing to build their business on Google Cloud, and if yours is one of them — welcome! And even though Google Cloud is easy to use, there’s still a lot to learn, starting with how to create and activate your account, and how to create projects, folders, and organizations as part of Google Cloud’s resource hierarchy. If you prefer, you can also watch our video on how to get started with Google Cloud.
Once you’ve mastered those concepts, you’re ready to learn how to get the most out of your investment in Google Cloud. In this blog, we’ll show you how to manage and monitor your cloud resources with Google Cloud’s operations suite, administer your billing with Cloud Billing, and improve the support you receive with Google Cloud Customer Care. Whether you’re new to Google Cloud or an experienced user, these services will help improve your experience.
Let’s get started!
Improve the performance and reliability of your applications with the operations suite
Sometimes you want to check how your deployment is behaving, or if there is something happening with your server, database, or application that is affecting your customers. With so many tools to check, finding and solving the issue can become overwhelming very quickly. This is where Google Cloud’s operations suite comes in.
This suite of products for integrated monitoring, logging, and tracing managed services for applications and systems running on Google Cloud and beyond. It can help you visualize and monitor incidents with dashboards and Metrics Explorer, manage and analyze log data in real-time all in one place with Cloud Logging, visualize metrics at scale with Cloud Monitoring, manage latency with Cloud Trace, and perform performance and cost management with Cloud Profiler.
Learn more about the operations suite in the video below:
Manage budgets and alerts with Cloud Billing
Google Cloud billing management is easier than you might think. Google Cloud charges for compute resources monthly on a consumption basis, which is different from the traditional upfront purchase model. With the right tools and resources, you can more easily manage your costs and optimize your use of Google Cloud resources.
One of the most important things to do is to set up billing and alerts. This will help you avoid unexpected charges and ensure that you are only paying for the resources you use. You can also use budgets and alerts to track your costs and help ensure that you are staying within your budget.
You can also view your costs through console billing reports, monthly invoices or build customized dashboards on BigQuery, Google Data Studio, or a BI tool of your preference. This allows you to see where your costs come from and identify areas where you can save money. You can also use cost management to optimize your use of Google Cloud resources and get the most out of your investment.
Finally, Google Cloud offers a variety of discounts and optimization options. These can help you save money on your overall costs. For example, you can get a discount if you commit to using Google Cloud for a certain period of time. You can also save money by using preemptible VMs, which are VMs that are available at a lower price but can be terminated at any time.
Google Cloud Customer Care
To meet customer needs and deliver a better experience, we’ve reenvisioned our Customer Care portfolio, a scalable set of offerings built with your needs at the center, so you can simplify and streamline your support experience.
Choose from the core offerings:
- Basic – the support tier you receive when you sign up on Google Cloud. You can use this at no cost but support is offered for billing issues only.
- Standard – simple, flexible way to ensure that your workloads run smoothly on Google Cloud. Standard enables you to receive technical help from Google experts with a four hour response time and 8 hours response time during 5 days a week availability.
- Enhanced – rapid response times and additional services to boost your productivity and help you run in Google Cloud efficiently. There is both case and phone support for technical issues, with a one-hour response time. There is 24/5 availability overall with 24/7 for critical issues. You can also have add-ons or value-add services like Technical Account Adviser Service and Event management.
- Premium – the highest value support offering, supplying incredibly fast response times, a named Technical Account Manager, Customer Aware support and additional services. There is case and phone support for technical issues and also third-party technology support, with a 15-minute response time and a 24/5 availability overall with 24/7 for critical issues.
Watch the video to find out how to purchase support, create support cases and learn more about support.
Supercharge your growth with the Google for Startups Cloud Program
Growing a startup requires technology that can keep up with and enhance your ideas. The Google for Startups Cloud Program provides the tech you need to help develop better software and deliver innovative experiences with confidence. At the same time, you’ll help boost your team’s capabilities with expert cloud guidance, Google Cloud credits, training opportunities, and more.
The program has two tiers:
- Start: for pre-seed startups that have not yet received equity funding. Get up to $2,000 USD in Google Cloud credit that’s valid for two years toward Google Cloud services and even toward a Cloud Customer Care plan with unlimited access to technical support, networking opportunities with the global Google Cloud Startup Community, and more.
- Scale: for seed to series A startups with verified equity funding. Get Google Cloud and Firebase costs covered up to $100,000 USD a year for your first two years, unlimited access to technical support when credits are applied to a Cloud Customer Care plan, partnerships with Google Cloud Startup Customer Engineers and a dedicated Startup Success Manager, networking opportunities with the global Google Cloud Startup Community, co-marketing for select startups, and more.
Once enrolled, Google startup experts will recommend Google products and services that can help your startup grow in the cloud. Learn more about the Google for Startups program, eligibility criteria, credit usage and migration incentives in the our Startup Programs video linked down below.
That’s a wrap!
Let’s recap: The operations suite includes tools to monitor incidents, analyze log data in real-time, manage latency, and more. Cloud Billing offers billing management tools and resources to help you save costs and make the most of your resources. If you need help, Cloud Customer Care services are available to streamline your support experience. Also, if you’re a startup, don’t forget to check the Google for Startups Cloud Program!
The Google Cloud Technical Guides for Startups series has many detailed videos and handbooks to support you on all steps of your startup growth journey. Check out our full playlist on the Google Cloud Tech channel and website. Don’t forget to subscribe to stay up to date.
See you in the cloud!
Transformation Cloud: A New Wheel of Innovation and Digital Transformation
3368
Of your peers have already read this article.
1:30 Minutes
The most insightful time you'll spend today!
Looking back on the past year, I see challenges—but also reinvention. Reinvention in how children are educated. Reinvention in how medical professionals provide care. Reinvention in how customers purchase products. This reinvention was made possible by all of the IT leaders around the world who had a vision about what could be possible with technology.
Technology has allowed people to work and complete critical activities safely outside of their standard locations. But, it has also enabled transformation in ways we have not seen before: in how people collaborate, in how businesses operate, and most important to me, in how organizations innovate.
Rethinking what it means to transform
The leading indicator for organizations that are accelerating their innovation during this time is how they are thinking about transformation. Instead of asking infrastructure questions about where their apps and services should run, they are asking transformation questions about how to build an environment that enables every person, process, and technology to adapt in order to bring the highest level of innovation to the business.
Innovative companies have moved beyond migrating their data centers to the cloud, changing not only where their business is done but, more importantly, how it is done. For example, Papa John’s recently announced they are building a digital platform that looks at real-time data across the business to improve its loyalty programs, website, and customer and partner experiences. Albertsons Companies is transforming itself by reinventing grocery shopping, both the digital and physical aisle, through shoppable maps, AI-powered conversational commerce, and predictive grocery list building. Airbus is reimagining their work environment to embrace the hybrid work reality. And Siemens is partnering with Google Cloud to reinvent industrial manufacturing with AI to empower employees, automate mundane tasks, and improve product quality.
Here, transformation is made possible with technologies that enable new innovations for their customers versus decisions about where infrastructure should be run. And this aligns with a recent study by Forrester that states the top two IT initiatives for the next 12 months are to increase innovation and to invest in technology that helps employees do their jobs better.1
Some of the best conversations I’ve had with customers are focused on how to:
- Accelerate transformation while also maintaining the freedom to adapt to market needs.
- Make every employee—data scientists to sales associates—smarter with real-time data to make the best decisions.
- Bring people together and enable them to communicate, collaborate, and share with each other when they can not meet in person.
- Protect everything that matters to us—our people, our customers, our data, our customers’ data, and each transaction we undertake.
This new customer thinking is driving new technology requirements—requirements that can be solved through a transformation cloud. A transformation cloud accelerates an organization’s digital transformation through app and infrastructure modernization, data democratization, people connections, and trusted transactions. The result is an organization – and its workers – that can take advantage of all of the benefits of cloud computing to drive innovation.
The new requirements for innovation
Organizations want to work with multiple cloud providers to choose the best technology for each of their apps and services while also mitigating against inevitable cloud outages and vendor lock in. They value the flexibility of open source based solutions and look to our multicloud platforms like Google Kubernetes Engine and Anthos to instill freedom in how they innovate and drive differentiated customer experiences. It is no surprise that, in a recent Google-commissioned IDG research study, 78% of Global IT leaders stated that multi/hybrid cloud support is a major consideration when selecting a cloud provider and 74% preferred open source cloud solutions.2 Customers like MLB, DenizBank, and Macquarie Bank understand the necessity of a multicloud strategy and are taking advantage of Google Cloud’s open, hybrid architecture to give them the maximum flexibility to run their business how and where they want.
These organizations also want to use data to better understand their customers, enhance their products, and improve inventory accuracy in order to make real-time decisions—and bring it together into a cohesive data cloud. They value how analytics solutions democratize access to data for all employees and how embedded AI helps them predict and automate the future. The Forrester study mentioned above also shows that companies focused on improving their use of data for better decision-making, are taking actions to improve data self-service capabilities and make access to data and insights more democratic.3 Customers like Twitter, PayPal, The Home Depot, HSBC, and Stanford Medicine, unify their data across their organizations to power deeper AI-driven business insights, make better real-time decisions, and build and run their data-driven applications.
And while technology is driving many of the transformations we see, so are an organization’s people. Workers are finding new ways to strengthen human connections, deepen their impact, and serve customers while transforming how work happens—as shown in the fact that 59% of organizations in the IDG study accelerated or newly introduced remote working and collaboration capabilities in 2020.4 Customers like Kia Motors, Cambridge Health Alliance, and PwC are using Google Workspace to enable teams of all sizes to connect, create, collaborate, and to drive innovation from any device, and any location.
Finally, the innovation that we see in every digital transaction is matched with new ways to protect and secure the business. Organizations want to protect their employees, customers, and partners against emerging threats, analyze massive amounts of data to secure infrastructure, and build a long term strategy for strategic governance of their assets regardless of their location. Getting this right is essential as organizations see security as a top pain point impeding innovation.5 Customers like Equifax and Evernote are using Google Cloud’s secure platform and security products to extend customer confidence anywhere their systems may operate.
Google Cloud technologies are already powering customers’ transformation clouds
Supporting our customers’ reinventions are our top priority and we believe that together, we can pave the way for what is next. With our investments in multicloud and AI/ML, to sustainable infrastructure, industry solutions, and technology that improves our communities, such as COVID-19 vaccine distribution, we are proud that our customers trust Google Cloud solutions to digitally transform their business.
We have lots more to tell you about in the coming months, starting with our Data Cloud Summit on May 26th. Between this event, and the multiple other events we have this summer, you will learn about how our industry leadership and collaboration with our partners are enabling our customers to build powerful transformation clouds to support their continued reinvention.
1. Forrester Analytics Business Technographics® Priorities And Journey Survey, 2021
2. IDG Communications, Inc: “No Turning Back: How the Pandemic Has Reshaped Digital Business Agendas”, 2021
3. Of the companies that prioritize data in decision making, 37% are improving data self-service capabilities and 30% are making access to data and insights more democratic (Forrester Analytics Business Technographics® Priorities And Journey Survey, 2021)
4. IDG Communications, Inc, “No Turning Back: How the Pandemic Has Reshaped Digital Business Agendas”, 2021
5. 33% of organizations stated Security risks & concerns as a top pain point impeding innovation (IDG Communications, Inc, “No Turning Back: How the Pandemic Has Reshaped Digital Business Agendas”, 2021)
3543
Of your peers have already watched this video.
1:30 Minutes
The most insightful time you'll spend today!
See How Rémy Cointreau Drives Customer Centricity with SAP on Google Cloud
Rémy Cointreau is a French, family-owned business group whose origins date back to 1724. Rémy Cointreau is working to be a more customer centric organization. In order to fulfill this goal and to modernize, they determined they needed to get away from infrastructure management and decided to move their SAP landscape to Google Cloud.
Additionally Rémy Cointreau wanted to become more data centric. Learn how operations that used to take five weeks now take five minutes. Learn how Rémy Cointreau is leveraging live data analysis and is preparing for the future with SAP on Google Cloud.
More Relevant Stories for Your Company
Building a Large-Scale Migration Program with Google Cloud
Many organizations are looking to the public cloud to solve on-premises infrastructure challenges. These range from capacity constraints, aging hardware, or reliability issues; or alternatively, organizations may be looking to capitalize on the value that cloud infrastructure can bring - saving money through automatic scaling, or deriving business value from
Google Cloud’s Data Analytics May Recap
May was a very busy month for data analytics product innovation. If you didn’t have the chance to attend our inaugural Data Cloud Summit, video replays of all our sessions are now available so feel free to watch them at your own pace. In this blog, I’d like to share some background behind
A CIO’s Guide to Application Migration
A well-executed digital transformation should do much more than keep you competitive… it should also position you to excel by untethering IT staff from low value, labor-intensive tasks, allowing them to focus on innovation and high-impact projects. Also, replacing (or supplementing) legacy systems with modern technologies can reduce complexity and
Digital Maturity in Higher Ed Tied to Improvements in Students’ Journey: Study
Why Higher Ed Needs to Go All-in on Digital In the wake of the COVID-19 pandemic, the majority of students within the 18-24-year-old demographic now expect hybrid learning environments--even once we are beyond the pandemic. And a vast number of adult learners are seeking options that accommodate their work and
