VOOZH about

URL: https://thenewstack.io/googles-generative-ai-stack-an-in-depth-analysis/

⇱ Google’s Generative AI Stack: An In-Depth Analysis - The New Stack


TNS
SUBSCRIBE
Join our community of software engineering leaders and aspirational developers. Always stay in-the-know by getting the most important news and exclusive content delivered fresh to your inbox to learn more about at-scale software development.
REQUIRED
It seems that you've previously unsubscribed from our newsletter in the past. Click the button below to open the re-subscribe form in a new tab. When you're done, simply close that tab and continue with this form to complete your subscription.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.
Welcome and thank you for joining The New Stack community!
Please answer a few simple questions to help us deliver the news and resources you are interested in.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Great to meet you!
Tell us a bit about your job so we can cover the topics you find most relevant.
REQUIRED
REQUIRED
REQUIRED
REQUIRED
REQUIRED
Welcome!

We’re so glad you’re here. You can expect all the best TNS content to arrive Monday through Friday to keep you on top of the news and at the top of your game.

What’s next?

Check your inbox for a confirmation email where you can adjust your preferences and even join additional groups.

Follow TNS on your favorite social media networks.

Become a TNS follower on LinkedIn.

Check out the latest featured and trending stories while you wait for your first TNS newsletter.

PREV
1 of 2
NEXT
VOXPOP
As a JavaScript developer, what non-React tools do you use most often?
Angular
0%
Astro
0%
Svelte
0%
Vue.js
0%
Other
0%
I only use React
0%
I don't use JavaScript
0%
Thanks for your opinion! Subscribe below to get the final results, published exclusively in our TNS Update newsletter:
NEW! Try Stackie AI
From clobbered drafts to real-time sync
Apr 14th 2026 10:00am, by David Moore
TypeScript 6.0 RC arrives as a bridge to a faster future
Mar 14th 2026 9:00am, by Darryl K. Taft
Mastra empowers web devs to build AI agents in TypeScript
Jan 28th 2026 11:00am, by Loraine Lawson
2023-05-31 07:59:33
Google’s Generative AI Stack: An In-Depth Analysis
AI

Google’s Generative AI Stack: An In-Depth Analysis

At the recently concluded Google I/O 2023 conference, the search giant unveiled its generative AI strategy. From Bard to Project Tailwind, generative AI dominated the conference. Here's a closer look at Google’s strategy.
May 31st, 2023 7:59am by Janakiram MSV
👁 Featued image for: Google’s Generative AI Stack: An In-Depth Analysis

At the recently concluded Google I/O 2023 conference, the search giant unveiled its generative AI strategy. From Bard to Project Tailwind, generative AI dominated the conference. Google’s long-term investment in AI-related research led to the creation of powerful foundation models, which have become the core of the new product and services.

This article takes a closer look at Google’s generative AI strategy.

Foundation Models – The Secret Sauce

Based on self-supervised learning techniques, foundation models are trained on large, publicly available data. These foundation models can be adapted to various use cases and scenarios without the need to retrain.

Four foundation models power Google’s generative AI stack:

PaLM 2: This is a large language model (LLM) trained on 100+ languages that can perform text processing, sentiment analysis, classification, and more. According to Google, the model can understand, generate, and translate nuanced text across various languages, including idioms, poems, and riddles. It can demonstrate logic and reasoning and even solve complex mathematical equations.

Codey: A foundation model that can be embedded in a standard development kit (SDK) or application to enhance developer productivity. It improves the efficiency of developers through code generation and code completion. Codey has been optimized and fine-tuned based on high-quality and permissively licensed code from external sources to enhance its performance.

👁 Image

Thomas Kurian, Google Cloud CEO, announced Codey.

Imagen: This text-to-image foundation model lets organizations generate and customize studio-grade images. Developers can use this model to create or edit images.

👁 Image

An image generated through Imagen.

Chirp: A foundation model trained to perform speech-to-text conversion. It can be used with various languages to generate captions and build voice assistance capability.

Bard – The ChatGPT Competitor from Google

Google Bard is a chatbot based on the PaLM 2 LLM. The current version of Bard is available in English, Japanese, and Korean, which can be accessed through the Google Bard website or through Google Assistant.

Bard, the new Chatbot from Google powered by PaLM 2

Soon, Bard’s response will include images along with text, making the interaction more useful and richer to the users. It will also become possible to use images as input prompts to make Bard write captions or perform image search.

Bard can also respond to code-related queries. It lets developers export the response to Google Colab or Replit code environments. Apart from code generation and explanations, Bard will also include citations with a link to the original source.

Duet AI – The AI-Powered Sidekick for Developers and Consumers

The foundation models are fine-tuned to assist developers and consumers in their day-to-day tasks. Duet AI is the brand that Google uses to identify the generative AI experiences infused into various products.

Duet AI for DevOps

When it comes to developers and operators, Google announced Duet AI-based services that are embedded into development environments and its cloud services.

Code Assistance: Google is going to ship plug-ins for popular IDEs such as VS Code and JetBrains. This helps developers generate code automatically based on comments and other forms of instructions. This capability competes with GitHub Copliot and other code completion products such as Amazon Code Whisperer and Tabnine.

Cloud Workstations: Cloud Workstations are pre-configured development environments in the cloud that come with runtimes, frameworks, and IDEs approved by enterprises. Duet AI enables Cloud Workstations with code/boilerplate generation, code completion, and code explanation. It can even scan source code for security vulnerabilities and suggest appropriate fixes.

Cloud Console: Google is going to embed a chat window within the Google Cloud Console user interface through which operators can interact with the chatbot. Like Bard and ChatGPT, this chatbot can assist operators with steps needed to perform a specific task or a function related to managing the cloud.

Cloud Shell: Like the chatbot for Cloud Console, the Cloud Shell, which is a terminal window embedded within the browser, will have a chatbot. It can generate commands and scripts to automate a variety of DevOps and CloudOps-related tasks.

Duet AI for End Users

It’s a no-brainer that Google would extend the power of AI to its consumer products, such as Google Workspace. Soon, Docs, Sheets, Slides, and Meet will get a chatbot to assist users in generating, transcribing, and summarizing content. This integration between the foundation models and Google Workspace makes the end-users creative and productive.

Google also demonstrated Project Tailwind, an AI-first notebook based on the personal content stored in Google Drive, Workspace, and other assets. Currently, this experimental service is available only in the USA.

Duet AI for Low Code and No Code

AppSheet, Google’s low-code/no-code platform, is going to be integrated with Duet AI. With this, users can create intelligent business applications, connect their data, and build workflows into Google Workspace via natural language powered by PaLM 2.

Google also announced MakerSuite, a tool that lets developers start prototyping quickly and easily. They will be able to iterate on prompts, augment datasets with synthetic data, and easily tune custom models. When they are ready to move to code, MakerSuite will let them export the prompt as code to languages and frameworks, such as Python and Node.js.

Search Generative Experience (SGE)

Google Search is going to be fundamentally changed through the infusion of generative AI. Search will become contextual and efficient by analyzing the semantic meaning of the query. Google is combining Shopping Graph with generative AI, which has over 35 billion product listings, to deliver an immersive experience to users.

The combination of traditional search and generative AI will transform how users experience the web.

Vertex AI and PaLM 2 API

Google is going to expose PaLM 2 LLM through a dedicated API endpoint. This is not available yet, but when it is ready, frontend and mobile developers can easily consume the API to build generative AI-based apps.

Vertex AI, Google’s ML PaaS in the Cloud, is ready for generative AI. It has an updated Model Garden, which is a repository of foundation models such as PaLM 2, Imagen, and Chirp. Google is also bringing third-party foundation models, such as stable diffusion, to its cloud platform.

👁 Image

Vertex AI – Model Garden

Generative AI Studio within Vertex AI acts as a playground to explore the API by tweaking various parameters and prompts. Developers can start with the Generative AI Studio before invoking the API or using the SDK.

👁 Image

Vertex AI – Generative AI Studio

Finally, Gen App Builder is a new service that lets traditional developers unfamiliar with ML or AI build generative AI applications. Developers can use a combination of text and images to create applications that can search for information in documents, photos, and video content. This service enables them to build engaging customer interactions.

When we analyze  Google’s generative AI strategy, it becomes clear that PaLM 2 is the foundation powering almost every service it announced.

👁 Image

PaLM 2 is helping Google compete with OpenAI and Microsoft. It’s doing what GPT did to OpenAI and Microsoft.

TRENDING STORIES
Janakiram MSV (Jani) is a practicing architect, research analyst, and advisor to Silicon Valley startups. He focuses on the convergence of modern infrastructure powered by cloud-native technology and machine intelligence driven by generative AI. Before becoming an entrepreneur, he spent...
Read more from Janakiram MSV
SHARE THIS STORY
TRENDING STORIES
TNS owner Insight Partners is an investor in: OpenAI.
SHARE THIS STORY
TRENDING STORIES
TNS DAILY NEWSLETTER Receive a free roundup of the most recent TNS articles in your inbox each day.
The New Stack does not sell your information or share it with unaffiliated third parties. By continuing, you agree to our Terms of Use and Privacy Policy.