More languages, image inputs, and extension support among Bard features at I/O ’23.
At Wednesday’s Google I/O conference, Google announced wide availability of its ChatGPT-like AI assistant, Bard, in over 180 countries with no waitlist. It also announced updates such as support for Japanese and Korean, visual responses to queries, integration with Google services, and add-ons that will extend Bard’s capabilities.
Similar to how OpenAI upgraded ChatGPT with GPT-4 after its launch, Bard is getting an upgrade under the hood. Google says that some of Bard’s recent enhancements are powered by Google’s new PaLM 2, a family of foundational large language models (LLMs) that have enabled “advanced math and reasoning skills” and better coding capabilities. Previously, Bard used Google’s LaMDA AI model.
Google plans to add Google Lens integration to Bard, which will allow users to include photos and images in their prompts. On the Bard demo page, Google shows an example of uploading a photo of dogs and asking Bard to “write a funny caption about these two.” Reportedly, Bard will analyze the photo, detect the dog breeds, and draft some amusing captions on demand.
Google thinks that software developers may appreciate several improvements in Bard, including an export button for code execution in either Colab or Replit. And from now on, when Bard provides code, it will include citations. “If Bard brings in a block of code or cites other content, just click the annotation and Bard will underline those parts of the response and link to the source,” writes Google.
Bard will also support a dark theme for the first time, a feature that elicited the biggest cheer from the Google employee audience at the I/O keynote.
Similar to ChatGPT plugins, announced in March, Google plans to add extensions to Bard that will allow the chatbot to access external resources. In the I/O presentation, Google showed an example of generating images of unicorns for a birthday party within Bard using an extension for Adobe Firefly, which is an AI image synthesis model similar to Stable Diffusion.