Google has a whole lot of AI news coming out of its developer-focused I/O conference. The company’s keynote showed off key products like its flagship Gemini AI model, which now has a faster Flash version to compete with the new and faster GPT iteration, GPT-4o that OpenAI announced a day earlier.
Google is also redesigning search with AI Overviews that promise to summarize the web in response to complex queries and a new Ask Photos assistant that can dig through your archive for the answer to a question like “what’s my license plate?” However, the flaws of AI search were unintentionally highlighted when its video search demo offered some terrible advice about how to fix a problem with your camera.
Android is adding a scam detection feature that can listen into calls to pick up on potential flimflammery, while Chrome will add Gemini Nano to power AI features that can be processed locally.
On day two of the event, Google also released more details about a new beta release of Android 15 and other new details of the next big update for its mobile OS.
When it comes to other kinds of hardware, Google TVs are becoming home hubs, and new Home APIs will give app developers access to all kinds of automations. Streaming apps like Max and Peacock are coming to Android Auto, and Wear OS 5 will extend battery life for smartwatches.
Read on for all the details as Google I/O 2024 continues.
Highlights
- Wear OS 5 triples down on battery life
- Android will be able to detect if your phone has been snatched
- ADT’s new security system has facial recognition powered by Google Nest
- Google opens up its smart home to everyone and will make Google TVs home hubs
- We have to stop ignoring AI’s hallucination problem
- Google now offers ‘web’ search — and an AI opt-out button
- Google’s new LearnLM AI model focuses on education
May 24
Here’s an early look at Gemini on Gmail’s mobile app.Last week, Google announced that it’s bringing Gemini to the Gmail mobile app, and now we have a glimpse at how it might work. Android Authority contributor AssembleDebug found references to the new Gemini button in the Gmail app on Android, and showed off how you can ask for help summarizing emails and writing responses.
May 21
Google’s new ‘Add to Chromebook’ badge makes web apps easier to find and install
Google is making a new “Add to Chromebook” badge that’s designed to make it easier for ChromeOS users to find and install progressive web apps (PWAs) and Android apps. The badge links directly to the web app you’re looking to install or to the Google Play Store (if it’s an Android app), 9to5Google reports.
Read Article >In a Google I/O session video about ChromeOS, the presenter says many people looking for apps start with a Google search and end up on developers’ websites — a great place to display an Add to Chromebook badge and get ChromeOS users to the app. There isn’t much of a barrier when it comes to finding and installing Android apps on a Chromebook, as most people go straight to the Play Store to install those.
May 20
Google CEO Sundar Pichai on AI-powered search and the future of the web
Today, I’m talking to Alphabet and Google CEO Sundar Pichai, who joined the show the day after the Google I/O developer conference last week. Google’s focus during the conference was AI, of course — Google is building AI into virtually all of its products. My personal favorite is the new AI search in Google Photos that lets you ask things like, “What’s my license plate number?” and get an answer back from your entire photo library. All in all, Google executives said “AI” more than 120 times during the keynote — we counted.
Read Article >But there was one particular announcement at I/O that’s sending shockwaves around the web: Google is rolling out what it calls AI Overviews in Search to everyone in the United States by this week and around the world to more than a billion users by the end of the year. That means when you search for something on Google, you’ll get AI-powered results at the top of the page for a number of queries. The company literally describes this as “letting Google do the Googling for you.” Google has been testing this for a year now, in what it called the Search Generative Experience, so you may have already seen a version of this — but now it’s here, and it will change the web as we know it.
May 17
Single-tap passkeys are coming to Android 15
AI was the main focus of the Google I/O keynote this year, but there are still a bunch of new feature updates hidden in the various developer sessions. Case in point, 9to5Google spotted that Android 15 and Wear OS 5 are going to get some convenient passkey updates.
Read Article >In its “Passkeys and identity best practices” dev session, Google announced that Android 15 is going to get a single-tap sign-in process. Instead of having two separate screens — one to select an account and another for a biometric prompt — Google will merge them into a single screen.
May 17
AI assistants are so back
AI. AI? AI! AI... A. I. This has been a week filled with AI announcements from some of the biggest and most important companies in tech, all of whom seem totally convinced that we’re due for a revolution in virtual assistants. If Silicon Valley gets its way, you might never have to write an email, a line of code, or a joke ever again. All you’ll do is ask your all-knowing, ultra-helpful, maybe slightly too flirty virtual assistant, and it’ll get everything done for you.
Read Article >On this episode of The Vergecast, we discuss all the AI assistant stuff OpenAI announced at its Spring Update event and the very similar stuff Google announced at its I/O developer conference the next day. Since the early days of Siri, Google Assistant, and Alexa, the tech industry has been moving toward the same goal. Are flirty AI assistants really the future of computing?
May 16
Google’s Gemini AI plan for schools promises extra data protection and privacy
Google will soon offer schools access to Gemini AI — specifically for educators and students over the age of 18 — and promises not to use their data for AI model training or share it with anyone.
Read Article >Google will include the extra Gemini data privacy protections on Workspace for Education accounts at no additional charge. However, it does mean relying on the older Gemini 1.0 Pro model instead of newer, more updated models like Gemini 1.5 Pro or Flash, which is designed to provide more accurate answers.
May 16
Google’s making it easier for people with low vision to find objects using their phone
Coinciding with Global Accessibility Awareness Day, Google is highlighting a number of new accessibility features across its software and enhancements to others that were already part of Android. First is a significant upgrade to Android’s Lookout tool, which helps people who are blind or have low vision find out more information about their surroundings. Google is leveraging AI and adding the ability for Lookout to search for specific objects, including seating, bathrooms, and more, making up seven total categories.
Read Article >“As you move your camera around the room, Lookout will notify you of the direction and distance to the item,” Eve Andersson, Google’s senior director of product inclusion, equity, and accessibility, wrote in the blog post.
May 15
Android 15’s second beta release lets users lock down access to private apps
Alongside Google’s ongoing developer-focused I/O conference comes the latest release of Android 15, which is now in its second beta. It’s got some cool new features, like the ability to now hide a collection of apps inside a “private space,” customizable vibrations so you can notice different types of notifications just by feeling, and also richer widget previews.
Read Article >The new private space function is the most interesting of the bunch: it can hide apps you don’t want others seeing into a biometric or PIN-protected container in the app drawer. It’s one of several new security features coming to Android.
May 15
Android 15 will hide one-time passwords in notifications.In response to malware and social engineering attacks that work by snooping notifications or activating screen sharing, Google says Android 15 will hide notifications with one-time passwords (with some exceptions, like wearable companion apps).
They’re also automatically hidden during screen sharing, and developers can enable their apps to check if Google Play Protect is active, or if another app might be capturing the screen during use.
May 15
Google’s new glasses are just a prototype for now.The blink-and-you-missed-it AR glasses at Google I/O? “The glasses shown are a functional research prototype from our AR team at Google. We do not have any launch plans to share,” Google spokesperson Jane Park tells The Verge.
However: “Looking further ahead, we anticipate that capabilities demonstrated with Project Astra could be utilized through wearables and other next-generation devices.”
May 15
Google adds Max, Peacock, and Angry Birds to cars with native Android software
Google is adding several new apps to its in-car infotainment platforms, while also making it easier for developers to get their apps approved faster and with fewer complications.
Read Article >Google said that two new streaming services, Max and Peacock, are coming to cars with Google built-in. These include models from companies like Renault, Polestar, and Volvo. (Other brands with Google built-in, like Ford, Acura, and Honda, do not support video streaming while parked yet.)
May 15
Car screens are getting bigger — and weirder — and Google wants to help
Google is lowering the barriers for new apps to be added to Android Auto and cars with Google software built-in, making it easier for developers of gaming and streaming apps to get them added to those platforms. It is also releasing new guidelines for developing apps for various screen sizes and shapes.
Read Article >Google is launching a new program for car-ready apps, essentially expediting the process for developers to get their apps approved for in-car platforms. As part of this program, Google says it will “proactively” review mobile apps that are already compatible with the increasingly large-sized screens found in more modern vehicles.
May 15
Wear OS 5 triples down on battery life
Wear OS 5 is on its way, and with it, Google says Android smartwatch users ought to see even better battery life. Running a marathon, for example, will purportedly consume 20 percent less battery than on Wear OS 4.
Read Article >This emphasis on battery life is similar to last year’s Wear OS 4 announcement — and for good reason. Wear OS 4 helped the Pixel Watch 2 last an entire day, something the original struggled to do. That improved battery life has seemingly bought some goodwill. Google says that, in the last year, the Wear OS user base grew by an impressive 40 percent across 160 countries and regions.
May 15
Android will be able to detect if your phone has been snatched
Google is announcing an array of new security features as it releases its second Android 15 beta, including a feature that can detect the moment your phone is swiped from your hands. Some of these updates will be included with Android 15 when it arrives this fall, but theft detection and a number of other features will be available to phones with much older OS versions, too — bringing them to many more people.
Read Article >Theft Detection Lock works by recognizing the unusual motions that would indicate someone has yanked your phone out of your hand or a table in front of you. To prevent a thief from being able to access information on your device, the screen automatically locks. The system looks for other signals that indicate foul play, too, and will be able to lock the screen for protection if someone tries to take it off the network to prevent remote access.
May 15
ADT’s new security system has facial recognition powered by Google Nest
ADT has confirmed to The Verge that it’s rolling out a big upgrade to its ADT Plus home security system. The all-new hardware and software platform for ADT Plus features new ADT hardware, deeper integration with Google Nest hardware, and the ability to automatically disarm using facial recognition to let trusted neighbors into your home when you’re away.
Read Article >I first reported on the new system last October, but until now, ADT had declined to comment despite publishing multiple support pages about it on its site. This week, ADT spokesperson Ben Tamblyn confirmed to The Verge the new ADT Plus system has started rolling out to some states and will be available nationwide in the coming months. The system can be self-installed or professionally installed and can work with ADT’s professional monitoring service.
May 15
Eve’s Android app is finally almost here, thanks to Google’s new Home APIs
After announcing that it would be bringing an app to Android way back in 2022, Eve is finally close to launching its Android app, possibly by this fall. Android users will be able to control Eve’s smart home products natively — including smart plugs, smart lights, and smart shades. They will be able to access features such as energy management that are not yet available in the Matter platforms they work with (including Google Home and Samsung SmartThings). Prior to Matter, Eve devices only worked with Apple HomeKit and were only controllable on iOS devices.
Read Article >“The highly anticipated app will allow Matter devices to be added, controlled and automated directly and without any proprietary connection mechanism or fragile cloud-to-cloud integrations,” the company said in a press release. “For the growing range of Matter-enabled Eve devices, Eve for Android will provide advanced functionality, such as measurement of energy consumption and generation for Eve Energy solutions, autonomous heating schedules for the smart thermostat Eve Thermo or Adaptive Shading for roller blinds in the Eve Blinds Collection.”
May 15
Intel’s Thunderbolt Share lets two PCs control each other over a USB cable
Why can’t you just plug a USB cable between two PCs, drag your mouse cursor between their screens, and drop files between them, as if they were a single machine? Well, you can and have for years — but Intel may be about to turbocharge that idea with Thunderbolt Share.
Read Article >It’s a proprietary app that Intel will be licensing to laptop, desktop, and accessory manufacturers to bundle with new hardware. Install it on two Thunderbolt 4 or 5 computers, connect them with a Thunderbolt cable, and you should be able to share your mouse, keyboard, screens, storage, and other USB peripherals; drag and drop files at Thunderbolt speeds; and sync data between them. It won’t let you share an internet connection, though.
May 15
Google opens up its smart home to everyone and will make Google TVs home hubs
Google has announced that it’s opening up API access to its Google Home smart home platform. This means that any app maker — smart home-related or not — can access the over 600 million devices connected to Google Home and tap into the Google Home automation engine to create smart solutions for their users inside their own app.
Read Article >The Home APIs can access any Matter device or Works with Google Home device and allows developers to build their own experiences using Google Home devices and automations into their apps on both iOS and Android. This is a significant move for Google in opening up its smart home platform, following shutting down its Works with Nest program back in 2019.
May 15
The best parts of Google’s I/O 2024 keynote in 17 minutes.We cut down the nearly two-hour presentation just for you, ICYMI. You can also read about everything that was announced if you prefer words. Happy Wednesday!
May 15
We have to stop ignoring AI’s hallucination problem
Google I/O introduced an AI assistant that can see and hear the world, while OpenAI put its version of a Her-like chatbot into an iPhone. Next week, Microsoft will be hosting Build, where it’s sure to have some version of Copilot or Cortana that understands pivot tables. Then, a few weeks after that, Apple will host its own developer conference, and if the buzz is anything to go by, it’ll be talking about artificial intelligence, too. (Unclear if Siri will be mentioned.)
Read Article >AI is here! It’s no longer conceptual. It’s taking jobs, making a few new ones, and helping millions of students avoid doing their homework. According to most of the major tech companies investing in AI, we appear to be at the start of experiencing one of those rare monumental shifts in technology. Think the Industrial Revolution or the creation of the internet or personal computer. All of Silicon Valley — of Big Tech — is focused on taking large language models and other forms of artificial intelligence and moving them from the laptops of researchers into the phones and computers of average people. Ideally, they will make a lot of money in the process.
May 15
Google now offers ‘web’ search — and an AI opt-out button
This is not a joke: Google will now let you perform a “web” search. It’s rolling out “web” searches now, and in my early tests on desktop, it’s looking like it could be an incredibly popular change to Google’s search engine.
Read Article >The optional setting filters out almost all the other blocks of content that Google crams into a search results page, leaving you with links and text — and Google confirms to The Verge that it will block the company’s new AI Overviews as well.
May 14
Android apps will soon let you use your face to control your cursor
Google has announced that the code for Project Gameface, its hands-free gaming “mouse” that you control by making faces, is now available open-source to Android developers on Tuesday.
Read Article >Developers can now integrate the accessibility feature into their apps, allowing users to control the cursor with facial gestures or by moving their heads. For example, they can open their mouth to move the cursor or raise their eyebrows to click and drag.
May 14
How to care for your AI.Google is distributing these little handbooks for prompting AI, which is kind of adorable? It has color-coded highlights breaking down the basic components of a prompt. There’s an early internet “How to use a search engine” vibe about it — I’m gonna hang on to this one for posterity.
May 14
Here’s Sergey Brin holding court with reporters at Google I/O.Sergey posted up outside the area where Google was giving demos of Project Astra multi-modal chats. He said he thinks Sundar is doing a good job making hard decisions as CEO, said he mostly uses AI for coding tasks, and politely declined to answer a question from Bloomberg’s Shirin Ghaffary about Larry Page accusing Elon Musk of being a “speciesist.”
May 14
Google’s new LearnLM AI model focuses on education
Google says its new AI model, LearnLM, will help students with their homework.
Read Article >LearnLM, a family of AI models based on Google’s other large language mode, Gemini, was built to be an expert in subjects, find and present examples in different ways like a photo or video, coach students while studying, and, in Google’s words, “inspire engagement.”