How Nest cameras detect sound and motion

Your camera runs algorithms to process video and audio data so it can determine whether it detected something you might want to know about.

• The camera is designed to analyze its video data for people, animals, and moving vehicles, and can recognize when the same people reappear.
• To detect anything besides a person, animal, or moving vehicle, the camera checks for general motion in the scene. It learns what's normally in its background view and looks for movement and changes. As a result, it can sometimes trigger not just for important things, but also for minor things like tree branches that sway in the wind. If you only need your camera to detect people, animals, or moving vehicles, it's recommended that you do not turn on this feature.

You can find a list of all available alerts for your device in the What you get with a Nest Aware subscription article.

To change detection settings:

With the Home app

1. Open the Google Home app .
2. Tap Favorites or Devices ..
3. Tap and hold your device's tile  More   Settings .
4. Tap Event.

With the Nest app

Note: You can only turn off notifications for specific camera events.

1. Open the Nest app.
2. Select your camera or doorbell.
3. Tap Settings Notifications.

Activity Zones can help determine when your camera records something. If you set up Activity zones, your camera only records in the zones that you've enabled. This allows you to ignore busy or unimportant areas of your scene.

If your camera detects that even a small part of a notable object is in an Activity zone, your camera will record it.

You can find a list of all available alerts for your device in the What you get with a Nest Aware subscription article.

If you have a Nest Aware subscription, you may be able to turn on familiar face detection. When it's turned on, your camera builds a library of faces and compares each new face with the faces in that library. Some familiar face data is handled only on your camera, and some is managed through the Nest Aware service.

You can find a list of all available alerts for your device in the What you get with a Nest Aware subscription article.

Data handled only on the camera: When your camera detects a face, it creates a "faceprint" (biometric signature) to compare with other faces in the library. The biometric signature stays on the camera and never goes to the Nest Aware service. All matching and identification of faces happens on the camera itself.

Data handled through Nest Aware: Nest Aware manages the library which contains the face images and categorizes them. It does not contain biometric signatures and face models or perform matching and identification.

Sound detection recognizes certain important categories of sounds, like a dog bark or a smoke or carbon monoxide alarm. It can distinguish between these sounds and other loud sounds you might hear.

You can find a list of all available alerts for your device in the What you get with a Nest Aware subscription article.

Note: Sound detection is only available on Nest Cam (wired), Nest Cam (battery) with wired setup, and Nest Cam Indoor 2nd gen.

Your data will be handled as described in the Google Privacy Policy, and as explained in more detail in this Privacy FAQs Help Center page.

You can also read Google's commitment to privacy in the home.

Before your camera can detect activity, it first needs to figure out what everything in the scene looks like when there's no activity. That way, it can tell when something in the scene changes, like when someone walks into its view.

It can also pick up unexpected noises like when your dog barks. The software tries to ignore background noise like the steady hum of a fan so that your camera only sends alerts when something notable happens.

With a Nest Aware subscription, your Nest camera's sound and motion detection receives the following improvements:

• More accurate alerts about motion and sound
• Fewer false alerts from things like light, shadows and branches
• Activity Zones to get notifications about motion in certain areas, like a pathway or door
• Smoke and carbon monoxide alarm sound detection (Nest Cam Indoor and Nest Cam IQ Indoor in US only)

The advanced sound and motion detection that comes with a Nest Aware subscription requires a lot of computing power. When your camera's video streams to Nest's cloud servers, our software can look for different kinds of activity. The cloud servers let us easily update and refine Nest Aware activity detection over time, while your data is kept private and secure.

For more information about how we keep your data private and secure, refer to the following:

• If you use your Nest devices and services with a Google Account, then your data is handled as described in the Google Privacy Policy, and as explained in more detail in this Privacy FAQs Help Center page.
• You can also check Google's commitment to privacy in the home.
• If you use your Nest devices and services with a Nest Account, then your data is handled as described in the Nest Privacy page and Nest Privacy Statement.

Motion detection improvements

Nest Aware algorithms use motion pattern, shape, and texture recognition of what moves so that your camera can do the following:

• Notice small things and things that are far away, like when a kitten runs across the other side of a large room.
• Detect fast things, like when someone runs past a doorway or window.
• Reduce false alerts. For example, you probably won't get a notification if your camera detects tree branches that sway in the wind.
• Look for certain kinds of activity and send an alert. For example, when your camera detects someone who walks into its view, it can send a person alert. Some Nest cameras can even detect familiar faces.

Sound detection improvements

• Nest Aware algorithms measure ambient audio levels and filter out any regular noise in the area (like a running air conditioner). That way, sound detection can notice fluctuations in noise and determine if an important audio event has occurred, like a boom or the crash of a window breaking.
• Nest cameras can pick out specific types of sounds and alert you when a sound occurs. For example, you can set up notifications for your camera to send an alert when a dog barks or a person speaks, but not to bother you when it senses other noises.
• Sound detection is also upgraded to be more sensitive, so normal conversation is picked up as an activity event.