# Google Nest SDM **URL:** \ **Category:** Apps\ **Tags:** tools\ **Created:** [February 16, 2021, 10:48am UTC](https://community.homey.app/t/google-nest-sdm/43087 "2021-02-16T10:48:22Z")\ **Posts on this page:** 20\ **Page:** 13
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [March 30, 2021, 4:27pm UTC](https://community.homey.app/t/google-nest-sdm/43087/253 "2021-03-30T16:27:46Z")
2.3.1 should fix it… ---
**Author:** ![Pieter\_Pessers](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/pieter_pessers/32/8848_2.png) [@Pieter\_Pessers](https://community.homey.app/u/Pieter_Pessers)\ **Post date:** [March 30, 2021, 5:36pm UTC](https://community.homey.app/t/google-nest-sdm/43087/254 "2021-03-30T17:36:34Z")
I found it out. Thanks, Martin. ---
**Author:** ![Elco\_Messelink](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/elco_messelink/32/17793_2.png) [@Elco\_Messelink](https://community.homey.app/u/Elco_Messelink)\ **Post date:** [March 30, 2021, 6:04pm UTC](https://community.homey.app/t/google-nest-sdm/43087/255 "2021-03-30T18:04:38Z")
Thanks Martin ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 2, 2021, 8:53am UTC](https://community.homey.app/t/google-nest-sdm/43087/256 "2021-04-02T08:53:30Z")
Did you had a chance to check 2.3.1 if this fixed the issue? ---
**Author:** ![Elco\_Messelink](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/elco_messelink/32/17793_2.png) [@Elco\_Messelink](https://community.homey.app/u/Elco_Messelink)\ **Post date:** [April 2, 2021, 12:30pm UTC](https://community.homey.app/t/google-nest-sdm/43087/257 "2021-04-02T12:30:09Z")
Yes is perfect! ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 2, 2021, 2:12pm UTC](https://community.homey.app/t/google-nest-sdm/43087/258 "2021-04-02T14:12:56Z")
Hi Michel, these action cards were added in 2.3.1. Does it do the job with ignoring the cat… ---
**Author:** ![MichelS](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/michels/32/2162_2.png) [@MichelS](https://community.homey.app/u/MichelS)\ **Post date:** [April 2, 2021, 8:52pm UTC](https://community.homey.app/t/google-nest-sdm/43087/259 "2021-04-02T20:52:44Z")
Cool 🤩. Going to test it this weekend and will post the results here 👍 ---
**Author:** ![mbnn](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/mbnn/32/36655_2.png) [@mbnn](https://community.homey.app/u/mbnn)\ **Post date:** [April 5, 2021, 11:23am UTC](https://community.homey.app/t/google-nest-sdm/43087/260 "2021-04-05T11:23:49Z")
Keep up the great work Martin! Hoop dat Protect ondersteuning nog erin komt: [GitHub - chrisjshull/homebridge-nest: Nest plugin for HomeBridge](https://github.com/chrisjshull/homebridge-nest) daar werkt ie ook prima overigens. En hopelijk kan die dan over niet al te lange tijd de normale store in 😀 ---
**Author:** ![DeVisdude](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/devisdude/32/12410_2.png) [@DeVisdude](https://community.homey.app/u/DeVisdude)\ **Post date:** [April 9, 2021, 11:25am UTC](https://community.homey.app/t/google-nest-sdm/43087/261 "2021-04-09T11:25:35Z")
Hi Martin, can you add the following flow chart: THEN increase thermostat temperature with X degrees? ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 9, 2021, 11:47am UTC](https://community.homey.app/t/google-nest-sdm/43087/262 "2021-04-09T11:47:43Z")
Hi Dude, will check it out. Thanks for the suggestion. ---
**Author:** ![RaoulvM](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/raoulvm/32/41820_2.png) [@RaoulvM](https://community.homey.app/u/RaoulvM)\ **Post date:** [April 9, 2021, 3:17pm UTC](https://community.homey.app/t/google-nest-sdm/43087/263 "2021-04-09T15:17:05Z")
@Martin_Verbeek, Hallo Martin, For the 2nd time in a few months, my homey stopped receiving data input from the Nest Hello. I’ve tried restarting the app, homey and “maintenance” option. Nothing seems to fix the problem. Last time I was forced to remove your app and reinstall it to get things back to work. Is there an app easier work-around known? Thanks in advance. Raoul ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 9, 2021, 5:18pm UTC](https://community.homey.app/t/google-nest-sdm/43087/264 "2021-04-09T17:18:14Z")
Seems to be another issue. I have the same with my hello, thought I was the only one. But have another one reporting the same not related to this app. Looks like a google platform issue. ---
**Author:** ![Patrick\_Pennarts](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/patrick_pennarts/32/39144_2.png) [@Patrick\_Pennarts](https://community.homey.app/u/Patrick_Pennarts)\ **Post date:** [April 10, 2021, 8:08pm UTC](https://community.homey.app/t/google-nest-sdm/43087/265 "2021-04-10T20:08:58Z")
Same problem here! Nest Hello stopped reporting input 4 days ago. Tried to remove device / reboot Homey. Device can still be added back but no data incoming ---
**Author:** ![Marcel\_Ubels](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/marcel_ubels/32/18860_2.png) [@Marcel\_Ubels](https://community.homey.app/u/Marcel_Ubels)\ **Post date:** [April 10, 2021, 8:41pm UTC](https://community.homey.app/t/google-nest-sdm/43087/266 "2021-04-10T20:41:39Z")
I am on Homey 5.02 and Nest SDK 2.2.2 Everything still works(Nest Hello and thermostat), no problems. ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 13, 2021, 6:00am UTC](https://community.homey.app/t/google-nest-sdm/43087/267 "2021-04-13T06:00:54Z")
My Nest Hello came back today… ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 13, 2021, 9:36am UTC](https://community.homey.app/t/google-nest-sdm/43087/268 "2021-04-13T09:36:30Z")
Update 3.0.0. will be released shortly. (i will be waiting until homey 6.0.0.rc release gives less trouble) **Thermostat** : added action card to set temperature relative to current (-5 - +5 range) **New for camera type devices** : Have some fun with ML/AI (Google vision) for camera type devices. When the API is activated, by doing a Logout/Login in the app, you can play around with it. The app will send images from events to the vision ML service to detect objects, face expressions and logos in the provided picture. **Trigger cards: (all with a confidence level of \>70%)** Detection of a face expression (joy/sad/angry/wearing something/surprise) Detection of a logo (tags with name of company, and where on the picture) Detection that something happened to an object on the picture (object disappeared/reappeared, new object appeared/disappeared again) tags with name and where on the picture. **Action card:** Control Image Analytics. (On / Off / Reset). You should use On/Off at when there is insufficient light to get confident results. Reset can be used to set the initial situation for a device where objects that should be present normally are on the picture. The reset will be triggered when the next SOUND occurs for the device. **Where** Picture is divided in 9 areas, app computes the center of the object found and returns Top/Center/Bottom, Left/Center/Right combination in the tag **Object Location** ---
**Author:** ![Patrick\_Pennarts](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/patrick_pennarts/32/39144_2.png) [@Patrick\_Pennarts](https://community.homey.app/u/Patrick_Pennarts)\ **Post date:** [April 13, 2021, 1:03pm UTC](https://community.homey.app/t/google-nest-sdm/43087/269 "2021-04-13T13:03:39Z")
Same here! ---
**Author:** ![wesley\_w](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/wesley_w/32/10127_2.png) [@wesley\_w](https://community.homey.app/u/wesley_w)\ **Post date:** [April 13, 2021, 1:24pm UTC](https://community.homey.app/t/google-nest-sdm/43087/270 "2021-04-13T13:24:02Z")
> [@Martin\_Verbeek](#): > > ML/AI (Google vision) Could you tell more about the ML/AI (Google vision) ---
**Author:** ![Martin\_Verbeek](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/martin_verbeek/32/10641_2.png) [@Martin\_Verbeek](https://community.homey.app/u/Martin_Verbeek)\ **Post date:** [April 13, 2021, 1:48pm UTC](https://community.homey.app/t/google-nest-sdm/43087/271 "2021-04-13T13:48:23Z")
See below a description of localizedObjects (one of the 3 ways the app is using Vision). Would love to do the annotations you see in the picture, but the image functions needed for that are too large to keep the app within reasonable size. I am still looking for a simple image manipulation library that fits the bill. You will get the annotation names and location back in the trigger that responds to object moves etc. When you start with the function, or when you executed a reset action card, it will have an inventory of objects per device. This inventory is a sort of “expected” state. So when the bicycle disappears you can react to it by using a trigger, same when it reappears. Or when a new object enters the scene, and disappears again. The bounds are being used in the app to tell you where the object is found in the image. If you have more than 1 bicycle you would see bicylce#2 as the name that is shown. **Google website text** The Vision API can detect and extract multiple objects in an image with **Object Localization**. Object localization identifies multiple objects in an image and provides a [LocalizedObjectAnnotation](https://cloud.google.com/vision/docs/reference/rest/v1p3beta1/images/annotate#LocalizedObjectAnnotation) for each object in the image. Each `LocalizedObjectAnnotation` identifies information about the object, the position of the object, and rectangular bounds for the region of the image that contains the object. Object localization identifies both significant and less-prominent objects in an image. Object information is returned in English only. The [Cloud Translation](https://cloud.google.com/translate) can translate English labels into any of a number of [other languages](https://cloud.google.com/translate/docs/languages). ![image with bounding boxes](https://us1.discourse-cdn.com/flex025/uploads/athom/original/3X/7/6/76e0b47b895d2ca9e6ecae5623b9e0df6de43fd8.jpeg) _Image credit:_ [Bogdan Dada](https://unsplash.com/photos/J9cBJjlpYKU) on [Unsplash](https://unsplash.com/) ( _annotations added_ ). For example, the API might return the following information and bounding location data for the objects in the image above: | Name | mid | Score | Bounds | | --- | --- | --- | --- | | Bicycle wheel | /m/01bqk0 | 0.89648587 | (0.32076266, 0.78941387), (0.43812272, 0.78941387), (0.43812272, 0.97331065), (0.32076266, 0.97331065) | | Bicycle | /m/0199g | 0.886761 | (0.312, 0.6616471), (0.638353, 0.6616471), (0.638353, 0.9705882), (0.312, 0.9705882) | | Bicycle wheel | /m/01bqk0 | 0.6345275 | (0.5125398, 0.760708), (0.6256646, 0.760708), (0.6256646, 0.94601655), (0.5125398, 0.94601655) | | Picture frame | /m/06z37\_ | 0.6207608 | (0.79177403, 0.16160682), (0.97047985, 0.16160682), (0.97047985, 0.31348917), (0.79177403, 0.31348917) | | Tire | /m/0h9mv | 0.55886006 | (0.32076266, 0.78941387), (0.43812272, 0.78941387), (0.43812272, 0.97331065), (0.32076266, 0.97331065) | | Door | /m/02dgv | 0.5160098 | (0.77569866, 0.37104446), (0.9412425, 0.37104446), (0.9412425, 0.81507325), (0.77569866, 0.81507325) | ---
**Author:** ![wesley\_w](https://sea1.discourse-cdn.com/flex025/user_avatar/community.homey.app/wesley_w/32/10127_2.png) [@wesley\_w](https://community.homey.app/u/wesley_w)\ **Post date:** [April 13, 2021, 1:52pm UTC](https://community.homey.app/t/google-nest-sdm/43087/272 "2021-04-13T13:52:29Z")
Mmmm interesting to play with… When my Hello Doorbell sees my car on the driveway it can open my front door “Nuki” [Previous page](https://community.homey.app/t/google-nest-sdm/43087.md?page=12) [Next page](https://community.homey.app/t/google-nest-sdm/43087.md?page=14)