topic Re: PersonDetection or FaceFamilarDetection syntax for particular person in Home Automation

PersonDetection or FaceFamilarDetection syntax for particular person

KonaBlueShelby — Wed, 06 Sep 2023 17:36:50 GMT

I would like to know what the correct syntax is for a script to use the PersonDetection starter for a particular face. I saw two different ones in the screenshots of this blog post: https://www.googlenestcommunity.com/t5/Blog/Camera-events-custom-notifications-and-more-now-available-in-the-script/ba-p/471741

Those examples are using a device.event.FaceFamilarDetection which isn't available but show a faces or faceName field.

However, neither one of those validate correctly when I try to use them with PersonDetection. The documentation doesn't explain it either.

Thank you,

Mark

Re: PersonDetection or FaceFamilarDetection syntax for particular person

marilynereiche — Wed, 06 Sep 2023 19:06:50 GMT

For person detection or face familiar detection, you typically need to use a specific programming or machine learning framework or library such as OpenCV, TensorFlow, or a dedicated facial recognition API like Microsoft Azure's Face API. The syntax can vary significantly depending on the chosen tool, so it's essential to refer to the respective documentation for the correct syntax and implementation details. For more details visit here

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Wed, 06 Sep 2023 22:08:28 GMT

Hey @KonaBlueShelby - Are you able to copy and paste the examples from the reference docs to see if they work for you? You'll need to edit the device names based on what you've named the devices in your home. You'll find the supported starters under https://developers.home.google.com/automations/starters-conditions-and-actions (filter by " Device event starters"). Note that PersonDetection is different than FaceFamiliarDetection in that PersonDetection is whether the camera sees a person vs. a familiar/unfamiliar face on cameras that support the familiar faces feature.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

KonaBlueShelby — Thu, 07 Sep 2023 12:23:59 GMT

@nickfromgoogle thank you for the response. I tried manually putting in FaceFamiliarDetection and I get the validation error below. This is for a Nest Doorbell (battery) and it has faces detected and saved. I have the public preview active for my Google Home account.

[device.event.FaceFamiliarDetection] is not supported by device [Porch doorbell - Entryway]. The list of supported events: [device.state.Online, device.event.DoorbellPress, device.state.EnergyStorage, device.state.MotionDetection, device.event.MotionDetection, device.event.PersonDetection, device.event.MovingVehicleDetection, device.event.AnimalCatDetection, device.event.AnimalDogDetection, device.event.AnimalOtherDetection, device.event.PackageDelivered].

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Thu, 07 Sep 2023 15:59:27 GMT

Thanks for checking and sharing the details. I'll follow up with my team to see why this is happening.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

KonaBlueShelby — Mon, 11 Sep 2023 12:39:42 GMT

@nickfromgoogle - find anything out on this? Thanks.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Mon, 11 Sep 2023 17:03:00 GMT

Hey @KonaBlueShelby - Sorry, the team is still looking into this issue. I'll reply once I have more info. Thanks for your patience.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

KonaBlueShelby — Fri, 22 Sep 2023 14:33:44 GMT

@nickfromgoogle I have FaceFamilarDetection available now. But it doesn't look like the faceName or faces are valid options like shown in these screenshots https://www.googlenestcommunity.com/t5/Blog/Camera-events-custom-notifications-and-more-now-available-in-the-script/ba-p/471741

I was hoping to automate unlocking my Nest Yale lock if the Nest Doorbell recognizes me, but it doesn't look like unlocking is supported for the lock.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

NickP-Dublin — Sun, 01 Oct 2023 15:10:29 GMT

I just posted a similar question in as a reply in the another post. I used the example shown in the blog post about camera events and everything seems good apart from when I validate its says "Field [faceName] is unexpected in the struct".

Has the format for identifying individual faces in the script changed since the blog post?

Re: PersonDetection or FaceFamilarDetection syntax for particular person

Moziqui — Mon, 02 Oct 2023 15:14:23 GMT

I'm having the same issue, whether I use 'faces' or 'faceName', I get the same error: Field [faceName] is unexpected in the Struct.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

Super_paulie — Thu, 05 Oct 2023 13:09:36 GMT

add me to the list, face or faceName are not recognised as valid.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

KonaBlueShelby — Thu, 05 Oct 2023 13:28:07 GMT

@nickfromgoogle - it looks like I'm not the only one looking for the correct format to add 'faces' or 'faceName' or whatever it should be to get this working. Can you help with this please?

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Thu, 05 Oct 2023 21:27:57 GMT

Hey @KonaBlueShelby, sorry for the delay. We've issued a fix so that the FaceFamiliarDetection starter shows up in auto-complete and works without the faceNames parameter. We're working on removing the parameter in auto-complete until we get it fully implemented. Apologies for the inconvenience. In the meantime, you can use FaceFamiliarDetection as a starter so any familiar face detected starts the automation.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Thu, 05 Oct 2023 21:28:25 GMT

Hey @Super_paulie, we've issued a fix so that the FaceFamiliarDetection starter shows up in auto-complete and works without the faceNames parameter. We're working on removing the parameter in auto-complete until we get it fully implemented. Apologies for the inconvenience. In the meantime, you can use FaceFamiliarDetection as a starter so any familiar face detected starts the automation.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Thu, 05 Oct 2023 21:28:53 GMT

Hey @Moziqui, we've issued a fix so that the FaceFamiliarDetection starter shows up in auto-complete and works without the faceNames parameter. We're working on removing the parameter in auto-complete until we get it fully implemented. Apologies for the inconvenience. In the meantime, you can use FaceFamiliarDetection as a starter so any familiar face detected starts the automation.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Thu, 05 Oct 2023 21:29:34 GMT

Hey @NickP-Dublin we've issued a fix so that the FaceFamiliarDetection starter shows up in auto-complete and works without the faceNames parameter. We're working on removing the parameter in auto-complete until we get it fully implemented. Apologies for the inconvenience. In the meantime, you can use FaceFamiliarDetection as a starter so any familiar face detected starts the automation.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

Super_paulie — Thu, 05 Oct 2023 21:59:36 GMT

That's kinda ok, however I need to be able to use specific familiar faces as my starter. Just having general familiar faces isn't specific enough sadly.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

Matt_HGR — Sat, 28 Oct 2023 22:46:34 GMT

Hi @nickfromgoogle sorry to be another pest on this thread!

I'm also looking to get the faceName(s) parameter implemented to my automation. i've been lurking on this thread for around 3 weeks myself!

Do you happen to have an ETA (or a loose window) for when you'd like to get this re-added?

Thanks so much!

Matt

Re: PersonDetection or FaceFamilarDetection syntax for particular person

nickfromgoogle — Fri, 03 Nov 2023 18:14:38 GMT

Hey @Matt_HGR - Sorry for the delayed response. I'm still following up with the team on this request so nothing to share at this time.

Re: PersonDetection or FaceFamilarDetection syntax for particular person

Super_paulie — Wed, 08 Nov 2023 13:38:00 GMT

still waiting for this... i saw that there was an update to automations so i came back to check and the "faceNames" is still not available/working. A shame as why would i want to just use a generic "Familiar face" as a starter.

I mean i want specific people to use as starters for example "If Paul is at the door and its dark, then turn on lounge lights". What use would it be if its just a generic familiar face, for example why would i want the lights to come on when im not at home and say my grandmother is at the door. She would just assume i was in as the light came on...? not ideal Google, come on.