I understand your frustration: It's definitely a process. Here are some tips that have helped with my multi speaker + Home setup I have been using for the last few years. I am notorious for walking around the house with my phone in hand while talking to speakers. Also sitting at my desk with a Chromebook open, next to a speaker, with my Pixel on the wireless charger (all 2.5' away from each other). It happens 🙂 It's fixable.
https://support.google.com/googlenest/answer/7257763?hl=en&co=GENIE.Platform%3DAndroid
Google Nest Help says make sure both device are logged into the same Google account and make sure your Google app is fully updated on the phone. If both of these are correct, the phone shouldn't respond.
Some things to try:
1. Great job adjusting the sensitivity on each individual speak through the Google Home app. If this is still presenting a problem, be sure to check distance from each speaker. I also like to name each speaker something very different sounding (family room, kitchen, master bedroom, bathroom, office, etc not Speaker 1 speaker 2) AND place it inside the rooms I created for my home in the Google Home app. This last step appears to be especially important, in my experience.
2. Since Google Assistant is inside the speakers, there is an AI in there. Now that the speakers all assigned a name that matches the room they are in, let's use that to our advantage and try to train the speakers as to your intention by using the name of the speaker in different locations of the house. For example, when I am in between the Family Room and the Kitchen, either speaker can hear me. I used the name of the speaker I wanted to communicate with in the request.
"Hey Google, Tell me the daily Vitamin C intake per day for an adult on the Kitchen speaker."
Sitting in the office with three devices: "Hey Google, what time is it on the office speaker." This helps avoid my Chromebook workflow from being interrupted.
In my experience, this helps teach the system and dramatically improved my results. Additionally, My Google Home has been specifically asking me "Is this the speaker you want to respond"? The programmers clearly have their eye on this and are working to improve it. I hope this provides an incremental improvement along the software update path. For those who need detailed instructions on turning up or down the sensitivity ont he speakers like rmschoble and I have, take a look at this CNET article that walks through the individual steps. There is also a great link to an article with all the known OK Google commands.
https://www.cnet.com/home/smart-home/google-home-5-ways-to-fix-the-problem-when-google-assistant-doe...
All things Google: Google Fiber, Google WiFi, Chromebooks, Nest, Pixel phones, Fitbit, Chrome, Google Account, Chromecast, etc.
