Have you figured more out since your post? We have the exact same
situation. When we only had the Nest app, home/away assist worked
perfectly. As soon as we migrated to Google home, it got totally messed
up. Sometimes it works for a few days and then...