Just switched to ATT internet, using their dual band accesspoint; as soon as I connected to that network Nest Hub started failing to recognize commands on the first try.
"Ok google, play music" Little 'thinking dots' appear, no text is written, ~20s pass and hub responds that there was a problem try again. I immediately respond "ok google, play music" and it works like a champ. Taking ~30s for every dang command is getting annoying however.
Connected back to the old network for 2 days, it worked fine, connected back to the new ATT and failed again. Factory reset twice, checked connection strength, and everything seems to be correct.