We were able to verify that removing the Chromecast audio as the default
speaker from any other casting devices allowed this functionality to
work again
I have the same behavior.. my neighbor does too. Manual casting now
works from selected speaker on display or in Spotify app. But voice
controls are DOA to the Chromecast Audio or Chromecast Ultra