It's not currently possible to split the audio from a video on Chromecast devices and have it play on Google Nest Audio speakers however there have been rumours that it might be available in the future.
Please leave feedback for the Google Nest team requesting that this feature is added.
I hope we were able to answer your question with the info provided by @Cathal_S. If you have additional questions, feel free to respond to this thread and we'd be happy to further assist you. Otherwise, we'll close this thread after 24 hours if we don't hear back anything from you.