Thanks for reaching out. What type of Chromecast device do you have? Please take note that we can't separate the video and audio when casting. Also, only Chromecast with Google TV can be paired to Bluetooth devices.
If you have the older versions of Chromecast devices, you can still route the audio if your Bluetooth speaker has an auxiliary port and has an option to hardwire using a 3.5 mm cable.