Thanks for reaching out to the Google Nest Community.
A few questions: How often does it occur? How long does it take before it stops casting? Did the video buffer or pixelate before it stopped casting? Is the video playing problem-free on the device, when not casting?
Give these steps a try: