I just fixed it!!! I got back the rainbow of voices. I adjusted the
language on both device (phone) and Assistant settings to English US,
and it works!
The same thing happened to me. This morning the Orange voice is there
(male, brutal). I had different male voice before, don't remember the
colour, but now it's only Red and Orange. It's irritating, I don't want
to listen to it!