If anyone is dealing with buffering themselves here's something you can try. Try changing your wifi from 5ghz to 2.4ghz and vice versa. There must be something nearby causing interference on the 5ghz band because as soon as I changed it to 2.4ghz the difference in performance was immediately noticeable. My streams don't go out of sync anymore. Audio isn't dropping out. I still get some very minor buffering but that's likely a problem at the source. At any rate it's better than before and content is actually watchable now. Amazing what kind of problems bad wifi can cause.
I figured out your actual problem just by reading your second sentence:
Wifi.