Red kayak doesn't mean attack, I think its more to do with wrong place, wrong time. I had a nice calm experience with a whitey recently (actually think there were at least 2), and have a red kayak (video below). Been wanting to see one (I love sharks), but not wanting to at the same time.....
As long as they are under 10ft, I'm not majorly concerned. Once they are over that you can be sure I will be getting away as fast as possible.
https://www.youtube.com/watch?v=b6s8LUonRxE