Follow your surgeon's guidelines and you will be ok.
But if you can, hang on to that fear as it applies to dumping and sugar. I'm nervous about dumping, and that is just another reason for me not to eat sugary stuff! I haven't had simple sugars since surgery and don't miss it one bit.