Rudeboy fires back at trolls shortly after his girlfriend, Ivy, dismisses allegations of being a husband snatcher