Boxing doesn't really teach you actual self-defence. It teaches you how to move on your feet and throw a fast, hard punch, however, in self-defence, you need far more than that, assuming you're not up against a complete weak retard. What if someone has a knife or is also trained in boxing and self-defence? Now, you've got a problem.
But, being 6'6, I think that alone would be a good way to make others think twice.
Boxing messes you up more.