It is not against the law to carry a handgun. It is against the law to carry a handgun underneath the clothing in a concealed fashion without a permit. As long as it is visible (outside the clothing) and you have a permit for the gun, I believe that it is legal.
Brad is right, it is BS that we have a 2nd amendment in plain writing and still have to pay to carry a handgun.