I have an 08 Audio it can be done, loosen them up and the unit will turn, did you loosen the allen screws a lot, it might be stuck against the handlebar but they are not glued and there is no set pin, I have had mine come off when I put on a cup holder and my GPS, they won't move much only about an inch or so.
Well, I tried loosening the set screws and went so far as to remove them completely. The clutch lever and master cylinder come off and dangled by the hoses and then I tried to move the switch unit. It did not budge. I have a suspicion that the dealer may be right, they are not moveable.