Do I have the right to be upset at this? Help please?

Maybe you should consider reporting your former boss to the proper authorities. Or at least threaten him that you intend to. Maybe he'll change his mind to stay out of trouble.