??Am I Wrong to be upset about this with him?

You aren't wrong, your boyfriend sounds high maintnance. He acted like a spoiled brat and should let him know it. Just because it's his birthday doesn't mean he has a right to be inconsiderate of your needs.