He's oversensitive about his loss of colonies, not because of his pride (although, that's one of the reasons), but because it just remind him about how France used to love him (whether like a brother or romantically) (or both) but he ruined that for him.
And to this day, he's never forgiven himself.
He's not even sure if France ever forgave him.