About the difference of the title which Hagrid uses

I’m a non-native, having recently started reading the English version of Harry Potter with the help of a dictionary. I have a question: Why does Hagrid frequently end his sentences to Dumbledore with “sir,” but doesn’t use “ma’am” when speaking to Professor McGonagall? If anyone knows, please let me know.