Why Aaron was the only one unhappy with Cal abandoning his family?

He almost cried when Cal left too.

He almost cried when Cal left too.