Illegitimi non carborundum

So I was just realizing something ...Did Mark know Fred before???

I just rewatched the scene in season one when June asked what the phrase meant. Fred told her that it was just something funny he and his friends came up with when they were twelve.

In the scene where Mark is talking to June on the porch, as he was leaving he smirked and said "Don't let the bastards grind you down."

Am I reading too much into this? Or did he know Fred when they were twelve?? Fred is a smug little pr!ck, I wouldn't doubt if he didn't remember him.