Does geomancer’s passive deal more Dmg with low defense?

My geo isn’t really hitting as hard as I expected him to be doing despite reaching cb turn 45 so was wondering if he needs more ho and less defense for his passive?