Is After Effects too much for me?

I have AE because my family has Adobe Creative Cloud suite but I've never used it and it looks really daunting. I really just have one specific use case and I'm looking for advice as to if AE is the way to go - since I have it anyhow or maybe there's an easier path.

My videos are done/filmed and cut but I want to add little cartoon style animated effects like questions marks or surprise lines. Little explosions, magic effects etc. All very childish and cartoony. Looking channels like Toys & Colors or Vlad & Nikki for inspiration.

Like the music graphic here. that moves.

Ideally I could just have a collection of animations (like 50-100) that I could just drag and drop onto the video.

Very much appreciate any feedback & advice.

zzzz for sleeping would be another example