Does the Name of the Wind get better?

I'm at chapter 28 now, which is around 1/3 of the book and it feels like everything I've read so far could have been written in 20% of the pages I read. There is SO MUCH fluff. Yes he learned a lot, then things went downhill and then a lot of random stories were told.

I get that part is world building, but it doesn't really seemed to fit a cause. Will that change? Will I understand what happens now or will it be more fluff and very little progression?