Winter Recommendations?

So my boyfriend and I will be visiting St. Augustine for the first time just after Christmas this year! We’re both very excited and looking for things to do that are specific to the December time frame (it’s supposed to be beautiful I hear). Many websites like trip advisor are advertising things like the beach which don’t seem appropriate for the season.

Any help would be greatly appreciated to help make our Christmas a special one!