Tracking CSV file changes

Hi all, I work with large datasets in CSV files. As we develop new data rules (capitalization, date formats etc.) I find myself having to go back and make lots of changes to the datasets in VSCode. The rudimentary system I use is through multiple copies of files but that quickly leads to duplicate data filling up my computer(I may also be doing this completely wrong, in this case please share how you guys usually keep track of changes to large datasets.)

I'd like some kind of version control for the changes I make to the data, but not in excel as I find it too unwieldy for the kinds operations I have to do. Any suggestions on a Git-like system for version control?

Thanks!