Day trip to Florence

Does a day trip to Florence makes sense when we have only 3 days in Rome? Travelling with an infant so speed of covering places is pretty slow with us. Should we spend all 3 days in Rome or take a day out to travel to Florence? TIA.