Using FormattedCheckpointFiles in configs

[SalmanMohammadi]

Context

What is the purpose of this PR? Is it to

• add a new feature
• fix a bug
• update tests and/or documentation
• other (please add here)

Please link to any issues this PR addresses.

closes #2073

A super duper sanity check since we didn't have an example of the pytorch_model-{}-of-{}.bin format

from torchtune.training.checkpointing._utils import FormattedCheckpointFiles
fmt = FormattedCheckpointFiles(filename_format="pytorch_model-{}-of-{}.bin", max_filename="00015")
fmt.build_checkpoint_filenames()
['pytorch_model-00001-of-00015.bin',
 'pytorch_model-00002-of-00015.bin',
 'pytorch_model-00003-of-00015.bin',
 'pytorch_model-00004-of-00015.bin',
 'pytorch_model-00005-of-00015.bin',
 'pytorch_model-00006-of-00015.bin',
 'pytorch_model-00007-of-00015.bin',
 'pytorch_model-00008-of-00015.bin',
 'pytorch_model-00009-of-00015.bin',
 'pytorch_model-00010-of-00015.bin',
 'pytorch_model-00011-of-00015.bin',
 'pytorch_model-00012-of-00015.bin',
 'pytorch_model-00013-of-00015.bin',
 'pytorch_model-00014-of-00015.bin',
 'pytorch_model-00015-of-00015.bin']

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/torchtune/2147

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 921ccde with merge base 5370e0d ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[felipemello1]

thanks for doing it! I looked at it twice and everything looks good. But we are so close to a release that i am afraid that there may be some error if we dont test it. We can either: I will approve it, but assuming that you didnt try these configs, i am not sure if it should make it to this release

[SalmanMohammadi]

thanks for doing it! I looked at it twice and everything looks good. But we are so close to a release that i am afraid that there may be some error if we dont test it. We can either: I will approve it, but assuming that you didnt try these configs, i am not sure if it should make it to this release

As you wish. I thought about testing it but it's a lot of effort for a minor change.

[joecummings]

Should merge this after the release branch is cut @felipemello1