Mistral QLoRA and config spring cleaning #526

Job	Run time
recipe_test_multi_gpu (3.8, nightly)	15m 6s
recipe_test_multi_gpu (3.8, nightly)	15m 6s
recipe_test_multi_gpu (3.8, nightly)	15m 6s
recipe_test_multi_gpu (3.8, nightly)	15m 6s
recipe_test_multi_gpu (3.8, stable)	6m 18s
recipe_test_multi_gpu (3.8, stable)	6m 18s
recipe_test_multi_gpu (3.8, stable)	6m 18s
recipe_test_multi_gpu (3.8, stable)	6m 18s
recipe_test_multi_gpu (3.9, nightly)	15m 52s
recipe_test_multi_gpu (3.9, nightly)	15m 52s
recipe_test_multi_gpu (3.9, nightly)	15m 52s
recipe_test_multi_gpu (3.9, nightly)	15m 52s
recipe_test_multi_gpu (3.9, stable)	6m 45s
recipe_test_multi_gpu (3.9, stable)	6m 45s
recipe_test_multi_gpu (3.9, stable)	6m 45s
recipe_test_multi_gpu (3.9, stable)	6m 45s
recipe_test_multi_gpu (3.10, nightly)	16m 22s
recipe_test_multi_gpu (3.10, nightly)	16m 22s
recipe_test_multi_gpu (3.10, nightly)	15m 29s
recipe_test_multi_gpu (3.10, nightly)	15m 53s
recipe_test_multi_gpu (3.10, stable)	6m 38s
recipe_test_multi_gpu (3.10, stable)	6m 38s
recipe_test_multi_gpu (3.10, stable)	6m 38s
recipe_test_multi_gpu (3.10, stable)	6m 38s
recipe_test_multi_gpu (3.11, nightly)	16m 15s
recipe_test_multi_gpu (3.11, nightly)	15m 37s
recipe_test_multi_gpu (3.11, nightly)	15m 37s
recipe_test_multi_gpu (3.11, nightly)	15m 37s
recipe_test_multi_gpu (3.11, stable)	6m 27s
recipe_test_multi_gpu (3.11, stable)	6m 27s
recipe_test_multi_gpu (3.11, stable)	6m 27s
recipe_test_multi_gpu (3.11, stable)	6m 27s
	5h 55m 36s

Provide feedback