This project helps different companies to align Large Language Models to business preferences on Databricks using another LLM to generate feedback.
The Model Alignment Solution Accelerator V2 is available in the V2 branch. This is the version that was presented at Data+AI Summit 24.
- datasets
- torch
- tqdm
- transformers
- accelerate
- bitsandbytes
- loralib
- peft
- tyro
- trl