Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

update mpt7b instruct ft commit #375

Open
wants to merge 5 commits into
base: main
Choose a base branch
from
Open

update mpt7b instruct ft commit #375

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
ddf5f8a
update mpt7b instruct ft commit
RR4787 Jun 20, 2023
6b08dfc
Merge branch 'main' into roshan/mpt-instruct-ft-yaml
RR4787 Jun 20, 2023
e74a71e
pin hf commit
RR4787 Jun 20, 2023
dbcc14c
Merge branch 'roshan/mpt-instruct-ft-yaml' of github.com:mosaicml/exa…
RR4787 Jun 20, 2023
d44e399
Merge branch 'main' into roshan/mpt-instruct-ft-yaml
RR4787 Jun 21, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion examples/inference-deployments/mpt/mpt_7b_ft_handler.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@

LOCAL_CHECKPOINT_DIR = '/tmp/mpt'
LOCAL_MODEL_PATH = os.path.join(LOCAL_CHECKPOINT_DIR, 'local_model')
HF_COMMIT = 'bbe7a55d70215e16c00c1825805b81e4badb57d7'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be passed in from the input yaml



def download_convert(s3_path: Optional[str] = None,
Expand Down Expand Up @@ -77,7 +78,7 @@ def download_convert(s3_path: Optional[str] = None,
elif hf_path:
print(f'Downloading HF model with name: {hf_path}')
model_name_or_path = hf_path
snapshot_download(repo_id=hf_path)
snapshot_download(repo_id=hf_path, revision=HF_COMMIT)

# This is the format the the conversion script saves the converted checkpoint in
local_ft_model_path = os.path.join(LOCAL_CHECKPOINT_DIR, f'{gpus}-gpu')
Expand Down
2 changes: 1 addition & 1 deletion examples/inference-deployments/mpt/mpt_7b_instruct_ft.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ command: |
integrations:
- integration_type: git_repo
git_repo: mosaicml/examples
git_commit: 75e068f90c613a2cced553c5dc449d98c5470454
git_commit: dcc4c4dff002d282a2f432ccfcab4b61dc6a53af
ssh_clone: false
- integration_type: git_repo
git_repo: mosaicml/llm-foundry
Expand Down