Code

Evaluation Data Format Scripts#115

Code

Merged

anhuong merged 13 commits intofoundation-model-stack:mainfoundation-model-stack/fms-hf-tuning:mainfrom alex-jw-brooks:format_scriptsalex-jw-brooks/fms-hf-tuning:format_scriptsCopy head branch name to clipboardMay 21, 2024

+426-1

Commits

Commits on May 21, 2024

• Add tentative script for formatting eval data

  Show description for fae2c95
  alex-jw-brooks

  committed
  fae2c95

  Copy full SHA for fae2c95

• Add formatting for entities and tsa

  Show description for a967ff3
  alex-jw-brooks

  committed
  a967ff3

  Copy full SHA for a967ff3

• Add docstrings to format script

  Show description for 502d45e
  alex-jw-brooks

  committed
  502d45e

  Copy full SHA for 502d45e

• Escape commas in tsa / entities

  Show description for a9e2ad0
  alex-jw-brooks

  committed
  a9e2ad0

  Copy full SHA for a9e2ad0

• Add subsampling to script for pulling data

  Show description for 0e8c4d5
  alex-jw-brooks

  committed
  0e8c4d5

  Copy full SHA for 0e8c4d5

• Add script to convert alpaca format to sft format

  Show description for 151adc3
  alex-jw-brooks

  committed
  151adc3

  Copy full SHA for 151adc3

• Add notes on formatting and evaluation

  Show description for ba075b9
  alex-jw-brooks

  committed
  ba075b9

  Copy full SHA for ba075b9

• Fix venv guidance

  Show description for 6828780
  alex-jw-brooks

  committed
  6828780

  Copy full SHA for 6828780

• Add hack for simple formatting

  Show description for df8121c
  alex-jw-brooks

  committed
  df8121c

  Copy full SHA for df8121c

• Add boto3 to dev deps

  Show description for f6e27db
  alex-jw-brooks

  committed
  f6e27db

  Copy full SHA for f6e27db

• Add file and verbose flags to sft formatter

  Show description for cf92a3f
  alex-jw-brooks

  committed
  cf92a3f

  Copy full SHA for cf92a3f

• lint pull and fmt script

  Show description for bd7e521
  alex-jw-brooks

  committed
  bd7e521

  Copy full SHA for bd7e521

• Update docs & review comments

  Show description for 43fa7a5
  alex-jw-brooks

  committed
  43fa7a5

  Copy full SHA for 43fa7a5