Code

Prepare oasst2 dataset#3736

Code

Draft

andrewm4894 wants to merge 6 commits intoLAION-AI:mainLAION-AI/Open-Assistant:mainfrom andrewm4894:prepare-oasst1dot1andrewm4894/Open-Assistant:prepare-oasst1dot1Copy head branch name to clipboard

+1,193-6

Commits

Commits on Nov 8, 2023

• Add example usage and instructions for cleaning

  Show description for 3a9d124
  andrewm4894

  committed
  3a9d124

  Copy full SHA for 3a9d124

Commits on Dec 4, 2023

• add notebook for oasst2 generation

  andrewm4894

  committed
  ab5148f

  Copy full SHA for ab5148f

• move to oasst2 folder and rerun with additional instructions

  andrewm4894

  committed
  dc7054d

  Copy full SHA for dc7054d

• Remove keyword flagging script and update notebook

  andrewm4894

  committed
  9e446ed

  Copy full SHA for 9e446ed

• Add split_dataset.py and generate_oasst2.ipynb

  Show description for a095cb6
  andrewm4894

  committed
  a095cb6

  Copy full SHA for a095cb6

• add _ready_ versions of files too

  andrewm4894

  committed
  99adb6f

  Copy full SHA for 99adb6f