Skip to content

components oss_text_generation_data_import

github-actions[bot] edited this page Nov 10, 2023 · 26 revisions

OSS Text Generation Data Import

oss_text_generation_data_import

Overview

FTaaS component to copy user training data to output

Version: 0.0.2

View in Studio: https://ml.azure.com/registries/azureml/components/oss_text_generation_data_import/version/0.0.2

Inputs

Inputs

Name Description Type Default Optional Enum
train_file_path Path to the registered training data asset. The supported data formats are jsonl, json, csv, tsv and parquet. uri_file
validation_file_path Path to the registered validation data asset. The supported data formats are jsonl, json, csv, tsv and parquet. uri_file True

Validation parameters

Name Description Type Default Optional Enum
system_properties Validation parameters propagated from pipeline. string True

Outputs

Name Description Type
output_dataset Output dataset with train and validation data uri_folder

Environment

azureml://registries/azureml/environments/acft-hf-nlp-gpu/versions/28

Clone this wiki locally