text-to-text-transfer-transformer
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
File Explorer
- bug_report.md
- config.yaml
- question--use-discussion-tab-instead-.md
- build.yml
- t5-trivia.ipynb
- __init__.py
- dataset_providers.py
- dataset_providers_test.py
- glue_utils.py
- mixtures.py
- postprocessors.py
- postprocessors_test.py
- preprocessors.py
- preprocessors_test.py
- tasks.py
- utils.py
- expected_bootstrap_results.json
- prediction_large.txt
- target_large.txt
- __init__.py
- eval_utils.py
- eval_utils_test.py
- metrics.py
- metrics_test.py
- qa_utils.py
- qa_utils_test.py
- scoring_test.py
- test_utils.py
- __init__.py
- constant_0_001.gin
- rsqrt_no_ramp_down.gin
- __init__.py
- bi_bert_base.gin
- bi_bert_large.gin
- bi_v1.gin
- bi_v1_11B.gin
- bi_v1_2x.gin
- bi_v1_3B.gin
- bi_v1_4x.gin
- bi_v1_l6.gin
- bi_v1_large.gin
- bi_v1_shared.gin
- bi_v1_small.gin
- lm_v1.gin
- lm_v1_ifa.gin
- t5.1.0.11B.gin
- t5.1.0.3B.gin
- t5.1.0.base.gin
- t5.1.0.large.gin
- t5.1.0.small.gin
- t5.1.1.base.gin
- t5.1.1.large.gin
- t5.1.1.small.gin
- t5.1.1.tiny.gin
- t5.1.1.xl.gin
- t5.1.1.xxl.gin
- t5.1.n4w10.base.gin
- t5.1.n4w10.large.gin
- t5.1.n4w10.xl.gin
- t5.1.th.base.gin
- t5.1.th.large.gin
- __init__.py
- all_permute.gin
- denoise.gin
- iid_10_u_u.gin
- iid_15_d_d.gin
- iid_15_m_f.gin
- iid_15_r10s90_f.gin
- iid_15_u_u.gin
- iid_25_u_u.gin
- iid_50_u_u.gin
- lm.gin
- prefix_lm.gin
- README
- span.gin
- span_10_15_u_u.gin
- span_2_15_u_u.gin
- span_3_15_u_u.gin
- span_5_15_u_u.gin
- __init__.py
- cnn_dailymail_v002.gin
- default.gin
- en_mix.gin
- glue_v002_proportional.gin
- squad_v010_allanswers.gin
- super_glue_v102_proportional.gin
- wmt15_enfr_v003.gin
- wmt16_enro_v003.gin
- wmt_t2t_ende_v003.gin
- wsc_dpr_simple_proportional.gin
- __init__.py
- beam_search.gin
- dataset.gin
- eval.gin
- greedy_decode.gin
- infer.gin
- infer_from_task.gin
- infer_multi_file.gin
- perplexity_eval.gin
- sample_decode.gin
- score_eval.gin
- score_from_file.gin
- score_from_task.gin
- task_adapter.gin
- checkpoint
- graph.pbtxt
- model-info.txt
- model.ckpt-0.data-00000-of-00002
- model.ckpt-0.data-00001-of-00002
- model.ckpt-0.index
- model.ckpt-0.meta
- operative_config.gin
- __init__.py
- hf_model.py
- mesh_transformer.py
- mesh_transformer_main.py
- mesh_transformer_test.py
- mtf_model.py
- t5_model.py
- utils.py
- __init__.py
- dump_task.py
- dump_task_test.py
- parse_tb.py
- prepare_glue_submission.py
- transform_checkpoints.py
- __init__.py
- __init__.py
- version.py
- CONTRIBUTING.md
- LICENSE
- pytest.ini
- README.md
- released_checkpoints.md
- setup.py
# Installation Guide
pythonSetup Steps
pip install t5[gcp]
Install the T5 package with GCP dependencies.
pip install tfds-nightly[c4]
Install tfds-nightly for C4 dataset processing.
Key Commands
pip install t5[gcp]
Install the T5 library and related GCP features.
python -m tensorflow_datasets.scripts.download_and_prepare --datasets=c4/en --data_dir=gs://$MY_BUCKET/tensorflow_datasets
Download and prepare datasets using TensorFlow Datasets.
# Use via CDN
jsDelivrjsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.
Command Glossary
Commands referenced in this DOCs, explained below.
pip install
View Details ▼
pip install
Install Python packages.
pip install {{package1 package2 ...}}
Install one or more packages:
pip install {{package1 package2 ...}} {{[-U|--upgrade]}}
Upgrade all specified packages to the latest version, installing any that are not already present:
pip install {{package}}=={{version}}
Install a specific version of a package:
python
View Details ▼
python
Python language interpreter.
python
Start a REPL (interactive shell):
python {{path/to/file.py}}
Execute a specific Python file:
python -i {{path/to/file.py}}
Execute a specific Python file and start a REPL: