DeepPavlov
An open source library for deep learning end-to-end dialog systems and chatbots.
File Explorer
- bug_report.md
- config.yml
- feature-request.md
- default.html
- glue_cola_roberta.json
- glue_mnli_cased_bert_torch.json
- glue_mnli_mm_cased_bert_torch.json
- glue_mnli_roberta.json
- glue_mrpc_roberta.json
- glue_qnli_roberta.json
- glue_qqp_roberta.json
- glue_rte_cased_bert_torch.json
- glue_rte_roberta_mnli.json
- glue_sst2_roberta.json
- glue_stsb_roberta.json
- glue_wnli_roberta.json
- superglue_boolq_roberta_mnli.json
- superglue_copa_roberta.json
- superglue_record_roberta.json
- superglue_wic_bert.json
- boolqa_rubert.json
- few_shot_roberta.json
- insults_kaggle_bert.json
- paraphraser_convers_distilrubert_2L.json
- paraphraser_convers_distilrubert_6L.json
- paraphraser_rubert.json
- query_pr.json
- rusentiment_bert.json
- rusentiment_convers_bert.json
- rusentiment_convers_distilrubert_2L.json
- rusentiment_convers_distilrubert_6L.json
- sentiment_sst_conv_bert.json
- sentiment_twitter.json
- topics_distilbert_base_uncased.json
- en_ranker_pop_wiki.json
- en_ranker_tfidf_wiki.json
- ru_ranker_tfidf_wiki.json
- bert_embedder.json
- bert_sentence_embedder.json
- entity_detection_en.json
- entity_detection_ru.json
- entity_extraction_en.json
- entity_extraction_ru.json
- entity_linking_en.json
- entity_linking_ru.json
- fasttext_logreg.json
- kbqa_cq_en.json
- kbqa_cq_ru.json
- wiki_parser.json
- morpho_ru_syntagrus_bert.json
- ru_syntagrus_joint_parsing.json
- syntax_ru_syntagrus_bert.json
- mt_glue.json
- multitask_example.json
- ner_bert_base.json
- ner_case_agnostic_mdistilbert.json
- ner_collection3_bert.json
- ner_conll2003_bert.json
- ner_conll2003_deberta_crf.json
- ner_ontonotes_bert.json
- ner_ontonotes_bert_mult.json
- ner_ontonotes_deberta_crf.json
- ner_rus_bert.json
- ner_rus_bert_probas.json
- ner_rus_convers_distilrubert_2L.json
- ner_rus_convers_distilrubert_6L.json
- en_odqa_infer_wiki.json
- en_odqa_pop_infer_wiki.json
- ru_odqa_infer_wiki.json
- path_ranking_nll_roberta_en.json
- ranking_ubuntu_v2_torch_bert_uncased.json
- rel_ranking_nll_bert_ru.json
- rel_ranking_roberta_en.json
- translation_ranker.json
- re_docred.json
- re_rured.json
- russian_superglue_danetqa_rubert.json
- russian_superglue_lidirus_rubert.json
- russian_superglue_muserc_rubert.json
- russian_superglue_parus_rubert.json
- russian_superglue_rcb_rubert.json
- russian_superglue_rucos_rubert.json
- russian_superglue_russe_rubert.json
- russian_superglue_rwsd_rubert.json
- russian_superglue_terra_rubert.json
- sentseg_dailydialog_bert.json
- brillmoore_wikitypos_en.json
- levenshtein_corrector_ru.json
- qa_multisberquad_bert.json
- qa_nq_psgcls_bert.json
- qa_squad2_bert.json
- squad_bert.json
- squad_ru_bert.json
- squad_ru_convers_distilrubert_2L.json
- squad_ru_convers_distilrubert_6L.json
- __init__.py
- __init__.py
- infer.py
- train.py
- utils.py
- __init__.py
- aliases.py
- base.py
- chainer.py
- cross_validation.py
- errors.py
- file.py
- log.py
- log_events.py
- metrics_registry.json
- metrics_registry.py
- params.py
- params_search.py
- paths.py
- prints.py
- registry.json
- registry.py
- requirements_registry.json
- __init__.py
- data_fitting_iterator.py
- data_learning_iterator.py
- dataset_reader.py
- simple_vocab.py
- utils.py
- __init__.py
- component.py
- estimator.py
- nn_model.py
- serializable.py
- torch_model.py
- __init__.py
- fit_trainer.py
- nn_trainer.py
- torch_trainer.py
- utils.py
- __init__.py
- __init__.py
- basic_classification_iterator.py
- huggingface_dataset_iterator.py
- morphotagger_iterator.py
- multitask_iterator.py
- siamese_iterator.py
- sqlite_iterator.py
- squad_iterator.py
- typos_iterator.py
- __init__.py
- basic_classification_reader.py
- boolqa_reader.py
- conll2003_reader.py
- docred_reader.py
- faq_reader.py
- huggingface_dataset_reader.py
- imdb_reader.py
- line_reader.py
- morphotagging_dataset_reader.py
- multitask_reader.py
- odqa_reader.py
- paraphraser_reader.py
- rel_ranking_reader.py
- rured_reader.py
- sq_reader.py
- squad_dataset_reader.py
- typos_reader.py
- ubuntu_v2_reader.py
- __init__.py
- accuracy.py
- bleu.py
- correlation.py
- elmo_metrics.py
- fmeasure.py
- google_bleu.py
- log_loss.py
- mse.py
- recall_at_k.py
- record_metrics.py
- roc_auc_score.py
- squad_metrics.py
- __init__.py
- api_requester.py
- api_router.py
- __init__.py
- cos_sim_classifier.py
- dnnc_proba2labels.py
- proba2labels.py
- re_bert.py
- torch_classification_model.py
- torch_nets.py
- utils.py
- __init__.py
- bpr.py
- logit_ranker.py
- pop_ranker.py
- tfidf_ranker.py
- utils.py
- __init__.py
- abstract_embedder.py
- fasttext_embedder.py
- tfidf_weighted_embedder.py
- transformers_embedder.py
- __init__.py
- entity_detection_parser.py
- entity_linking.py
- find_word.py
- ner_chunker.py
- __init__.py
- query_generator.py
- query_generator_base.py
- rel_ranking_infer.py
- ru_adj_to_noun.py
- sentence_answer.py
- template_matcher.py
- tree_to_sparql.py
- type_define.py
- utils.py
- wiki_parser.py
- __init__.py
- dependency_decoding.py
- joint.py
- spacy_lemmatizer.py
- syntax_parsing.py
- __init__.py
- dirty_comments_preprocessor.py
- dnnc_preprocessor.py
- mask.py
- multitask_preprocessor.py
- ner_preprocessor.py
- odqa_preprocessors.py
- one_hotter.py
- re_preprocessor.py
- response_base_loader.py
- sanitizer.py
- sentseg_preprocessor.py
- squad_preprocessor.py
- str_lower.py
- str_token_reverser.py
- str_utf8_encoder.py
- torch_transformers_preprocessor.py
- transformers_preprocessor.py
- __init__.py
- metrics.py
- __init__.py
- losses.py
- relation_extraction_bert.py
- __init__.py
- sklearn_component.py
- __init__.py
- error_model.py
- __init__.py
- kenlm_elector.py
- top1_elector.py
- __init__.py
- levenshtein_searcher.py
- searcher_component.py
- tabled_trie.py
- __init__.py
- __init__.py
- lazy_tokenizer.py
- nltk_moses_tokenizer.py
- nltk_tokenizer.py
- spacy_tokenizer.py
- split_tokenizer.py
- utils.py
- __init__.py
- crf.py
- multitask_transformer.py
- torch_bert_ranker.py
- torch_transformers_classifier.py
- torch_transformers_el_ranker.py
- torch_transformers_multiplechoice.py
- torch_transformers_nll_ranking.py
- torch_transformers_sequence_tagger.py
- torch_transformers_squad.py
- torch_transformers_syntax_parser.py
- __init__.py
- hashing_tfidf_vectorizer.py
- __init__.py
- datasets.txt
- dependency_decoding.txt
- en_core_web_sm.txt
- faiss.txt
- fasttext.txt
- hdt.txt
- kenlm.txt
- lxml.txt
- opt_einsum.txt
- protobuf.txt
- pytorch.txt
- rapidfuzz.txt
- razdel.txt
- ru_core_news_sm.txt
- sacremoses.txt
- sentencepiece.txt
- slovnet.txt
- sortedcontainers.txt
- torchcrf.txt
- transformers.txt
- udapi.txt
- whapi.txt
- __init__.py
- benchmarks.py
- __init__.py
- dialog_logger.py
- __init__.py
- pip_wrapper.py
- __init__.py
- metrics.py
- server.py
- __init__.py
- dialog_logger_config.json
- log_config.json
- server_config.json
- __init__.py
- socket.py
- __init__.py
- __init__.py
- typos.py
- wiki_sqlite.py
- __init__.py
- __main__.py
- _meta.py
- deep.py
- download.py
- paramsearch.py
- settings.py
- 01_login_to_aws.png
- 02_choose_ubuntu.png
- 03_select_instance_type.png
- 04_add_storage.png
- 05_review_instance.png
- 06_go_to_running_instances.png
- 07_wait_init.png
- 08_01_set_sec_group.png
- 08_02_set_inbound.png
- 09_01_select_connect.png
- 09_02_connection_info.png
- Medium_Monogram.svg
- telegram.png
- Twitter_Social_Icon_Circle_Color.svg
- youtube_social_circle_red.png
- deeppavlov.css
- deeppavlov.png
- deeppavlov_logo.png
- dp_agnt_diag.png
- gobot_diagram.png
- ipavlov_footer.png
- kvret_diagram.png
- my_blocks.css
- tree.png
- footer.html
- commands.rst
- common.rst
- data.rst
- models.rst
- trainers.rst
- api_requester.rst
- classifiers.rst
- doc_retrieval.rst
- embedders.rst
- entity_extraction.rst
- kbqa.rst
- preprocessors.rst
- relation_extraction.rst
- sklearn.rst
- spelling_correction.rst
- tokenizers.rst
- torch_bert.rst
- vectorizers.rst
- core.rst
- dataset_iterators.rst
- dataset_readers.rst
- metrics.rst
- models.rst
- vocabs.rst
- contribution_guide.rst
- registry.rst
- bert.rst
- classification.ipynb
- entity_extraction.ipynb
- few_shot_classification.ipynb
- KBQA.ipynb
- morpho_tagger.ipynb
- multitask_bert.rst
- NER.ipynb
- neural_ranking.ipynb
- ODQA.ipynb
- popularity_ranking.rst
- relation_extraction.ipynb
- spelling_correction.ipynb
- SQuAD.ipynb
- superglue.rst
- syntax_parser.ipynb
- tfidf_ranking.ipynb
- hypersearch.rst
- overview.rst
- pretrained_vectors.rst
- aws_ec2.rst
- rest_api.rst
- settings.rst
- socket_api.rst
- internships.rst
- configuration.rst
- installation.rst
- overview.rst
- python.ipynb
- quick_start.rst
- conf.py
- index.rst
- Makefile
- en_ranker_pop_wiki_test.json
- en_ranker_tfidf_wiki_test.json
- ru_ranker_tfidf_wiki_test.json
- __init__.py
- test_quick_start.py
- cmd.sh
- docker-compose.yml
- Dockerfile
- README.md
- __init__.py
- hashes.py
- optimize_ipynb.py
- registry.py
- upload.py
- __init__.py
- .gitignore
- .readthedocs.yml
- _config.yml
- CNAME
- Jenkinsfile
- LICENSE
- MANIFEST.in
- NLP_OSS_DeepPavlov_ACL_Demo_final.pdf
- README.md
- requirements.txt
- setup.py
# Installation Guide
pythonPrerequisites
- Python 3.6, 3.7, 3.8, 3.9, 3.10, 3.11
- CUDA Toolkit Compatible with used GPU and PyTorch version
Setup Steps
python -m venv env
Create a virtual environment.
source ./env/bin/activate
Activate the virtual environment.
pip install deeppavlov
Install the deeppavlov package.
python -m deeppavlov interact <config_path> -d -i
Interact with the model via CLI.
Key Commands
pip install deeppavlov
Install the DeepPavlov package from PyPI.
python -m deeppavlov interact <config_path> -d -i
Run interactive CLI mode based on the specified config file.
python -m deeppavlov train <config_path> -d -i
Train the model based on the config file.
python -m deeppavlov evaluate <config_path> -d -i
Evaluate model metrics on the specified dataset.
python -m deeppavlov riseapi <config_path> -d -i
Run a REST API server.
It is recommended to install the PyTorch version compatible with CUDA to use GPU acceleration.
# Use via CDN
jsDelivrjsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.
Link
Example
Command Glossary
Commands referenced in this DOCs, explained below.
pip install
View Details ▼
pip install
Install Python packages.
pip install {{package1 package2 ...}}
Install one or more packages:
pip install {{package1 package2 ...}} {{[-U|--upgrade]}}
Upgrade all specified packages to the latest version, installing any that are not already present:
pip install {{package}}=={{version}}
Install a specific version of a package:
python
View Details ▼
python
Python language interpreter.
python
Start a REPL (interactive shell):
python {{path/to/file.py}}
Execute a specific Python file:
python -i {{path/to/file.py}}
Execute a specific Python file and start a REPL:
# Project Badges
// repository documentation
Was this content helpful?
(0 ratings)