volta
[TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs"
File Explorer
Download Latest Version (.zip)Showing a partial file list β download the zip above to see everything.
- __init__.py
- functional_overrides.py
- tensor_overrides.py
- torch_overrides.py
- __init__.py
- __version__.py
- _amp_state.py
- _initialize.py
- _process_optimizer.py
- amp.py
- compat.py
- frontend.py
- handle.py
- opt.py
- README.md
- rnn_compat.py
- scaler.py
- utils.py
- wrap.py
- batch_norm.cu
- batch_norm.h
- batch_norm_add_relu.cu
- batch_norm_add_relu.h
- cuda_utils.h
- interface.cpp
- ipc.cu
- nhwc_batch_norm_kernel.h
- dropout.h
- encdec_multihead_attn.cpp
- encdec_multihead_attn_cuda.cu
- encdec_multihead_attn_norm_add.cpp
- encdec_multihead_attn_norm_add_cuda.cu
- layer_norm.h
- self_multihead_attn.cpp
- self_multihead_attn_cuda.cu
- self_multihead_attn_norm_add.cpp
- self_multihead_attn_norm_add_cuda.cu
- softmax.h
- strided_batched_gemm.h
- fused_adam_cuda.cpp
- fused_adam_cuda_kernel.cu
- interface.cpp
- xentropy_kernel.cu
- perf_test_multihead_attn.py
- __init__.py
- batch_norm.py
- __init__.py
- encdec_multihead_attn.py
- encdec_multihead_attn_func.py
- fast_encdec_multihead_attn_func.py
- fast_encdec_multihead_attn_norm_add_func.py
- fast_self_multihead_attn_func.py
- fast_self_multihead_attn_norm_add_func.py
- MHA_bwd.png
- MHA_fwd.png
- README.md
- self_multihead_attn.py
- self_multihead_attn_func.py
- __init__.py
- fp16_optimizer.py
- fused_adam.py
- fused_sgd.py
- test_encdec_multihead_attn.py
- test_encdec_multihead_attn_norm_add.py
- test_self_multihead_attn.py
- test_self_multihead_attn_norm_add.py
- test_label_smoothing.py
- __init__.py
- softmax_xentropy.py
- __init__.py
- __init__.py
- fp16_optimizer.py
- fp16util.py
- loss_scaler.py
- README.md
- __init__.py
- multi_tensor_apply.py
- __init__.py
- fused_layer_norm.py
- __init__.py
- fused_adam.py
- fused_lamb.py
- fused_novograd.py
- fused_sgd.py
- __init__.py
- distributed.py
- LARC.py
- multiproc.py
- optimized_sync_batchnorm.py
- optimized_sync_batchnorm_kernel.py
- README.md
- sync_batchnorm.py
- sync_batchnorm_kernel.py
- fused_adam.py
- fused_layer_norm.py
- README.md
- test.sh
- custom_function.py
- custom_module.py
- README.md
- test.sh
- imagenet.py
- test.sh
- jit_script_function.py
- jit_script_method.py
- jit_trace_function.py
- jit_trace_method.py
- README.md
- test.sh
- README.md
- resnet.py
- test.sh
- .gitignore
- lenet.py
- operators.py
- simple.py
- __init__.py
- nvmarker.py
- __init__.py
- __main__.py
- db.py
- kernel.py
- nvvp.py
- parse.py
- __init__.py
- __main__.py
- activation.py
- base.py
- blas.py
- conv.py
- convert.py
- data.py
- dropout.py
- embedding.py
- index_slice_join_mutate.py
- linear.py
- loss.py
- misc.py
- normalization.py
- optim.py
- output.py
- pointwise.py
- pooling.py
- prof.py
- randomSample.py
- recurrentCell.py
- reduction.py
- softmax.py
- usage.py
- utility.py
- __init__.py
- FAQs.md
- README.md
- __init__.py
- README.md
- reparameterization.py
- weight_norm.py
- __init__.py
- cells.py
- models.py
- README.md
- RNNBackend.py
- __init__.py
- amp_C_frontend.cpp
- compat.h
- flatten_unflatten.cpp
- layer_norm_cuda.cpp
- layer_norm_cuda_kernel.cu
- multi_tensor_adam.cu
- multi_tensor_apply.cuh
- multi_tensor_axpby_kernel.cu
- multi_tensor_l2norm_kernel.cu
- multi_tensor_lamb.cu
- multi_tensor_lamb_stage_1.cu
- multi_tensor_lamb_stage_2.cu
- multi_tensor_novograd.cu
- multi_tensor_scale_kernel.cu
- multi_tensor_sgd_kernel.cu
- syncbn.cpp
- type_shim.h
- welford.cu
- pytorch_theme.css
- nv-pytorch2.png
- layout.html
- advanced.rst
- amp.rst
- conf.py
- fp16_utils.rst
- index.rst
- layernorm.rst
- optimizers.rst
- parallel.rst
- Makefile
- main_amp.py
- README.md
- Dockerfile
- README.md
- main_amp.py
- README.md
- distributed_data_parallel.py
- README.md
- run.sh
- README.md
- amp_master_params.py
- compare.py
- run.sh
- ddp_race_condition_test.py
- run_race_test.sh
- python_single_gpu_unit_test.py
- single_gpu_unit_test.py
- test_batchnorm1d.py
- test_groups.py
- two_gpu_unit_test.py
- unit_test.sh
- run.sh
- __init__.py
- test_add_param_group.py
- test_basic_casts.py
- test_cache.py
- test_checkpointing.py
- test_fused_sgd.py
- test_multi_tensor_axpby.py
- test_multi_tensor_l2norm.py
- test_multi_tensor_scale.py
- test_multiple_models_optimizers_losses.py
- test_promotion.py
- test_rnn.py
- utils.py
- __init__.py
- test_fp16util.py
- test_fused_layer_norm.py
- __init__.py
- test_adam.py
- __init__.py
- test_pyprof_nvtx.py
- run_test.py
- compare.py
- main_amp.py
- run_test.sh
- run.sh
- run.sh
- .gitmodules
- .nojekyll
- LICENSE
- README.md
- requirements.txt
- setup.py
- bert-base-uncased_weight_name.json
- ctrl_lxmert.json
- ctrl_muniter_base.json
- ctrl_uniter_base.json
- ctrl_vilbert_base.json
- ctrl_visualbert_base.json
- ctrl_vl-bert_base.json
- ctrl_xuniter_base.json
- lxmert.json
- m3p_base.json
- original_lxmert.json
- uc2_base.json
- vilbert_base.json
- vl-bert_base.json
- all_trainval_tasks.yml
- cross-modal-ablation_test_tasks.yml
- ctrl_test_tasks.yml
- ctrl_trainval_tasks.yml
- iglue_fewshot_tasks_boxes36.yml
- iglue_fewshot_tasks_X101.yml
- iglue_test_tasks_boxes36.yml
- iglue_test_tasks_X101.yml
- iglue_trainval_tasks_boxes36.yml
- iglue_trainval_tasks_X101.yml
- lxmert_test_tasks.yml
- lxmert_trainval_tasks.yml
- vilbert_test_tasks.yml
- vilbert_trainval_tasks.yml
- vl-bert_test_tasks.yml
- vl-bert_trainval_tasks.yml
- convert_lxmert.py
- convert_uc2.py
- m3p.json
- m3p_body2volta.json
- M3P_volta.ipynb
- download_data.py
- extract_cc_image.py
- merge_cc_image.py
- preprocess_cc_train.py
- preprocess_cc_train.sh
- preprocess_cc_valid.py
- preprocess_cc_valid.sh
- README.md
- train_ids.txt
- valid_ids.txt
- convert_flickr30k_lmdb.py
- convert_flickr30k_lmdb.sh
- download_captions.sh
- extract_captions.py
- extract_captions.sh
- extract_flickr30k_image.py
- merge_flickr30k_image.py
- README.md
- convert_vg_gqa_lmdb.py
- convert_vg_gqa_lmdb.sh
- extract_vg_gqa_image.py
- merge_vg_gqa_image.py
- README.md
- convert_coco_lmdb.py
- convert_coco_lmdb.sh
- download_data.sh
- extract_captions.py
- extract_captions.sh
- extract_coco_image.py
- merge_coco_image.py
- README.md
- test1k_ids.txt
- convert_nlvr2_lmdb.py
- convert_nlvr2_lmdb.sh
- download_captions.sh
- extract_nlvr2_image.py
- merge_nlvr2_image.py
- README.md
- convert_refcoco+_unc_dets36_lmdb.py
- convert_refcoco+_unc_dets36_lmdb.sh
- download_data.sh
- extract_refcoco+_unc_dets36_image.py
- merge_refcoco+_unc_dets36_image.py
- README.md
- select_regions.py
- select_regions.sh
- convert_refcoco_unc_dets36_lmdb.py
- convert_refcoco_unc_dets36_lmdb.sh
- download_data.sh
- extract_refcoco_unc_dets36_image.py
- merge_refcoco_unc_dets36_image.py
- README.md
- select_regions.py
- select_regions.sh
- convert_refcocog_umd_dets36_lmdb.py
- convert_refcocog_umd_dets36_lmdb.sh
- download_data.sh
- extract_refcocog_umd_dets36_image.py
- merge_refcocog_umd_dets36_image.py
- README.md
- select_regions.py
- select_regions.sh
- .gitkeep
- README.md
- README.md
- README.md
- val.sh
- val.sh
- val.sh
- val.sh
- val.sh
- val.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.1e-4.log.old
- test.1e-5.log.old
- test.5e-5.log.old
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.dtu.sh
- train.dtu.sh
- test.en.dtu.sh
- test.id.dtu.sh
- test.id_mt.dtu.sh
- test.sw.dtu.sh
- test.sw_mt.dtu.sh
- test.ta.dtu.sh
- test.ta_mt.dtu.sh
- test.tr.dtu.sh
- test.tr_mt.dtu.sh
- test.zh.dtu.sh
- test.zh_mt.dtu.sh
- train.dtu.sh
- test.ar.dtu.sh
- test.ar_mt.dtu.sh
- test.bg.dtu.sh
- test.bg_mt.dtu.sh
- test.da.dtu.sh
- test.da_mt.dtu.sh
- test.el.dtu.sh
- test.el_mt.dtu.sh
- test.en.dtu.sh
- test.et.dtu.sh
- test.et_mt.dtu.sh
- test.id.dtu.sh
- test.id_mt.dtu.sh
- test.ja.dtu.sh
- test.ja_mt.dtu.sh
- test.ko.dtu.sh
- test.ko_mt.dtu.sh
- test.tr.dtu.sh
- test.tr_mt.dtu.sh
- test.vi.dtu.sh
- test.vi_mt.dtu.sh
- train.dtu.sh
- test.de.dtu.sh
- test.de_mt.dtu.sh
- test.en.dtu.sh
- test.es.dtu.sh
- test.es_mt.dtu.sh
- test.id.dtu.sh
- test.id_mt.dtu.sh
- test.ja.dtu.sh
- test.ja_mt.dtu.sh
- test.ru.dtu.sh
- test.ru_mt.dtu.sh
- test.tr.dtu.sh
- test.tr_mt.dtu.sh
- test.zh.dtu.sh
- test.zh_mt.dtu.sh
- train.dtu.sh
- test.bn.dtu.sh
- test.bn_mt.dtu.sh
- test.de.dtu.sh
- test.de_mt.dtu.sh
- test.en.dtu.sh
- test.id.dtu.sh
- test.id_mt.dtu.sh
- test.ko.dtu.sh
- test.ko_mt.dtu.sh
- test.pt.dtu.sh
- test.pt_mt.dtu.sh
- test.ru.dtu.sh
- test.ru_mt.dtu.sh
- test.zh.dtu.sh
- test.zh_mt.dtu.sh
- train.dtu.sh
- test.ar.dtu.sh
- test.ar_mt.dtu.sh
- test.en.dtu.sh
- test.es.dtu.sh
- test.es_mt.dtu.sh
- test.fr.dtu.sh
- test.fr_mt.dtu.sh
- test.ru.dtu.sh
- test.ru_mt.dtu.sh
- train.dtu.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- train.sh
- test.sh
- train.sh
- test.sh
- train.sh
- flickr30k_boxes36_h5-proposal.py
- flickr30k_boxes36_h5-proposal.sh
- flickr30k_boxes36_h5-to-lmdb.sh
- flickr30k_resnext101_npy-proposal.sh
- flickr30k_resnext101_npy-to-lmdb.sh
- gqa-train_boxes36_h5-to-tdlmdb.sh
- gqa-train_resnext101_h5-to-tdlmdb.sh
- gqa-valid_boxes36_h5-to-tdlmdb.sh
- gqa-valid_resnext101_h5-to-tdlmdb.sh
- gqa_boxes36_h5-to-tdlmdb.py
- gqa_resnext101_npy-proposal.sh
- gqa_resnext101_npy-to-lmdb.sh
- gqa_resnext101_npy-to-tdlmdb.py
- marvl-fewshot_boxes36_h5-proposal.ku.cluster
- marvl-fewshot_boxes36_h5-proposal.sh
- marvl-fewshot_boxes36_h5-to-lmdb.sh
- marvl-fewshot_resnext101_npy-proposal.ku.cluster
- marvl-fewshot_resnext101_npy-proposal.sh
- marvl-fewshot_resnext101_npy-to-lmdb.sh
- marvl_boxes36_h5-proposal.py
- marvl_boxes36_h5-proposal.sh
- marvl_boxes36_h5-to-lmdb.sh
- marvl_resnext101_npy-proposal.ku.cluster
- marvl_resnext101_npy-proposal.sh
- marvl_resnext101_npy-to-lmdb.sh
- nlvr2_boxes36_h5-proposal.py
- nlvr2_boxes36_h5-proposal.sh
- nlvr2_boxes36_h5-to-lmdb.sh
- nlvr2_resnext101_npy-proposal.sh
- nlvr2_resnext101_npy-to-lmdb.sh
- wit-test_boxes36_h5-proposal.py
- wit-test_boxes36_h5-proposal.sh
- wit-test_boxes36_h5-proposal.slurm
- wit-test_boxes36_h5-to-lmdb.sh
- wit-test_resnext101_npy-proposal.sh
- wit-test_resnext101_npy-proposal.slurm
- wit-test_resnext101_npy-to-lmdb.sh
- wit-train_boxes36_h5-to-tdlmdb.sh
- wit-train_resnext101_npy-to-tdlmdb.sh
- wit-trainval_boxes36_h5-proposal.py
- wit-trainval_boxes36_h5-proposal.sh
- wit-trainval_boxes36_h5-proposal.slurm
- wit-trainval_boxes36_h5-to-tdlmdb.py
- wit-trainval_resnext101_npy-proposal.sh
- wit-trainval_resnext101_npy-proposal.slurm
- wit-trainval_resnext101_npy-to-tdlmdb.py
- wit-val_boxes36_h5-to-tdlmdb.sh
- wit-val_resnext101_npy-to-tdlmdb.sh
- xflickrco_boxes36_h5-proposal.py
- xflickrco_boxes36_h5-proposal.sh
- xflickrco_boxes36_h5-to-lmdb.sh
- xflickrco_resnext101_npy-proposal.sh
- xflickrco_resnext101_npy-to-lmdb.sh
- config.yml
- bug-report.md
- config.yml
- feature-request.md
- questions-help-support.md
- unexpected-problems.md
- cpu_test.yaml
- deploy_website.yaml
- linter_test.yaml
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- PULL_REQUEST_TEMPLATE.md
- customize.css
- chevron-right-orange.svg
- chevron_blue.svg
- favicon.png
- logo_icon.svg
- mmf_logo.png
- mmf_logo.svg
- mmf_logo_white_f.svg
- search_icon.svg
- view-page-source-icon.svg
- ga.js
- redirect.js
- layout.html
- theme_variables.jinja
- conf.py
- index.rst
- .gitignore
- license_header.txt
- Makefile
- requirements.txt
- gason.cpp
- gason.h
- maskApi.c
- maskApi.h
- coco-scm-1.rockspec
- CocoApi.lua
- cocoDemo.lua
- env.lua
- init.lua
- MaskApi.lua
- gasonMex.cpp
- gasonMex.mexa64
- gasonMex.mexmaci64
- getPrmDflt.m
- CocoApi.m
- cocoDemo.m
- CocoEval.m
- CocoUtils.m
- evalDemo.m
- gason.m
- MaskApi.m
- __init__.py
- _mask.pyx
- coco.py
- cocoeval.py
- mask.py
- Makefile
- pycocoDemo.ipynb
- pycocoEvalDemo.ipynb
- setup.py
- .gitignore
- .travis.yml
- license.txt
- README.txt
- bug-report.md
- feature-request.md
- questions-help-support.md
- e2e_faster_rcnn_R_101_FPN_1x_caffe2.yaml
- e2e_faster_rcnn_R_50_C4_1x_caffe2.yaml
- e2e_faster_rcnn_R_50_FPN_1x_caffe2.yaml
- e2e_faster_rcnn_X_101_32x8d_FPN_1x_caffe2.yaml
- e2e_mask_rcnn_R_101_FPN_1x_caffe2.yaml
- e2e_mask_rcnn_R_50_C4_1x_caffe2.yaml
- e2e_mask_rcnn_R_50_FPN_1x_caffe2.yaml
- e2e_mask_rcnn_X_101_32x8d_FPN_1x_caffe2.yaml
- e2e_faster_rcnn_R_50_FPN_1x_cocostyle.yaml
- e2e_mask_rcnn_R_50_FPN_1x_cocostyle.yaml
- e2e_faster_rcnn_R_50_C4_1x_1_gpu_voc.yaml
- e2e_faster_rcnn_R_50_C4_1x_4_gpu_voc.yaml
- e2e_mask_rcnn_R_50_FPN_1x_cocostyle.yaml
- e2e_faster_rcnn_R_50_C4_quick.yaml
- e2e_faster_rcnn_R_50_FPN_quick.yaml
- e2e_faster_rcnn_X_101_32x8d_FPN_quick.yaml
- e2e_mask_rcnn_R_50_C4_quick.yaml
- e2e_mask_rcnn_R_50_FPN_quick.yaml
- e2e_mask_rcnn_X_101_32x8d_FPN_quick.yaml
- rpn_R_50_C4_quick.yaml
- rpn_R_50_FPN_quick.yaml
- modified_for_conversion_e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_vqa_single.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_test.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_train.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_vqa_test.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_vqa_train.yaml
- e2e_faster_rcnn_X-101-64x4d-FPN_1x_MLP_2048_FPN_512_vqa_val.yaml
- e2e_faster_rcnn_X-152-32x8d-FPN_1x_MLP_2048_FPN_512_test.yaml
- e2e_faster_rcnn_X-152-32x8d-FPN_1x_MLP_2048_FPN_512_train.yaml
- e2e_faster_rcnn_R_101_FPN_1x.yaml
- e2e_faster_rcnn_R_50_C4_1x.yaml
- e2e_faster_rcnn_R_50_FPN_1x.yaml
- e2e_faster_rcnn_X_101_32x8d_FPN_1x.yaml
- e2e_mask_rcnn_R_101_FPN_1x.yaml
- e2e_mask_rcnn_R_50_C4_1x.yaml
- e2e_mask_rcnn_R_50_FPN_1x.yaml
- e2e_mask_rcnn_X_101_32x8d_FPN_1x.yaml
- demo_e2e_mask_rcnn_R_50_FPN_1x.png
- demo_e2e_mask_rcnn_X_101_32x8d_FPN_1x.png
- predictor.py
- README.md
- webcam.py
- Dockerfile
- jupyter_notebook_config.py
- Dockerfile
- __init__.py
- defaults.py
- paths_catalog.py
- nms_cpu.cpp
- ROIAlign_cpu.cpp
- vision.h
- nms.cu
- ROIAlign_cuda.cu
- ROIPool_cuda.cu
- vision.h
- nms.h
- ROIAlign.h
- ROIPool.h
- vision.cpp
- __init__.py
- inference.py
- trainer.py
- __init__.py
- _utils.py
- batch_norm.py
- misc.py
- nms.py
- roi_align.py
- roi_pool.py
- smooth_l1_loss.py
- __init__.py
- backbone.py
- fpn.py
- resnet.py
- __init__.py
- detectors.py
- generalized_rcnn.py
- __init__.py
- box_head.py
- inference.py
- loss.py
- roi_box_feature_extractors.py
- roi_box_predictors.py
- __init__.py
- inference.py
- loss.py
- mask_head.py
- roi_mask_feature_extractors.py
- roi_mask_predictors.py
- __init__.py
- roi_heads.py
- __init__.py
- anchor_generator.py
- inference.py
- loss.py
- rpn.py
- __init__.py
- balanced_positive_negative_sampler.py
- box_coder.py
- matcher.py
- poolers.py
- registry.py
- utils.py
- __init__.py
- build.py
- lr_scheduler.py
- __init__.py
- bounding_box.py
- boxlist_ops.py
- image_list.py
- segmentation_mask.py
- __init__.py
- c2_model_loading.py
- checkpoint.py
- collect_env.py
- comm.py
- env.py
- imports.py
- logger.py
- metric_logger.py
- miscellaneous.py
- model_serialization.py
- model_zoo.py
- README.md
- registry.py
- __init__.py
- checkpoint.py
- test_data_samplers.py
- test_metric_logger.py
- convert_cityscapes_to_coco.py
- instances2dict_with_polygons.py
- c2_to_pt.py
- extract_vqa_feat.py
- test_net.py
- train_net.py
- .flake8
- .gitignore
- ABSTRACTIONS.md
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- create_json.py
- INSTALL.md
- LICENSE
- MODEL_ZOO.md
- README.md
- setup.py
- TROUBLESHOOTING.md
- __init__.py
- batch_collator.py
- constants.py
- dataset_loader.py
- meter.py
- registry.py
- report.py
- sample.py
- test_reporter.py
- typings.py
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- detection.yaml
- masked.yaml
- ocr_en.yaml
- masked.yaml
- defaults.yaml
- masked.yaml
- train_small.yaml
- masked.yaml
- defaults.yaml
- defaults.yaml
- masked.yaml
- attack_vectors.yaml
- defaults.yaml
- hateful_pc_attack.yaml
- pc_attack.yaml
- protected_groups.yaml
- with_features.yaml
- bert.yaml
- defaults.yaml
- with_features.yaml
- masked.yaml
- defaults.yaml
- masked.yaml
- with_features.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- flickr30k_defaults.yaml
- masked.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- with_resnet.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- detection.yaml
- masked.yaml
- defaults.yaml
- defaults.yaml
- masked.yaml
- masked_q.yaml
- train_val.yaml
- with_raw_images.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- concat_bert.yaml
- concat_bow.yaml
- defaults.yaml
- late_fusion.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- classification.yaml
- defaults.yaml
- pretrain.yaml
- with_features.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- with_audio_video.yaml
- defaults.yaml
- defaults.yaml
- bert.yaml
- image.yaml
- text.yaml
- with_features.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- classification.yaml
- defaults.yaml
- pretrain.yaml
- datasets.yaml
- models.yaml
- defaults.yaml
- __init__.py
- builder.py
- dataset.py
- __init__.py
- _utils.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- detection_builder.py
- detection_dataset.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- __init__.py
- builder.py
- dataset.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- database.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- database.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- datasets.py
- __init__.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- database.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- detection_builder.py
- detection_dataset.py
- masked_builder.py
- masked_dataset.py
- __init__.py
- builder.py
- dataset.py
- __init__.py
- builder.py
- dataset.py
- masked_builder.py
- masked_dataset.py
- masked_q_vqa2_builder.py
- masked_q_vqa2_dataset.py
- ocr_builder.py
- ocr_dataset.py
- __init__.py
- builder.py
- database.py
- dataset.py
- __init__.py
- __init__.py
- feature_readers.py
- __init__.py
- annotation_database.py
- features_database.py
- image_database.py
- scene_graph_database.py
- __init__.py
- bert_processors.py
- detection_transforms.py
- frcnn_processor.py
- functional.py
- image_processors.py
- prediction_processors.py
- processors.py
- video_processors.py
- __init__.py
- base_dataset.py
- base_dataset_builder.py
- concat_dataset.py
- iteration_strategies.py
- mmf_dataset.py
- mmf_dataset_builder.py
- multi_datamodule.py
- multi_dataset_loader.py
- subset_dataset.py
- __init__.py
- vit.py
- __init__.py
- mmbt.py
- __init__.py
- huggingface.py
- __init__.py
- itm.py
- mlm.py
- mlp.py
- __init__.py
- base.py
- __init__.py
- backbone.py
- matcher.py
- misc.py
- transformer.py
- unit.py
- unit_base_model.py
- __init__.py
- alignment.py
- ban.py
- base_model.py
- butd.py
- cnn_lstm.py
- frcnn.py
- fusions.py
- krisp.py
- lorra.py
- lxmert.py
- m4c.py
- m4c_captioner.py
- mmbt.py
- mmf_bert.py
- mmf_transformer.py
- movie_mcan.py
- pythia.py
- top_down_bottom_up.py
- unimodal.py
- vilbert.py
- visdial_multi_modal.py
- visual_bert.py
- __init__.py
- attention.py
- bottleneck.py
- decoders.py
- embeddings.py
- encoders.py
- fusions.py
- hf_layers.py
- layers.py
- losses.py
- metrics.py
- optimizers.py
- schedulers.py
- defaults.yaml
- defaults.yaml
- defaults.yaml
- README.md
- beam_search.yaml
- defaults.yaml
- nucleus_sampling.yaml
- beam_search.yaml
- defaults.yaml
- nucleus_sampling.yaml
- beam_search.yaml
- defaults.yaml
- eval_pretrained_coco_model.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- with_features.yaml
- defaults.yaml
- bert.yaml
- image.yaml
- text.yaml
- with_features.yaml
- defaults.yaml
- direct.yaml
- from_cc.yaml
- defaults.yaml
- direct.yaml
- from_coco.yaml
- attack_vectors.yaml
- defaults.yaml
- hateful_pc_attack.yaml
- multilabel.yaml
- pc_attack.yaml
- protected_groups.yaml
- README.md
- README.md
- conceptnet_only.yaml
- dbpedia_only.yaml
- defaults.yaml
- haspart_only.yaml
- okvqav10.yaml
- okvqav10_fromfullpretrain.yaml
- randomgraph.yaml
- train_val.yaml
- train_val_cnonly.yaml
- train_val_dbonly.yaml
- train_val_hponly.yaml
- train_val_okvqav10.yaml
- train_val_okvqav10_fromfullpretrain.yaml
- train_val_random.yaml
- train_val_vgonly.yaml
- visualgenome_only.yaml
- krisp_pretrain.yaml
- okvqa_safe.yaml
- okvqa_safe.yaml
- defaults.yaml
- defaults_v10.yaml
- train_val.yaml
- train_val_okvqav10.yaml
- defaults_okvqasafe.yaml
- graphnetwork_module.py
- README.md
- requirements.txt
- defaults.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- train_val_resnet_only.yaml
- README.md
- masked.yaml
- pretrain.yaml
- masked.yaml
- pretrain.yaml
- masked.yaml
- pretrain.yaml
- defaults.yaml
- masked.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- joint_with_stvqa.yaml
- ocr_ml.yaml
- __init__.py
- extract_ocr_frcn_feature.py
- README.md
- beam_search.yaml
- defaults.yaml
- eval_pretrained_coco_model.yaml
- defaults.yaml
- eval_on_textcaps.yaml
- defaults.yaml
- joint_with_coco.yaml
- with_caffe2_feat.yaml
- without_ocr.yaml
- __init__.py
- coco_eval.py
- textcaps_eval.py
- README.md
- defaults.yaml
- with_features.yaml
- defaults.yaml
- defaults.yaml
- with_features.yaml
- with_images.yaml
- with_raw_images.yaml
- README.md
- masked_coco.yaml
- direct.yaml
- defaults.yaml
- defaults.yaml
- pretrain_itm.yaml
- defaults.yaml
- defaults.yaml
- masked.yaml
- defaults.yaml
- e2e.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_joint_vqa2.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- bert.yaml
- image.yaml
- text.yaml
- with_features.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- ten_pc.yaml
- defaults.yaml
- full.yaml
- full_coco_generated.yaml
- half.yaml
- half_coco_generated.yaml
- small.yaml
- small_coco_generated.yaml
- small_fifty_pc.yaml
- small_ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- full_train_val.yaml
- ten_pc.yaml
- defaults.yaml
- full.yaml
- full_coco_generated.yaml
- half.yaml
- half_coco_generated.yaml
- small.yaml
- small_coco_generated.yaml
- small_fifty_pc.yaml
- small_ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- full_train_val.yaml
- ten_pc.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- 12k_iterations_without_resnet.yaml
- debug.yaml
- defaults.yaml
- resnet_only.yaml
- train_val.yaml
- train_val_resnet_only.yaml
- README.md
- separate_dec.yaml
- shared_dec.yaml
- shared_dec_without_task_embedding.yaml
- single_task.yaml
- single_task_without_task_embedding.yaml
- separate_dec.yaml
- shared_dec.yaml
- separate_dec.yaml
- shared_dec.yaml
- single_task.yaml
- separate_dec.yaml
- shared_dec.yaml
- single_task.yaml
- visual_entailment_dataset_cfg.yaml
- vqa2_dataset_cfg.yaml
- README.md
- defaults.yaml
- direct.yaml
- from_cc.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- README.md
- defaults.yaml
- defaults.yaml
- direct.yaml
- from_coco.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- defaults.yaml
- train_val.yaml
- defaults.yaml
- train_val.yaml
- with_raw_images.yaml
- README.md
- __init__.py
- base.py
- checkpoint.py
- early_stopping.py
- logistics.py
- lr_scheduler.py
- __init__.py
- callback_hook.py
- device.py
- evaluation_loop.py
- profiling.py
- training_loop.py
- __init__.py
- loop_callback.py
- __init__.py
- base_trainer.py
- lightning_trainer.py
- mmf_trainer.py
- __init__.py
- visualizing_image.py
- cphoc.c
- __init__.py
- build_phoc.py
- __init__.py
- box_ops.py
- build.py
- checkpoint.py
- checkpoint_updater.py
- configuration.py
- dataset.py
- distributed.py
- download.py
- early_stopping.py
- env.py
- file_io.py
- flags.py
- general.py
- inference.py
- logger.py
- m4c_evaluators.py
- modeling.py
- patch.py
- process_answers.py
- text.py
- timer.py
- torchscript.py
- transform.py
- visualize.py
- vocab.py
- xla.py
- __init__.py
- version.py
- __init__.py
- hm_convert.py
- interactive.py
- predict.py
- run.py
- defaults.yaml
- defaults.yaml
- defaults.yaml
- README.md
- beam_search.yaml
- defaults.yaml
- nucleus_sampling.yaml
- beam_search.yaml
- defaults.yaml
- nucleus_sampling.yaml
- beam_search.yaml
- defaults.yaml
- eval_pretrained_coco_model.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- with_features.yaml
- defaults.yaml
- bert.yaml
- image.yaml
- text.yaml
- with_features.yaml
- defaults.yaml
- direct.yaml
- from_cc.yaml
- defaults.yaml
- direct.yaml
- from_coco.yaml
- attack_vectors.yaml
- defaults.yaml
- hateful_pc_attack.yaml
- multilabel.yaml
- pc_attack.yaml
- protected_groups.yaml
- README.md
- README.md
- conceptnet_only.yaml
- dbpedia_only.yaml
- defaults.yaml
- haspart_only.yaml
- okvqav10.yaml
- okvqav10_fromfullpretrain.yaml
- randomgraph.yaml
- train_val.yaml
- train_val_cnonly.yaml
- train_val_dbonly.yaml
- train_val_hponly.yaml
- train_val_okvqav10.yaml
- train_val_okvqav10_fromfullpretrain.yaml
- train_val_random.yaml
- train_val_vgonly.yaml
- visualgenome_only.yaml
- krisp_pretrain.yaml
- okvqa_safe.yaml
- okvqa_safe.yaml
- defaults.yaml
- defaults_v10.yaml
- train_val.yaml
- train_val_okvqav10.yaml
- defaults_okvqasafe.yaml
- graphnetwork_module.py
- README.md
- requirements.txt
- defaults.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- train_val_resnet_only.yaml
- README.md
- masked.yaml
- pretrain.yaml
- masked.yaml
- pretrain.yaml
- masked.yaml
- pretrain.yaml
- defaults.yaml
- masked.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- joint_with_stvqa.yaml
- ocr_ml.yaml
- __init__.py
- extract_ocr_frcn_feature.py
- README.md
- beam_search.yaml
- defaults.yaml
- eval_pretrained_coco_model.yaml
- defaults.yaml
- eval_on_textcaps.yaml
- defaults.yaml
- joint_with_coco.yaml
- with_caffe2_feat.yaml
- without_ocr.yaml
- __init__.py
- coco_eval.py
- textcaps_eval.py
- README.md
- defaults.yaml
- with_features.yaml
- defaults.yaml
- defaults.yaml
- with_features.yaml
- with_images.yaml
- with_raw_images.yaml
- README.md
- masked_coco.yaml
- direct.yaml
- defaults.yaml
- defaults.yaml
- pretrain_itm.yaml
- defaults.yaml
- defaults.yaml
- masked.yaml
- defaults.yaml
- e2e.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_joint_vqa2.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- bert.yaml
- image.yaml
- text.yaml
- with_features.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- ten_pc.yaml
- defaults.yaml
- full.yaml
- full_coco_generated.yaml
- half.yaml
- half_coco_generated.yaml
- small.yaml
- small_coco_generated.yaml
- small_fifty_pc.yaml
- small_ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- full_train_val.yaml
- ten_pc.yaml
- defaults.yaml
- full.yaml
- full_coco_generated.yaml
- half.yaml
- half_coco_generated.yaml
- small.yaml
- small_coco_generated.yaml
- small_fifty_pc.yaml
- small_ten_pc.yaml
- defaults.yaml
- fifty_pc.yaml
- full.yaml
- full_train_val.yaml
- ten_pc.yaml
- README.md
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- 12k_iterations_without_resnet.yaml
- debug.yaml
- defaults.yaml
- resnet_only.yaml
- train_val.yaml
- train_val_resnet_only.yaml
- README.md
- separate_dec.yaml
- shared_dec.yaml
- shared_dec_without_task_embedding.yaml
- single_task.yaml
- single_task_without_task_embedding.yaml
- separate_dec.yaml
- shared_dec.yaml
- separate_dec.yaml
- shared_dec.yaml
- single_task.yaml
- separate_dec.yaml
- shared_dec.yaml
- single_task.yaml
- visual_entailment_dataset_cfg.yaml
- vqa2_dataset_cfg.yaml
- README.md
- defaults.yaml
- direct.yaml
- from_cc.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- README.md
- defaults.yaml
- defaults.yaml
- direct.yaml
- from_coco.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- pretrain.yaml
- pretrain_train_val.yaml
- defaults.yaml
- pretrain.yaml
- defaults.yaml
- defaults.yaml
- train_val.yaml
- defaults.yaml
- train_val.yaml
- defaults.yaml
- train_val.yaml
- with_raw_images.yaml
- README.md
- __init__.py
- test_batch_collator.py
- test_meter.py
- test_report.py
- test_sample.py
- __init__.py
- test_configs_for_keys.py
- test_zoo_urls.py
- always_one.yaml
- experiment.yaml
- simple.yaml
- __init__.py
- always_one.py
- __init__.py
- simple.py
- __init__.py
- vocab.txt
- __init__.py
- test_base_dataset.py
- test_bert_processors.py
- test_iteration_strategies.py
- test_mmf_dataset_builder.py
- test_multi_datamodule.py
- test_multi_dataset_loader.py
- test_prediction_processors.py
- test_processors.py
- __init__.py
- test_interfaces.py
- __init__.py
- test_heads.py
- __init__.py
- test_albef.py
- test_cnn_lstm.py
- test_mmbt.py
- test_mmf_transformer.py
- test_vilbert.py
- test_visual_bert.py
- __init__.py
- test_encoders.py
- test_fusions.py
- test_layers.py
- test_losses.py
- test_metrics.py
- test_optimizers.py
- __init__.py
- test_logistics.py
- test_lr_scheduler.py
- test_user_callback.py
- __init__.py
- lightning_trainer_mock.py
- test_checkpoint.py
- test_grad_accumulate.py
- test_grad_clipping.py
- test_logging.py
- test_loop_conditions.py
- test_loss.py
- test_lr_schedule.py
- test_validation.py
- __init__.py
- test_device.py
- test_eval_loop.py
- test_fp16.py
- test_sharded_ddp.py
- test_trainer_mocks.py
- test_training_loop.py
- test_utils.py
- __init__.py
- test_checkpoint.py
- test_configuration.py
- test_distributed.py
- test_download.py
- test_env.py
- test_file_io.py
- test_general.py
- test_logger.py
- test_model.py
- test_quality_checks.py
- test_text.py
- test_timer.py
- test_visualize.py
- __init__.py
- conftest.py
- test_utils.py
- extract_bert.sh
- extract_bert_embeddings.py
- coco_caption_eval.py
- extract_features_frcnn.py
- frcnn_utils.py
- modeling_frcnn.py
- processing_image.py
- extract.sh
- extract_features_vmb.py
- extract_features_vmb_wit-test.py
- extract_features_vmb_wit.py
- extract_resnet152_feat.py
- extraction_utils.py
- lmdb_conversion.py
- convert_gqa_to_vqa.py
- extract_vocabulary.py
- README.md
- generate_test_data.py
- build_imdb.py
- extract_vocabulary.py
- __init__.py
- README.md
- sweep_visual_bert.py
- __init__.py
- hateful_memes_challenge.md
- textvqa_challenge.md
- vqa_challenge.md
- faqs.md
- features.md
- installation.mdx
- quickstart.md
- video_overview.md
- concepts.md
- configuration.md
- dataset_zoo.md
- logging.md
- model_zoo.md
- pretrained_models.md
- projects.md
- training_tricks.md
- butd.md
- m4c.md
- m4c_captioner.md
- movie_mcan.md
- unit.md
- checkpointing.md
- concat_bert_tutorial.md
- dataset.md
- image_feature_extraction.md
- losses.md
- metrics.md
- processors.md
- slurm.md
- custom.css
- index.js
- index.js
- styles.module.css
- config.yml
- banner_logo.svg
- boilerplate.svg
- boilerplate_white.svg
- favicon.png
- logo.png
- logo.svg
- logo_white_f.png
- logo_white_f.svg
- logo_white_text.svg
- oss_logo.png
- puzzle_pieces.svg
- puzzle_pieces_white.svg
- pytorch_logo.svg
- pytorch_logo_white.svg
- undraw_docusaurus_react.svg
- undraw_docusaurus_tree.svg
- .nojekyll
- CNAME
- .eslintignore
- .eslintrc.js
- .gitignore
- .prettierignore
- .prettierrc
- .stylelintrc.js
- build_docs.sh
- docusaurus.config.js
- package.json
- README.md
- sidebars.js
- yarn.lock
- .editorconfig
- .flake8
- .gitignore
- .pre-commit-config.yaml
- detectron_model.yaml
- img_tensor.pkl
- LICENSE
- MANIFEST.in
- NOTICES
- pyproject.toml
- README.md
- requirements.txt
- setup.py
- config.yml
- feature-request.md
- questions-help-support.md
- unexpected-problems-bugs.md
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- Detectron2-Logo-Horz.svg
- ISSUE_TEMPLATE.md
- pull_request_template.md
- mask_rcnn_R_50_FPN.yaml
- fast_rcnn_R_50_FPN_1x.yaml
- faster_rcnn_R_101_C4_3x.yaml
- faster_rcnn_R_101_DC5_3x.yaml
- faster_rcnn_R_101_FPN_3x.yaml
- faster_rcnn_R_50_C4_1x.yaml
- faster_rcnn_R_50_C4_3x.yaml
- faster_rcnn_R_50_DC5_1x.yaml
- faster_rcnn_R_50_DC5_3x.yaml
- faster_rcnn_R_50_FPN_1x.yaml
- faster_rcnn_R_50_FPN_3x.yaml
- faster_rcnn_X_101_32x8d_FPN_3x.yaml
- retinanet_R_101_FPN_3x.yaml
- retinanet_R_50_FPN_1x.yaml
- retinanet_R_50_FPN_3x.yaml
- rpn_R_50_C4_1x.yaml
- rpn_R_50_FPN_1x.yaml
- mask_rcnn_R_101_C4_3x.yaml
- mask_rcnn_R_101_DC5_3x.yaml
- mask_rcnn_R_101_FPN_3x.yaml
- mask_rcnn_R_50_C4_1x.yaml
- mask_rcnn_R_50_C4_3x.yaml
- mask_rcnn_R_50_DC5_1x.yaml
- mask_rcnn_R_50_DC5_3x.yaml
- mask_rcnn_R_50_FPN_1x.yaml
- mask_rcnn_R_50_FPN_3x.yaml
- mask_rcnn_X_101_32x8d_FPN_3x.yaml
- Base-Keypoint-RCNN-FPN.yaml
- keypoint_rcnn_R_101_FPN_3x.yaml
- keypoint_rcnn_R_50_FPN_1x.yaml
- keypoint_rcnn_R_50_FPN_3x.yaml
- keypoint_rcnn_X_101_32x8d_FPN_3x.yaml
- Base-Panoptic-FPN.yaml
- panoptic_fpn_R_101_3x.yaml
- panoptic_fpn_R_50_1x.yaml
- panoptic_fpn_R_50_3x.yaml
- README.md
- Base-RCNN-C4.yaml
- Base-RCNN-DilatedC5.yaml
- Base-RCNN-FPN.yaml
- Base-RetinaNet.yaml
- .clang-format
- .flake8
- .gitignore
- GETTING_STARTED.md
- INSTALL.md
- LICENSE
- MODEL_ZOO.md
- README.md
- detectron2_given_box_maxnms.py
- detectron2_proposal_maxnms.py
- h5_to_lmdb.py
- h5_to_td-lmdb.py
- large_tsv_to_h5.py
- npy_to_lmdb.py
- README.md
- .gitignore
- ablate_lang4vis.py
- ablate_vis4lang.py
- eval_retrieval.py
- eval_task.py
- LICENSE
- MODELS.md
- README.md
- ViLBERT_VOLTA.png
# Installation Guide
git clone https://github.com/e-bug/volta
Downloads the entire project code from GitHub to your computer.
cd volta
Moves into the project folder you just downloaded.
2. Docker
Easy Recommended- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -f features_extraction/mmf/github/vqa-maskrcnn-benchmark/docker/Dockerfile -t volta .
Builds a runnable image based on the Dockerfile.
docker run -p 8080:80 volta
Runs the built image as an actual container.
3. Python
Easypip install -r requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
Pulled directly from this repo's README.
4. Make
Medium- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
cd features_extraction/mmf/github/cocoapi/PythonAPI
This project's files live in a subfolder, so move into it first.
make
Compiles the code based on the generated build configuration to produce an executable.
