Implicit-LVM
This code repository presents the pytorch implementation of the paper “Implicit Deep Latent Variable Models for Text Generation”(EMNLP 2019).
File Explorer
Download Latest Version (.zip)- parser.py
- readme.txt
- test.act.txt
- test.emotion.txt
- test.utts.txt
- train.act.txt
- train.emotion.txt
- train.utts.txt
- valid.act.txt
- valid.emotion.txt
- valid.utts.txt
- data.py
- DialogWAE_models_dailydial.py
- DialogWAE_train_dailydial.py
- models_dailydial.py
- train_dailydial.py
- utils_dailydial.py
- test.jsonl
- train.jsonl
- valid.jsonl
- full_swda_clean_42da_sentiment_dialog_corpus.p
- test_multi_ref.json
- data.py
- DialogWAE_models_swda.py
- DialogWAE_train_swda.py
- models_swda.py
- train_swda.py
- utils_swda.py
- test.txt
- train.txt
- val.txt
- .DS_Store
- data.py
- generative_model.py
- interpolation.py
- models_ptb.py
- optim_n2n.py
- preprocess_ptb.py
- train_ptb.py
- train_ptb_ae.py
- train_ptb_vaes.py
- utils_ptb.py
- test.txt
- train.txt
- val.txt
- .DS_Store
- data.py
- models_yahoo.py
- preprocess_yahoo.py
- train_yahoo.py
- readme.txt
- yelp.test.txt
- yelp.train.txt
- yelp.valid.txt
- .DS_Store
- data.py
- models_yelp.py
- train_yelp.py
- train_yelp_ae.py
- train_yelp_vaes.py
- utils_yelp.py
- EMNLP2019_iVAE.png
- 000000.png
- 005000.png
- 010000.png
- 015000.png
- 020000.png
- 025000.png
- 030000.png
- 035000.png
- 040000.png
- 045000.png
- 050000.png
- 055000.png
- 060000.png
- 065000.png
- 070000.png
- 075000.png
- 080000.png
- 000000.png
- 005000.png
- 010000.png
- 015000.png
- 020000.png
- 025000.png
- 030000.png
- 035000.png
- 040000.png
- 045000.png
- 050000.png
- 055000.png
- 060000.png
- 065000.png
- 070000.png
- 075000.png
- 080000.png
- models_onehot.py
- train_onehot.py
- utils_onehot.py
- vae_onehot.py
- data.txt
- README.txt
- test.txt
- test0.txt
- test1.txt
- train0.txt
- train1.txt
- valid0.txt
- valid1.txt
- FindEigen3.cmake
- KenLMFunctions.cmake
- adjust_counts.hh
- corpus_count.hh
- discount.hh
- hash_gamma.hh
- header_info.hh
- initial_probabilities.hh
- interpolate.hh
- joint_order.hh
- ngram.hh
- ngram_stream.hh
- output.hh
- pipeline.hh
- print.hh
- sort.hh
- arpa_io.hh
- count_io.hh
- format.hh
- phrase.hh
- thread.hh
- vocab.hh
- wrapper.hh
- arpa_to_stream.hh
- wordvecs.hh
- nplm.hh
- bhiksha.hh
- binary_format.hh
- blank.hh
- config.hh
- enumerate_vocab.hh
- facade.hh
- left.hh
- lm_exception.hh
- max_order.hh
- model.hh
- model_type.hh
- ngram_query.hh
- partial.hh
- quantize.hh
- read_arpa.hh
- return.hh
- search_hashed.hh
- search_trie.hh
- sizes.hh
- state.hh
- trie.hh
- trie_sort.hh
- value.hh
- value_build.hh
- virtual_interface.hh
- vocab.hh
- weights.hh
- word_index.hh
- block.hh
- chain.hh
- config.hh
- io.hh
- line_input.hh
- multi_progress.hh
- multi_stream.hh
- sort.hh
- stream.hh
- timer.hh
- bit_packing.hh
- ersatz_progress.hh
- exception.hh
- fake_ofstream.hh
- file.hh
- file_piece.hh
- fixed_array.hh
- getopt.hh
- have.hh
- joint_sort.hh
- mmap.hh
- multi_intersection.hh
- murmur_hash.hh
- parallel_read.hh
- pcqueue.hh
- pool.hh
- probing_hash_table.hh
- proxy_iterator.hh
- read_compressed.hh
- scoped.hh
- sized_iterator.hh
- sorted_uniform.hh
- string_piece.hh
- string_piece_hash.hh
- thread_pool.hh
- tokenize_piece.hh
- unistd.hh
- usage.hh
- adjust_counts.cc
- adjust_counts.hh
- adjust_counts_test.cc
- CMakeLists.txt
- combine_counts.hh
- corpus_count.cc
- corpus_count.hh
- corpus_count_test.cc
- count_ngrams_main.cc
- debug_print.hh
- discount.hh
- dump_counts_main.cc
- hash_gamma.hh
- header_info.hh
- initial_probabilities.cc
- initial_probabilities.hh
- interpolate.cc
- interpolate.hh
- lmplz_main.cc
- output.cc
- output.hh
- payload.hh
- pipeline.cc
- pipeline.hh
- README.md
- TODO
- generate.sh
- toy0.1
- toy0.2
- toy0.3
- toy0.arpa
- toy0.kenlm_intermediate
- toy0.vocab
- toy1.1
- toy1.2
- toy1.3
- toy1.arpa
- toy1.kenlm_intermediate
- toy1.vocab
- CMakeLists.txt
- compare.hh
- joint_order.hh
- model_buffer.cc
- model_buffer.hh
- model_buffer_test.cc
- ngram.hh
- ngram_stream.hh
- print.cc
- print.hh
- renumber.cc
- renumber.hh
- size_option.cc
- size_option.hh
- special.hh
- arpa_io.cc
- arpa_io.hh
- CMakeLists.txt
- count_io.hh
- filter_main.cc
- format.hh
- phrase.cc
- phrase.hh
- phrase_table_vocab_main.cc
- thread.hh
- vocab.cc
- vocab.hh
- wrapper.hh
- test1
- test2
- test3
- test_bad_order
- test_no_unk
- backoff_matrix.hh
- backoff_reunification.cc
- backoff_reunification.hh
- backoff_reunification_test.cc
- bounded_sequence_encoding.cc
- bounded_sequence_encoding.hh
- bounded_sequence_encoding_test.cc
- CMakeLists.txt
- interpolate_info.hh
- interpolate_main.cc
- merge_probabilities.cc
- merge_probabilities.hh
- merge_vocab.cc
- merge_vocab.hh
- merge_vocab_test.cc
- normalize.cc
- normalize.hh
- normalize_test.cc
- pipeline.cc
- pipeline.hh
- split_worker.cc
- split_worker.hh
- streaming_example_main.cc
- tune_derivatives.cc
- tune_derivatives.hh
- tune_derivatives_test.cc
- tune_instances.cc
- tune_instances.hh
- tune_instances_test.cc
- tune_matrix.hh
- tune_weights.cc
- tune_weights.hh
- universal_vocab.cc
- universal_vocab.hh
- nplm.cc
- nplm.hh
- README
- bhiksha.cc
- bhiksha.hh
- binary_format.cc
- binary_format.hh
- blank.hh
- build_binary_main.cc
- CMakeLists.txt
- config.cc
- config.hh
- enumerate_vocab.hh
- facade.hh
- fragment_main.cc
- kenlm_benchmark_main.cc
- left.hh
- left_test.cc
- lm_exception.cc
- lm_exception.hh
- max_order.hh
- model.cc
- model.hh
- model_test.cc
- model_type.hh
- ngram_query.hh
- partial.hh
- partial_test.cc
- quantize.cc
- quantize.hh
- query_main.cc
- read_arpa.cc
- read_arpa.hh
- return.hh
- search_hashed.cc
- search_hashed.hh
- search_trie.cc
- search_trie.hh
- sizes.cc
- sizes.hh
- state.hh
- test.arpa
- test_nounk.arpa
- trie.cc
- trie.hh
- trie_sort.cc
- trie_sort.hh
- value.hh
- value_build.cc
- value_build.hh
- virtual_interface.cc
- virtual_interface.hh
- vocab.cc
- vocab.hh
- weights.hh
- word_index.hh
- _kenlm.pxd
- example.py
- kenlm.cpp
- kenlm.pyx
- bignum-dtoa.cc
- bignum-dtoa.h
- bignum.cc
- bignum.h
- cached-powers.cc
- cached-powers.h
- CMakeLists.txt
- diy-fp.cc
- diy-fp.h
- double-conversion.cc
- double-conversion.h
- fast-dtoa.cc
- fast-dtoa.h
- fixed-dtoa.cc
- fixed-dtoa.h
- ieee.h
- LICENSE
- strtod.cc
- strtod.h
- utils.h
- block.hh
- chain.cc
- chain.hh
- CMakeLists.txt
- config.hh
- count_records.cc
- count_records.hh
- io.cc
- io.hh
- io_test.cc
- line_input.cc
- line_input.hh
- multi_progress.cc
- multi_progress.hh
- multi_stream.hh
- rewindable_stream.cc
- rewindable_stream.hh
- rewindable_stream_test.cc
- sort.hh
- sort_test.cc
- stream.hh
- stream_test.cc
- typed_stream.hh
- bit_packing.cc
- bit_packing.hh
- bit_packing_test.cc
- cat_compressed_main.cc
- CMakeLists.txt
- ersatz_progress.cc
- ersatz_progress.hh
- exception.cc
- exception.hh
- fake_ostream.hh
- file.cc
- file.hh
- file_piece.cc
- file_piece.hh
- file_piece_test.cc
- file_stream.hh
- fixed_array.hh
- float_to_string.cc
- float_to_string.hh
- getopt.c
- getopt.hh
- have.hh
- integer_to_string.cc
- integer_to_string.hh
- integer_to_string_test.cc
- joint_sort.hh
- joint_sort_test.cc
- mmap.cc
- mmap.hh
- multi_intersection.hh
- multi_intersection_test.cc
- murmur_hash.cc
- murmur_hash.hh
- parallel_read.cc
- parallel_read.hh
- pcqueue.hh
- pcqueue_test.cc
- pool.cc
- pool.hh
- probing_hash_table.hh
- probing_hash_table_benchmark_main.cc
- probing_hash_table_test.cc
- proxy_iterator.hh
- read_compressed.cc
- read_compressed.hh
- read_compressed_test.cc
- scoped.cc
- scoped.hh
- sized_iterator.hh
- sized_iterator_test.cc
- sorted_uniform.hh
- sorted_uniform_test.cc
- spaces.cc
- spaces.hh
- string_piece.cc
- string_piece.hh
- string_piece_hash.hh
- string_stream.hh
- string_stream_test.cc
- thread_pool.hh
- tokenize_piece.hh
- tokenize_piece_test.cc
- usage.cc
- usage.hh
- build_binary.vcxproj
- kenlm.sln
- kenlm.vcxproj
- lmplz.vcxproj
- ngram_query.vcxproj
- .gitignore
- BUILDING
- clean_query_only.sh
- CMakeLists.txt
- compile_query_only.sh
- COPYING
- COPYING.3
- COPYING.LESSER.3
- Doxyfile
- GIT_REVISION
- LICENSE
- MANIFEST.in
- README.md
- setup.py
- arae_models_yelp.py
- arae_train_yelp.py
- compare.py
- models_yelp.py
- train_yelp.py
- utils_yelp.py
- .DS_Store
- README.md
# Installation Guide
1. Get the code
git clone https://github.com/fangleai/Implicit-LVM
Downloads the entire project code from GitHub to your computer.
cd Implicit-LVM
Moves into the project folder you just downloaded.
2. CMake
Medium RecommendedPrerequisites
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd transfer_yelp/kenlm
This project's files live in a subfolder, so move into it first.
mkdir build && cd build
Creates a folder to hold the build output and moves into it.
cmake ..
Analyzes the source code and generates build configuration files (must be run inside the build folder).
make
Compiles the code based on the generated build configuration to produce an executable.
Check that an executable was created inside the build folder, then run it directly (e.g. ./build/app_name).
3. .NET
MediumPrerequisites
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd transfer_yelp/kenlm/windows
This project's files live in a subfolder, so move into it first.
dotnet restore
Downloads the packages the project depends on.
dotnet run
Builds the project and runs it immediately.
After dotnet run, check the message or address shown in the terminal.
4. Python
EasyPrerequisites
⚠️ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
pip install .
Installs the package published on PyPI directly — no need to clone the source.
python <실행할 파일명>.py # README에서 정확한 실행 파일명을 확인하세요
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
// repository documentation
Was this content helpful?
(0 ratings)