NeuroDecipher - GitLite

KO | EN

gitlite — search

#javascript #hacktoberfest #ai #typescript #go #golang #android #machine-learning #rust #deep-learning #docker #windows #awesome #mcp

NeuroDecipher

(★ 54)

No description available.

파일 탐색기

최종 버전 다운로드 (.zip)

- linear_b-greek.cog
- linear_b-greek.names.cog
- linear_b.el.raw
- linear_b.minoan.raw
- README.md
- test.es-fr-en.toy.cog
- uga-heb.no_spe.cog
- uga-heb.small.no_spe.cog
- - __init__.py
  - _editdistance.cpp
  - _editdistance.h
  - bycython.pyx
  - def.h
- - test_editdistance.py
- LICENSE
- README.rst
- setup.py
- - __init__.py
  - decipher_config.py
- - __init__.py
  - charset.py
  - charset_test.py
  - cognate.py
  - cognate_test.py
  - data_loader.py
  - data_loader_test.py
  - vocab.py
- - __init__.py
  - evaluator.py
- - __init__.py
  - edit_dist.py
  - flow.py
  - min_cost_flow.py
- - __init__.py
  - core.py
- - __init__.py
  - decipher.py
  - lstm_state.py
  - modules.py
  - trie.py
  - trie_test.py
- - __init__.py
  - manager.py
  - manager_test.py
  - trainer.py
- __init__.py
- main.py
- Linear_b_simplified.ipynb
.gitignore
.gitmodules
arglib
dev_misc
README.md
requirements.txt
setup.py

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# NeuroDecipher

This repo hosts the codebase for reproduce the results for the ACL paper [Neural Decipherment via Minimum-Cost Flow: from Ugaritic to Linear B](http://people.csail.mit.edu/j_luo/assets/publications/NeuroDecipher.pdf).

# Data
Data for linear B and Ugaritic are included in the `data` folder:
* `uga-heb.no_spe.cog` is the entire Ugaritic-Hebrew data obtained from [Ben Snyder](http://people.csail.mit.edu/bsnyder/papers/bsnyder_acl2010.pdf). `no_spe` stands for no special symbols since the original file contains special symbols that mark the morphological segmentations and affixes.
* `uga-heb.small.no_spe.cog` is the exact random subset of Ugaritic data I used in the paper for training the model. Around one tenth of the original file.
* `linear_b-greek.cog` is the linear B data used in the paper. `notebooks/Linear_b_simplified.ipynb` is the same notebook I used for preparing the linear B data.
* `linear_b-greek.names.cog` is the linear B data that only included names on the Greek side.

Note that you might need to install [fonts](https://www.google.com/get/noto/#sans-linb) in order to render Linear B scripts properly in your computer.

# Install
* Run `git submodule init && git submodule update` to obtain all the submodules.
* Install `pytorch`. Any version `>= 1.3` should work.
* `pip install -r requirements.txt` for other libraries.
* Go to the three folders (`editdistance`, `arglib`, and `dev_misc`) and run `pip install .` in each folder to install the dependency.
* Run `pip install .` in the root folder.

# Run
The recommended way to run this program is to write down a configuration class first. See `nd/config/decipher_config.py` for an example, and 
accordingly you can use `python nd/main.py --cfg UgaHebSmallNoSpe` to start running.