wiki2bio

KO | EN

gitlite — search

#hacktoberfest #react #deep-learning #linux #docker #cli #kubernetes #vue #awesome-list #security #ios #mcp #openai #open-source

(★ 153)

Code for AAAI2018 paper "Table-to-text Generation by Structure-aware Seq2seq Learning"

파일 탐색기

최종 버전 다운로드 (.zip)

- frame.png
- task.png
- field_vocab.txt
- word_vocab.txt
- - smart_common_words.txt
  - WordNet-2.0.exc.db
- ROUGE-1.5.5.pl
.gitattributes
AttentionUnit.py
DataLoader.py
dualAttentionUnit.py
fgateLstmUnit.py
LstmUnit.py
Main.py
OutputUnit.py
preprocess.py
PythonROUGE.py
README.md
SeqUnit.py
util.py

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# wiki2bio
<p align="center"><img width="60%" src="doc/task.png"/></p>

This project provides the implementation of table-to-text (infobox-to-biography) generation, taking the structure of a infobox for consideration.

Details of table-to-text generation can be found [here](https://tyliupku.github.io/papers/aaai2018_liu.pdf). The implementation is based on Tensorflow 1.0.0 and Python 2.7.

# Model Overview
<p align="center"><img width="85%" src="doc/frame.png"/></p>
wiki2bio is a natural language generation task which transforms Wikipedia infoboxes to corresponding biographies.
We encode the structure of an infobox by taking field type and position information into consideration.

In the encoding phase, we update the cell memory of the LSTM unit by a field gate and its corresponding field value 
in order to incorporate field information into table representation.
In the decoding phase, dual attention mechanism which contains word level attention and field level attention is proposed 
to model the semantic relevance between the generated description and the table.

# Installation
We strongly recommended using GPUs to train the model. It takes about 36~48 hours to finish training on a GTX1080 GPU.
## Tensorflow
Our code is based on Tensorflow 1.0.0. You can find the installation instructions [here](https://www.tensorflow.org/versions/r1.1/install/).
## Dependencies
```requirements.txt``` summarize the dependencies of our code. You can install these dependencies by:
```
pip install -r requirements.txt
```

# Data
The dataset for evaluation is [WIKIBIO](https://github.com/DavidGrangier/wikipedia-biography-dataset) from [Lebret et al. 2016](https://arxiv.org/abs/1603.07771). We preprocess the dataset in a easy-to-use way.

The ```original_data``` we proprocessed can be downloaded via [Google Drive](https://drive.google.com/file/d/15AV8LeWY3nzCKb8RRbM8kwHAp_DUZ5gf/view?usp=sharing) or [Baidu Yunpan](https://pan.baidu.com/s/1c324Vs8).

```
original_data
training set: train.box; train.summary
testing set:  test.box; test.summary
valid set:    valid.box; valid.summary
vocabularies: word_vocab.txt; field_vocab.txt
```

```*.box``` in the ```original_data``` is the infoboxes from Wikipedia. One infobox per line.

```*.summary``` in the ```original_data``` is the biographies corresponding to the infoboxes in ```*.box```. One biography per line.

```word_vocab.txt``` and ```field_vocab.txt``` are vocabularies for words (20000 words) and field types (1480 types), respectively.

The whole dataset is divided into training set (582,659 instances, 80%), valid set (72,831 instances, 10%) and testing set (72,831 instances, 10%).

# Usage
## preprocess
Firstly, we extract words, field types and position information from the original infoboxes ```*.box```.
After that, we idlize the extracted words and field type according to the word vocabulary ```word_vocab.txt``` and field vocabulary ```field_vocab.txt```. 
```
python preprocess.py
```
After preprocessing, the directory structure looks like follows:
```
-original_data
-processed_data
  |-train
    |-train.box.pos
    |-train.box.rpos
    |-train.box.val
    |-train.box.lab
    |-train.summary.id
    |-train.box.val.id
    |-train.box.lab.id
  |-test
    |-...
  |-valid
    |-...
-results
  |-evaluation
  |-res
```
```*.box.pos```, ```*.box.rpos```, ```*.box.val```, ```*.box.lab``` represents the word position p+, word position p-, field content and field types, respectively.

Experiment results will be stored in the ```results/res``` directory.

## train
For training, turn the "mode" in ```main.py``` to ```train```:
```
tf.app.flags.DEFINE_string("mode",'train','train or test')
```
Then run ```main.py```:
```
python main.py
```
In the training stage, the model will report BLEU and ROUGE scores on the valid set and store the model parameters after certain training steps.
The detailed results will be stored in the  ```results/res/CUR_MODEL_TIME_STAMP/log.txt```.

## test
For testing, turn the "mode" in ```main.py``` to ```train``` and the "load" to the selected model directory:
```
tf.app.flags.DEFINE_string("mode",'test','train or test')
tf.app.flags.DEFINE_string("load",'YOUR_BEST_MODEL_TIME_STAMP','load directory')
```
Then test your model by running:
```
python main.py
```

# Reference
If you find the code and data resources helpful, please cite the following paper:
```
@article{liu2017table,
  title={Table-to-text Generation by Structure-aware Seq2seq Learning},
  author={Liu, Tianyu and Wang, Kexiang and Sha, Lei and Chang, Baobao and Sui, Zhifang},
  journal={arXiv preprint arXiv:1711.09724},
  year={2017}
}
```

wiki2bio

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

wiki2bio

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README