Dynamic_generator

KO | EN

gitlite — search

#hacktoberfest #ai #typescript #llm #golang #rust #deep-learning #linux #nodejs #java #vue #awesome-list #security #ios

Dynamic_generator

(★ 11)

Learning Dynamic Generator Model by Alternating Back-Propagation Through Time

Dynamic_generator 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Learning Dynamic Generator Model by Alternating Back-Propagation Through Time

This repository contains a tensorflow implementation for the paper "[Learning Dynamic Generator Model by Alternating Back-Propagation Through Time](http://www.stat.ucla.edu/~jxie/DynamicGenerator/DynamicGenerator_file/doc/DynamicGenerator.pdf)".

Project Page: (http://www.stat.ucla.edu/~jxie/DynamicGenerator/DynamicGenerator.html)

## Reference
    @article{DG,
        author = {Xie, Jianwen and Gao, Ruiqi and Zheng, Zilong and Zhu, Song-Chun and Wu, Ying Nian},
        title = {Learning Dynamic Generator Model by Alternating Back-Propagation Through Time},
        journal={The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI)},
        year = {2019}
    }
  
 ## Requirements
- Python 2.7 or Python 3.3+
- [Tensorflow r1.0+](https://www.tensorflow.org/install/)
- [Scipy](https://www.scipy.org/install.html)
- [pillow](https://pillow.readthedocs.io/en/latest/installation.html)

## Usage

### (1) For dynamic texture synthesis

#### (i) Training

First, prepare your data into a folder, for example `./trainingVideo/dynamicTexture/fire` 
  
To train a model with dynamic texture ***fire***:

$ python main_dyn_G.py --category fire --isTraining True

The training results will be saved in `./output_synthesis/fire/final_result`.

The learned models will be saved in `./output_synthesis/fire/model`.

#### (ii) Testing for dynamic texture synthesis  
    
    $ python main_dyn_G.py --category fire --isTraining False --num_sections_in_test 4 --num_batches_in_test 2 --ckpt_name model.ckpt-2960
    
the 'num_sections_in_test' indicates the number of trucations of the synthesized video

the 'num_batches_in_test' indicates the number of independent synthesized videos

testing results will be saved in `./output_synthesis/fire/final_result_testing`.

#### (iii) Results

For each category, the first one is the observed video, and the other three are synthesized videos generated by the learned model. The observed video is of 60 frames in length, while the two synthesized videos are of 120 frames in length.

### (2) For action pattern synthesis

#### (i) Training

First, prepare your data into a folder, for example `./trainingVideo/action_dataset/animal30_running` 
  
To train a model with dataset ***animal30_running***:

$ python main_dyn_G_motion.py --category animal30_running --isTraining True

The training results will be saved in `./output_synthesis/animal30_running/final_result`.

The learned models will be saved in `./output_synthesis/animal30_running/model`.

#### (ii) Testing

$ python main_dyn_G_motion.py --category animal30_running --isTraining False --num_sections_in_test 2 --num_batches_in_test 2 --ckpt_name model.ckpt-6990
    
testing results will be saved in `./output_synthesis/animal30_running/final_result_testing`.

#### (iii) Results

Synthesizing animal actions (animal action dataset). The first row shows the observed videos, while the second and third rows display two corresponding synthesized videos for each obcerved video. The number of frames of the observed video is less than that of the synthesized video in the experiment of synthesizing human actions.

### (3) For recovery

#### (i) Training and recovering

##### Using external mask file

Type 1: missing frames

$ python main_dyn_G_recovery.py --category ocean --isTraining True  --training_mode incomplete --mask_type external --mask_file missing_frame_type.mat
    
Type 2: single region masks
    
    $ python main_dyn_G_recovery.py --category ocean --isTraining True  --training_mode incomplete --mask_type external --mask_file region_type.mat

##### Using mask generated by the code

Type 1: missing frames

$ python main_dyn_G_recovery.py --category ocean --isTraining True  --training_mode incomplete --mask_type missingFrames
    
Type 2: single region masks

$ python main_dyn_G_recovery.py --category ocean --isTraining True  --training_mode incomplete --mask_type randomRegion
    
The results will be saved in `./output_recovery/ocean/final_result`.

#### (ii) Results

In each example, the first one is the occluded training video, and the second one is the recovered result.

### (4) For background inpainting

#### (i) Inpainting

$ python main_dyn_G_background_inpainting.py --category boats --isTraining True  --training_mode incomplete --mask_type external --mask_file mask128.mat
    
The results will be saved in `./output_background_inpainting/boats/final_result`.

#### (ii) Results

In each example, the first one is the original video, the second one is the result where the target object is removed by our algorithm. (Left) removing a walking person in front of fountain. (Right) removing a moving boat in the lake.

### Q & A
For any questions, please contact Jianwen Xie (jianwen@ucla.edu), Ruiqi Gao (ruiqigao@ucla.edu) and Zilong Zheng (zilongzheng0318@ucla.edu)

Dynamic_generator

Dynamic_generator 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Dynamic_generator

Dynamic_generator 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README