TextToFace

KO | EN

gitlite — search

#hacktoberfest #typescript #android #rust #deep-learning #linux #kubernetes #vue #awesome-list #security #mcp #ios #openai #open-source

(★ 17)

stylegan convert text to face image

TextToFace Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## StyleGAN Bert &mdash; convert text to face 
![Python 3.6](https://img.shields.io/badge/python-3.6-green.svg?style=plastic)
![TensorFlow 1.10](https://img.shields.io/badge/tensorflow-1.10-green.svg?style=plastic)
![cuDNN 7.3.1](https://img.shields.io/badge/cudnn-7.3.1-green.svg?style=plastic)
![License CC BY-NC](https://img.shields.io/badge/license-CC_BY--NC-green.svg?style=plastic)

*You can convert text to face image!!! Thanks to @Puzer and @pbaylies for the original style Encoder*

![example image](https://raw.githubusercontent.com/aloyschen/TextToFace/master/example.png)

Short explanation of encoding approach:

1) Bert is used for transforming sentence to embedding
2) Original pre-trained StyleGAN generator is used for generating images
3) Pre-trained ResNet network is used for transforming a reference image and generated image into high-level features space
4) Simple Model is used for transforming Text Embedding and image into high-level features space

**More examples you can find in the [Jupyter notebook](https://github.com/aloyschen/TextToFace/blob/master/play_text_to_face.ipynb)**

### Generating latent representation of your images
You can generate latent representations of your own images using two scripts:
1) Extract and align faces from images
> python align_images.py raw_images/ aligned_images/

2) Download the stylegan pre-train model ([百度云链接](https://pan.baidu.com/s/1CuTKhAG2cdDo_RV5E6V9FA)), put the stylegan.pkl to model folder

3) Training ResNet50 encoder
train your own with trainResnet.py or download my [pre-trained model](https://pan.baidu.com/s/14QaGTltjpeErBVM23jGIFw)! Put the model in model/finetuned_resnet.h5<br>
[Origin github](https://github.com/pbaylies/stylegan-encoder/blob/master/README.md)

4) Find latent representation of aligned images
> python encode_images.py aligned_images/ generated_images/ latent_representations/

### Generating sentence embedding
You can generate sentence embedding with [bert-as-service](https://github.com/hanxiao/bert-as-service)
1) Install bert-serving
> pip install bert-serving-server

> pip install bert-serving-server
2) Start the BERT service
> bert-serving-start -model_dir ./model/chinese_L-12_H-768_A-12 -num_worker=4

bert chinese model download address [百度云链接](https://pan.baidu.com/s/1YNtlySQlqFmcDgTMuRKO7w)

### Generating your own text and image dataset
You can describe face image by yourself, like this:
>48889.png	黑色短发年轻女子，有刘海，开心的笑，露齿，大眼睛<br>
48872.png	黑色短发青年男子，戴墨镜，侧面

Used image from [FHHQ dataset](https://github.com/NVlabs/ffhq-dataset)

### Train text embedding model
The model is simple with some Dense layer
> python trainTextToFace.py

TextToFace

TextToFace Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

TextToFace

TextToFace Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README