HIMT

KO | EN

gitlite — search

#javascript #go #machine-learning #linux #macos #windows #awesome #kubernetes #vue #security #pytorch #ios #mcp #openai

(★ 20)

The code for our paper Hierarchical Interactive Multimodal Transformer for Aspect-Based Multimodal Sentiment Analysis

HIMT 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# HIMT
The code for our TAFFC 2022 paper (https://ieeexplore.ieee.org/abstract/document/9765342/):

Jianfei Yu, Kai Chen, and Rui Xia. "Hierarchical Interactive Multimodal Transformer for Aspect-Based Multimodal Sentiment Analysis." IEEE Transactions on Affective Computing (2022).

----------Update------------

2023.03.23  We upload **mywordbag.txt** and **myembedding.txt** to [Baidu Netdist](https://pan.baidu.com/s/1F3rI0oSA2GTvToXlhXAsmQ) with code kbtf which are needed when running our code.

## Usage
We use [Faster R-CNN](https://github.com/peteanderson80/bottom-up-attention) to extract image features and corresponding semantic labels. You can download from [Baidu Netdist](https://pan.baidu.com/s/1F3rI0oSA2GTvToXlhXAsmQ) with the extraction code kbtf. Before you run the bash file, you need to change the parameter **--img_path** to your saved path.

For the textual input of each sample, please refer to [TomBERT](https://github.com/jefferyYu/TomBERT) to download them from the **absa_data** folder, and then change the parameter **--data_dir** to your saved path.

## Training and Inference
```
bash run_himt.sh
```

## Acknowledgements

- Most of the codes are based on the codes provided by huggingface: https://github.com/huggingface/transformers.

HIMT

HIMT 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

HIMT

HIMT 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README