CleanAgent - GitLite

KO | EN

gitlite — search

#javascript #hacktoberfest #react #ai #golang #android #nodejs #java #vue #pytorch #mcp #ios #openai #open-source

CleanAgent

(★ 76)

This is an experimental demo repository of agent on data cleaning task

파일 탐색기

최종 버전 다운로드 (.zip)

- config.toml
- git_page.png
- - flight_1k.csv
  - flight_1k_cleaned.csv
  - flight_1k_withgt.csv
.gitignore
chainlit.md
ground_truth_extraction.py
llm_cache.csv
llm_cache.json
main.py
README.md
requirements.txt

# 설치 가이드

1. 코드 내려받기

git clone https://github.com/sfu-db/CleanAgent

깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.

cd CleanAgent

방금 내려받은 프로젝트 폴더 안으로 이동합니다.

2. Python

쉬움 추천

사전 준비물

Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
Python 3 설치 시 'Add Python to PATH' 옵션을 꼭 체크하세요 (Windows).

pip install -r requirements.txt

requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.

✅ 에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.

이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# CleanAgent: Automatically Standardize Your Data with LLM-based Agents
### Introduction
**`CleanAgent`** is a tool that automates the data standardization process with LLM-based Agents. You only need to upload the table that needs to be standardized, and **`CleanAgent`** will get your hands free, standardize your data automatically and return the standardized table to you.
Our demo paper **CleanAgent: Automating Data Standardization with LLM-based Agents** will be published in the future.

If you think this small project is interesting or helpful to you, please considering give us a star :star2: :star2: :star2: ! :smiley:

### Usage
Please use **`CleanAgent`** with the following commands:
```shell
git clone https://github.com/sfu-db/CleanAgent
cd CleanAgent
conda create -n cleanagent python=3.10.6
conda activate cleanagent
export OPENAI_API_KEY="Your_Openai_API_Key"
pip install -r requirements.txt
chainlit run main.py
```
Then you can see the web UI of **`CleanAgent`** on `http://localhost:8000`

### Demonstration
You also can watch the following 4-mins demo to learn how to use **`CleanAgent`**:

<a href="https://youtu.be/fSYXVM6qeqM"><img src="assets/git_page.png"/></a>

### Citation
If you think **`CleanAgent`** is useful for you, please considering to cite our **`CleanAgent`**:
```bibtex
@article{qi2024cleanagent,
  title={CleanAgent: Automating data standardization with LLM-based agents},
  author={Qi, Danrui and Miao, Zhengjie and Wang, Jiannan},
  journal={arXiv preprint arXiv:2403.08291},
  year={2024}
}
```