Awesome-LLM-3D

KO | EN

gitlite — search

#hacktoberfest #react #go #android #deep-learning #docker #nodejs #awesome #cli #vue #awesome-list #security #pytorch #open-source

(★ 2,251)

Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

파일 탐색기

최종 버전 다운로드 (.zip)

- Figure1_v5.png
- Figure1_v6.png
- Figure1_v8_25.6.9.png
- llm-3D.md
.gitignore
contributing.md
LICENSE
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Awesome-LLM-3D [![Awesome](https://awesome.re/badge.svg)](https://awesome.re) [![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://GitHub.com/Naereen/StrapDown.js/graphs/commit-activity) [![PR's Welcome](https://img.shields.io/badge/PRs-welcome-brightgreen.svg?style=flat)](http://makeapullrequest.com)  <a href="" target='_blank'><img src="https://visitor-badge.laobi.icu/badge?page_id=activevisionlab.llm3d&left_color=gray&right_color=blue"> </a> [![arXiv](https://img.shields.io/badge/arXiv-2405.10255v2-b31b1b.svg)](https://arxiv.org/abs/2405.10255v2)

## 🏠 About
Here is a curated list of papers about 3D-Related Tasks empowered by Large Language Models (LLMs). 
It contains various tasks including 3D understanding, reasoning, generation, and embodied agents. Also, we include other Foundation Models (CLIP, SAM) for the whole picture of this area.

This is an active repository, you can watch for following the latest advances. If you find it useful, please kindly star ⭐ this repo and [cite](#citation) the paper.

## 🔥 News
- [2026-03-20] Our benchmark paper **Real-3DQA** is now available at ICLR 2026! Following our survey paper, we now release the benchmark paper on genuine 3D spatial understanding. [Project Page](https://real-3dqa.github.io/)
- [2025-10-21] 📢 We have released the **second version** of our survey, updated to include literature up to **July 2025**:  
👉 [*When LLMs Step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models*](https://arxiv.org/pdf/2405.10255v2)
- [2024-05-16] Check out the first survey paper in the 3D-LLM domain: [When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models](https://arxiv.org/pdf/2405.10255) 
- [2024-01-06] [Runsen Xu](https://runsenxu.com/) added chronological information and [Xianzheng Ma](https://xianzhengma.github.io/) reorganized it in Z-A order for better following the latest advances.
- [2023-12-16] [Xianzheng Ma](https://xianzhengma.github.io/) and [Yash Bhalgat](https://yashbhalgat.github.io/) curated this list and published the first version;

## Table of Contents

- [Awesome-LLM-3D](#awesome-llm-3D)
  - [3D Unified Understanding and Generation (LLM)](#3d-unified-understanding-and-generation-via-llm)
  - [3D Understanding (LLM)](#3d-understanding-via-llm)
  - [3D Understanding (other Foundation Models)](#3d-understanding-via-other-foundation-models)
  - [3D Reasoning](#3d-reasoning)
  - [3D Generation](#3d-generation)
  - [3D Embodied Agent](#3d-embodied-agent)
  - [3D Benchmarks](#3d-benchmarks)
  - [Contributing](#contributing)

## 3D Unified Understanding and Generation via LLM

## 3D Understanding via LLM

## Contributing

Your contributions are always welcome!

I will keep some pull requests open if I'm not sure if they are awesome for 3D LLMs, you could vote for them by adding 👍 to them.

---

If you have any questions about this opinionated list, please get in touch at xianzheng@robots.ox.ac.uk or Wechat ID: mxz1997112.

## Star History

[![Star History Chart](https://api.star-history.com/svg?repos=ActiveVisionLab/Awesome-LLM-3D&type=Date)](https://star-history.com/#ActiveVisionLab/Awesome-LLM-3D&Date)

## Citation
If you find this repository useful, please consider citing this paper:
```
@misc{ma2024llmsstep3dworld,
      title={When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models}, 
      author={Xianzheng Ma and Yash Bhalgat and Brandon Smart and Shuai Chen and Xinghui Li and Jian Ding and Jindong Gu and Dave Zhenyu Chen and Songyou Peng and Jia-Wang Bian and Philip H Torr and Marc Pollefeys and Matthias Nießner and Ian D Reid and Angel X. Chang and Iro Laina and Victor Adrian Prisacariu},
      year={2024},
      journal={arXiv preprint arXiv:2405.10255},
}
```

## Acknowledgement
This repo is inspired by [Awesome-LLM](https://github.com/Hannibal046/Awesome-LLM?tab=readme-ov-file#other-awesome-lists)

Awesome-LLM-3D

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Awesome-LLM-3D

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README