OneVision-Encoder

(โ˜… 396)

Codec-Aligned Sparsity as a Foundational Principle for Multimodal Intelligence

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • .pylintrc
  • dockerfile
  • environment.yml
  • LICENSE
  • pyproject.toml
  • README.md
  • requirements.txt

# Installation Guide

1. Get the code
git clone https://github.com/EvolvingLMMs-Lab/OneVision-Encoder

Downloads the entire project code from GitHub to your computer.

cd OneVision-Encoder

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended
Prerequisites
  • Python 3 Python is required to use pip.
pip install torch==2.7.0 torchvision==0.22.0 torchaudio==2.7.0 --index-url https://download.pytorch.org/whl/cu118

Installs the package published on PyPI directly โ€” no need to clone the source.

pip install --extra-index-url https://pypi.nvidia.com --upgrade nvidia-dali-cuda110

Installs the package published on PyPI directly โ€” no need to clone the source.

โœ… After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. Docker

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -t ov_encoder_llava:26.01 .

Builds a runnable image based on the Dockerfile.

docker run -it --gpus all --ipc host --net host --privileged \

Runs the built image as an actual container.

docker build -t onevision-encoder:2601 .

Builds a runnable image based on the Dockerfile.

docker run -it --rm --gpus all --ipc host --net host --privileged \

Runs the built image as an actual container.

โœ… Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.

Pulled directly from this repo's README.

4. Node.js

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Node.js Node.js must be installed to use npm. The LTS version is recommended.
โš ๏ธ This is a large repository, so this method may point to an internal sub-package rather than the actual core product. Check the full README as well.
cd llava_next/lmms-eval/lmms_eval/tui/web

This project's files live in a subfolder, so move into it first.

npm install

Downloads and installs the libraries listed in package.json.

npm start

Starts the development/run server.

โœ… After running the command, open the address shown in the terminal (usually something like http://localhost:3000) in your browser.

5. Python

Easy
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -e .

Installs the Python libraries listed in requirements.txt (or similar).

pip install torch==2.7.0 torchvision==0.22.0 torchaudio==2.7.0 --index-url https://download.pytorch.org/whl/cu118

Installs the package published on PyPI directly โ€” no need to clone the source.

pip install --extra-index-url https://pypi.nvidia.com --upgrade nvidia-dali-cuda110

Installs the package published on PyPI directly โ€” no need to clone the source.

pip install -r requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

โœ… If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

Today's picks

the-book-of-secret-knowledge โ˜… 239,592

A collection of inspiring lists, manuals, cheatsheets, blogs, hacks, one-liners, cli/web t
LeetCodeAnimation โ˜… 76,695

Demonstrate all the questions on LeetCode in the form of animation.๏ผˆ็”จๅŠจ็”ป็š„ๅฝขๅผๅ‘ˆ็Žฐ่งฃLeetCode้ข˜็›ฎ็š„ๆ€่ทฏ

Java
computer-science โ˜… 208,280

๐ŸŽ“ Path to a free self-taught education in Computer Science!

HTML
go โ˜… 136,044

The Go programming language

Go
SecLists โ˜… 72,972

SecLists is the security tester's companion. It's a collection of multiple types of lists

PHP
openai-cookbook โ˜… 75,446

Examples and guides for using the OpenAI API

Jupyter Notebook
// repository documentation