vLLM-Moet

(★ 526)

A vLLM patch + hand‑written SM120 SASS kernels: 2‑bit MoE experts + an FP4 "delta" cache that recovers precision — matching the official (NV)FP4 checkpoint's quality on consumer Blackwell cards

Owner Repos

qwentin ★ 16

27B at 256k context on one RTX 5090 — FP6 + 4-bit KV + MTP spec-decode, hand-written SM120 tensor-core kernels, OpenAI API.

Cuda
rtx-p2p ★ 9

PCIe P2P on consumer RTX 5090 via one GSP firmware registry key — no driver patches.

Shell
cubit ★ 9

Open-source SM120 (Blackwell) SASS assembler — encode, schedule & assemble GPU machine code, including all tensor-core instructions.

Rust

File Explorer

ZIP Download
  • .dockerignore
  • .gitignore
  • AGENTS.md
  • Dockerfile.recipes
  • Dockerfile.sm120-v024
  • LICENSE
  • NOTICE
  • README.md

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Link
Example

Command Glossary

Commands referenced in this DOCs, explained below.

🔍

docker run

View Details ▼

This command is an alias of `docker container run`.

tldr docker container run

View documentation for the original command:

🔍

git clone

View Details ▼

Clone an existing repository.

git clone {{remote_repository_location}} {{path/to/directory}}

Clone an existing repository into a new directory (the default directory is the repository name):

git clone --recursive {{remote_repository_location}}

Clone an existing repository and its submodules:

git clone {{[-n|--no-checkout]}} {{remote_repository_location}}

Clone only the `.git` directory of an existing repository:

🔍

sass

View Details ▼

Convert SCSS or Sass files to CSS.

sass {{inputfile.scss|inputfile.sass}}

Convert a SCSS or Sass file to CSS and print out the result:

sass {{inputfile.scss|inputfile.sass}} {{outputfile.css}}

Convert a SCSS or Sass file to CSS and save the result to a file:

sass --watch {{inputfile.scss|inputfile.sass}}

Watch a SCSS or Sass file for changes and output or update the CSS file with same filename:

// repository documentation