litgpt

(★ 13,619)

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Reference Links

🌐 Official Homepage Lightning Cloud Rozière et al. 2023 Google Team, Google Deepmind Google Team, Google Deepmind Qwen Team 2024

Owner Repos

pytorch-lightning ★ 31,297

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

Python
lit-llama ★ 6,084

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Python
LitServe ★ 3,929

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

Python
torchmetrics ★ 2,460

Machine learning metrics for distributed, scalable PyTorch applications.

Python
lightning-thunder ★ 1,469

PyTorch compiler that accelerates training and inference. Get built-in optimizations for performance, memory, parallelism, and easily write your own.

Python
deep-learning-project-template ★ 1,288

Pytorch Lightning code guideline for conferences

Python

File Explorer

ZIP Download
  • .gitignore
  • .pre-commit-config.yaml
  • CITATION.cff
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • LICENSE.md
  • pyproject.toml
  • README.md

# Installation Guide

python
Prerequisites

Setup Steps

git clone https://github.com/Lightning-AI/litgpt

Clone the repository locally.

cd litgpt

Navigate to the project directory.

pip install 'litgpt[extra]'

Install LitGPT with extra dependencies.

Key Commands

pip install 'litgpt[extra]'

Install LitGPT package with extra features.

pip install -e '.[extra,compiler,test]'

Install the package in editable mode from source.

uv sync --all-extras

Sync all dependencies using the uv package manager.

Running in a GPU environment requires a CUDA driver compatible with PyTorch.

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Link
Example

Release Timeline

Actively Maintained

Command Glossary

Commands referenced in this DOCs, explained below.

🔍

git clone

View Details ▼

Clone an existing repository.

git clone {{remote_repository_location}} {{path/to/directory}}

Clone an existing repository into a new directory (the default directory is the repository name):

git clone --recursive {{remote_repository_location}}

Clone an existing repository and its submodules:

git clone {{[-n|--no-checkout]}} {{remote_repository_location}}

Clone only the `.git` directory of an existing repository:

🔍

pip install

View Details ▼

Install Python packages.

pip install {{package1 package2 ...}}

Install one or more packages:

pip install {{package1 package2 ...}} {{[-U|--upgrade]}}

Upgrade all specified packages to the latest version, installing any that are not already present:

pip install {{package}}=={{version}}

Install a specific version of a package:

🔍

uv sync

View Details ▼

Update the project's environment to match the lockfile.

uv sync

Sync the project environment with the lockfile:

uv sync --all-extras

Sync and include all optional dependencies:

uv sync --extra {{extra_name}}

Sync with specific optional dependencies:

// repository documentation