MC-SMoE

(★ 107)

[ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"

File Explorer

Download Latest Version (.zip)
  • .gitignore
  • LICENSE
  • README.md
  • requirements.txt

# Installation Guide

1. Get the code
git clone https://github.com/UNITES-Lab/MC-SMoE

Downloads the entire project code from GitHub to your computer.

cd MC-SMoE

Moves into the project folder you just downloaded.

2. Python

Easy Recommended
Prerequisites
  • Git Needed to download the project code from GitHub.
  • Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.
pip install -r requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

✅ If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

Today's picks

d3 ★ 113,510

Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:

Shell
supabase ★ 108,234

The Postgres development platform. Supabase gives you a dedicated Postgres database to bui

TypeScript
markitdown ★ 175,168

Python tool for converting files and office documents to Markdown.

Python
reveal.js ★ 72,157

The HTML Presentation Framework

JavaScript
awesome-design-md ★ 109,537

A collection of DESIGN.md files analysis by popular brand design systems. Drop one into yo
langchain ★ 144,721

The agent engineering platform.

Python
// repository documentation