flux2-distributed-inference
Unofficial distributed/sharded Flux2 inference using ๐ค Accelerate device_map="auto" for multi-GPU model-parallel execution.
ํ์ผ ํ์๊ธฐ
- flux2_pipeline.py
- mistral3.py
- inference.py
- minimal_example.py
- README.md
- requirements.txt
# CDN์ผ๋ก ์ฌ์ฉํ๊ธฐ
jsDelivrjsDelivr๋ ๊ณต๊ฐ GitHub ๋ฆฌํฌ์งํ ๋ฆฌ๋ฅผ ๋ณ๋ ์ค์ ์์ด CDN์ผ๋ก ์ฆ์ ์๋นํฉ๋๋ค. ๋ฒ์ ๊ณผ ํ์ผ์ ๊ณ ๋ฅด๋ฉด ์นํ์ด์ง์ ๋ฐ๋ก ๋ถ์ผ ์ ์๋ ๋งํฌ์ ์์ ์ฝ๋๊ฐ ๋ง๋ค์ด์ง๋๋ค.
๋ช ๋ น์ด ์ฉ์ด์ง
์ด ๋ฌธ์์์ ์ฌ์ฉ๋ ๋ช ๋ น์ด๋ฅผ ๋ชจ์๋ดค์ต๋๋ค. ๋ฏ์ ๋ช ๋ น์ด๊ฐ ์๋ค๋ฉด ํผ์ณ์ ํ์ธํด๋ณด์ธ์.
conda activate
์ค๋ช
๋ณด๊ธฐ โผ
conda activate
Activate a conda environment.
See also: `conda deactivate`.
conda activate myenv
Activate an existing environment named `myenv`:
conda activate {{path/to/myenv}}
Activate an existing environment located at custom path:
conda activate --stack myenv
Stack `myenv` environment on top of a previous environment making libraries/commands/variables from both accessible:
conda create
์ค๋ช
๋ณด๊ธฐ โผ
conda create
Create new conda environments.
conda create {{[-y|--yes]}} {{[-n|--name]}} py39 python=3.9 "numpy>=1.11" scipy
Create a new environment named `py39`, install Python 3.9, NumPy v1.11 or above in it, and the latest stable version of SciPy. Say yes to all confirmations:
conda create {{[-n|--name]}} myenv --file {{file1.yml}} --file {{file2.yml}}
Create a new environment named `myenv` and install packages listed in files:
conda create {{[-p|--prefix]}} {{path/to/myenv}}
Create a new environment at a custom path (i.e. prefix):
git clone
์ค๋ช
๋ณด๊ธฐ โผ
git clone
Clone an existing repository.
git clone {{remote_repository_location}} {{path/to/directory}}
Clone an existing repository into a new directory (the default directory is the repository name):
git clone --recursive {{remote_repository_location}}
Clone an existing repository and its submodules:
git clone {{[-n|--no-checkout]}} {{remote_repository_location}}
Clone only the `.git` directory of an existing repository:
huggingface-cli
์ค๋ช
๋ณด๊ธฐ โผ
huggingface-cli
์ด ๋ช ๋ น์ `hf`์ ๋ณ์นญ์ ๋๋ค.
tldr hf
์์ธํ ๋ด์ฉ์ ์๋ณธ ๋ช ๋ น์ ์ฐธ๊ณ ํ์ธ์:
pip install
์ค๋ช
๋ณด๊ธฐ โผ
pip install
Install Python packages.
pip install {{package1 package2 ...}}
Install one or more packages:
pip install {{package1 package2 ...}} {{[-U|--upgrade]}}
Upgrade all specified packages to the latest version, installing any that are not already present:
pip install {{package}}=={{version}}
Install a specific version of a package:
python
์ค๋ช
๋ณด๊ธฐ โผ
python
Python ์ธ์ด ์ธํฐํ๋ฆฌํฐ.
๋ ๋ง์ ์ ๋ณด: <https://docs.python.org/using/cmdline.html>.
python
REPL(๋ํํ ์ ธ) ์์:
python {{path/to/file.py}}
ํน์ Python ํ์ผ ์คํ:
python -i {{path/to/file.py}}
ํน์ Python ํ์ผ ์คํ ํ REPL ์์:
cls
์ค๋ช
๋ณด๊ธฐ โผ
cls
ํ๋ฉด์ ์ง์ฐ๊ณ ์์์ ์ด๊ธฐํํ๋ ๋ช
๋ น์ด.
๋ ๋ง์ ์ ๋ณด: <https://help.fdos.org/en/hhstndrd/batch/cls.htm>.
CLS
ํ๋ฉด์ ์ง์ฐ๊ณ ์์์ ํฐ์์์ ๊ฒ์ ์ผ๋ก ์ด๊ธฐํ:
