flux2-distributed-inference

(โ˜… 13)

Unofficial distributed/sharded Flux2 inference using ๐Ÿค— Accelerate device_map="auto" for multi-GPU model-parallel execution.

ํŒŒ์ผ ํƒ์ƒ‰๊ธฐ

  • inference.py
  • minimal_example.py
  • README.md
  • requirements.txt

# CDN์œผ๋กœ ์‚ฌ์šฉํ•˜๊ธฐ

jsDelivr

jsDelivr๋Š” ๊ณต๊ฐœ GitHub ๋ฆฌํฌ์ง€ํ† ๋ฆฌ๋ฅผ ๋ณ„๋„ ์„ค์ • ์—†์ด CDN์œผ๋กœ ์ฆ‰์‹œ ์„œ๋น™ํ•ฉ๋‹ˆ๋‹ค. ๋ฒ„์ „๊ณผ ํŒŒ์ผ์„ ๊ณ ๋ฅด๋ฉด ์›นํŽ˜์ด์ง€์— ๋ฐ”๋กœ ๋ถ™์ผ ์ˆ˜ ์žˆ๋Š” ๋งํฌ์™€ ์˜ˆ์‹œ ์ฝ”๋“œ๊ฐ€ ๋งŒ๋“ค์–ด์ง‘๋‹ˆ๋‹ค.

๋ช…๋ น์–ด ์šฉ์–ด์ง‘

์ด ๋ฌธ์„œ์—์„œ ์‚ฌ์šฉ๋œ ๋ช…๋ น์–ด๋ฅผ ๋ชจ์•„๋ดค์Šต๋‹ˆ๋‹ค. ๋‚ฏ์„  ๋ช…๋ น์–ด๊ฐ€ ์žˆ๋‹ค๋ฉด ํŽผ์ณ์„œ ํ™•์ธํ•ด๋ณด์„ธ์š”.

๐Ÿ”

conda activate

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

Activate a conda environment.
See also: `conda deactivate`.

conda activate myenv

Activate an existing environment named `myenv`:

conda activate {{path/to/myenv}}

Activate an existing environment located at custom path:

conda activate --stack myenv

Stack `myenv` environment on top of a previous environment making libraries/commands/variables from both accessible:

๐Ÿ”

conda create

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

Create new conda environments.

conda create {{[-y|--yes]}} {{[-n|--name]}} py39 python=3.9 "numpy>=1.11" scipy

Create a new environment named `py39`, install Python 3.9, NumPy v1.11 or above in it, and the latest stable version of SciPy. Say yes to all confirmations:

conda create {{[-n|--name]}} myenv --file {{file1.yml}} --file {{file2.yml}}

Create a new environment named `myenv` and install packages listed in files:

conda create {{[-p|--prefix]}} {{path/to/myenv}}

Create a new environment at a custom path (i.e. prefix):

๐Ÿ”

git clone

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

Clone an existing repository.

git clone {{remote_repository_location}} {{path/to/directory}}

Clone an existing repository into a new directory (the default directory is the repository name):

git clone --recursive {{remote_repository_location}}

Clone an existing repository and its submodules:

git clone {{[-n|--no-checkout]}} {{remote_repository_location}}

Clone only the `.git` directory of an existing repository:

๐Ÿ”

huggingface-cli

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

์ด ๋ช…๋ น์€ `hf`์˜ ๋ณ„์นญ์ž…๋‹ˆ๋‹ค.

tldr hf

์ž์„ธํ•œ ๋‚ด์šฉ์€ ์›๋ณธ ๋ช…๋ น์„ ์ฐธ๊ณ ํ•˜์„ธ์š”:

๐Ÿ”

pip install

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

Install Python packages.

pip install {{package1 package2 ...}}

Install one or more packages:

pip install {{package1 package2 ...}} {{[-U|--upgrade]}}

Upgrade all specified packages to the latest version, installing any that are not already present:

pip install {{package}}=={{version}}

Install a specific version of a package:

๐Ÿ”

python

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

Python ์–ธ์–ด ์ธํ„ฐํ”„๋ฆฌํ„ฐ.
๋” ๋งŽ์€ ์ •๋ณด: <https://docs.python.org/using/cmdline.html>.

python

REPL(๋Œ€ํ™”ํ˜• ์…ธ) ์‹œ์ž‘:

python {{path/to/file.py}}

ํŠน์ • Python ํŒŒ์ผ ์‹คํ–‰:

python -i {{path/to/file.py}}

ํŠน์ • Python ํŒŒ์ผ ์‹คํ–‰ ํ›„ REPL ์‹œ์ž‘:

๐Ÿ”

cls

์„ค๋ช… ๋ณด๊ธฐ โ–ผ

ํ™”๋ฉด์„ ์ง€์šฐ๊ณ  ์ƒ‰์ƒ์„ ์ดˆ๊ธฐํ™”ํ•˜๋Š” ๋ช…๋ น์–ด.
๋” ๋งŽ์€ ์ •๋ณด: <https://help.fdos.org/en/hhstndrd/batch/cls.htm>.

CLS

ํ™”๋ฉด์„ ์ง€์šฐ๊ณ  ์ƒ‰์ƒ์„ ํฐ์ƒ‰์—์„œ ๊ฒ€์ •์œผ๋กœ ์ดˆ๊ธฐํ™”:

// repository documentation