agora
A collaborative training library
File Explorer
- SKILL.md
- build-push-container.yml
- 8B_sparta_async_C.yaml
- default.yaml
- default.yaml
- authorizer.py
- integrity_check.cpython-311-x86_64-linux-gnu.so
- __init__.py
- cli_logger.py
- common.py
- connection_test_server.py
- state_loader.py
- __init__.py
- run_server.py
- pyproject.toml
- ar_runner.py
- matchmaking.py
- partition.py
- averager.py
- compression.py
- gradient_averager.py
- gradient_averager_powersgd.py
- gradient_averager_random_proj.py
- state_averager.py
- state_averager_sparta.py
- optimizer_async.py
- optimizer_sparta_async_nstep.py
- optimizer_sparta_sync.py
- optimizer_sync.py
- progress_tracker.py
- bounded_task_pool.py
- dht_handler.py
- module_collab.py
- runtime.py
- server.py
- file_logger.py
- formatters.py
- log_monitor.py
- logger.py
- arguments.py
- components.py
- experts.py
- arguments.py
- components.py
- experts.py
- arguments.py
- experts.py
- arguments_registry.py
- base_arguments.py
- expert_registry.py
- lr_schedule.py
- dht_monitor.py
- gpu_util_monitor.py
- mem_monitor.py
- network_throughput.py
- peer_visibility.py
- monitor.py
- roles.py
- auth.py
- authorizer.py
- validator_builder.py
- validator_schema.py
- __init__.py
- cloud_detect.py
- common.py
- configs.py
- dht_partition.py
- flops.py
- node_info.py
- subspace.py
- __init__.py
- types.py
- pyproject.toml
- fault-tolerance.md
- memory-communication.md
- mp-compression.svg
- overview.md
- research-foundations.md
- startup-sequence.md
- system-architecture.svg
- training-architecture.md
- custom.css
- extras.js
- aws-inbound-rules.png
- favicon.png
- gcp-inbound-rules.png
- lambda-inbound-rules.png
- runpod-edit-pod.png
- runpod-external-port.png
- runpod-inbound-rules.png
- tensordock-external-port.png
- tensordock-forwarded-ports.png
- cloud.md
- index.md
- network.md
- useful-links.md
- advanced.md
- index.md
- points.md
- requirements.md
- run.md
- index.md
- agora-logo-black.svg
- agora-logo-white.svg
- dashboard-button.svg
- run-concluded-banner.svg
- .gitignore
- agora_cli.py
- constraints.txt
- Dockerfile
- LICENSE
- mkdocs.yml
- README.md
- run.json
- THIRD_PARTY_LICENSES.md
# Use via CDN
jsDelivrjsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.
Command Glossary
Commands referenced in this DOCs, explained below.
conda activate
View Details ▼
conda activate
Activate a conda environment.
See also: `conda deactivate`.
conda activate myenv
Activate an existing environment named `myenv`:
conda activate {{path/to/myenv}}
Activate an existing environment located at custom path:
conda activate --stack myenv
Stack `myenv` environment on top of a previous environment making libraries/commands/variables from both accessible:
conda create
View Details ▼
conda create
Create new conda environments.
conda create {{[-y|--yes]}} {{[-n|--name]}} py39 python=3.9 "numpy>=1.11" scipy
Create a new environment named `py39`, install Python 3.9, NumPy v1.11 or above in it, and the latest stable version of SciPy. Say yes to all confirmations:
conda create {{[-n|--name]}} myenv --file {{file1.yml}} --file {{file2.yml}}
Create a new environment named `myenv` and install packages listed in files:
conda create {{[-p|--prefix]}} {{path/to/myenv}}
Create a new environment at a custom path (i.e. prefix):
docker build
View Details ▼
docker build
Build an image from a Dockerfile.
docker build .
Build a Docker image using the Dockerfile in the current directory:
docker build {{github.com/creack/docker-firefox}}
Build a Docker image from a Dockerfile at a specified URL:
docker build {{[-t|--tag]}} {{name:tag}} .
Build a Docker image and tag it:
docker run
View Details ▼
docker run
This command is an alias of `docker container run`.
tldr docker container run
View documentation for the original command:
docker stop
View Details ▼
docker stop
This command is an alias of `docker container stop`.
tldr docker container stop
View documentation for the original command:
git clone
View Details ▼
git clone
Clone an existing repository.
git clone {{remote_repository_location}} {{path/to/directory}}
Clone an existing repository into a new directory (the default directory is the repository name):
git clone --recursive {{remote_repository_location}}
Clone an existing repository and its submodules:
git clone {{[-n|--no-checkout]}} {{remote_repository_location}}
Clone only the `.git` directory of an existing repository:
nvidia-smi
View Details ▼
nvidia-smi
Aid the management and monitoring of NVIDIA GPU devices.
nvidia-smi
Display information on all available GPUs and processes using them:
nvidia-smi {{[-q|--query]}}
Display more detailed GPU information:
nvidia-smi dmon
Monitor overall GPU usage with 1-second update interval:
pip install
View Details ▼
pip install
Install Python packages.
pip install {{package1 package2 ...}}
Install one or more packages:
pip install {{package1 package2 ...}} {{[-U|--upgrade]}}
Upgrade all specified packages to the latest version, installing any that are not already present:
pip install {{package}}=={{version}}
Install a specific version of a package:
python3
View Details ▼
python3
This command is an alias of `python`.
tldr python
View documentation for the original command:
ulimit
View Details ▼
ulimit
Get and set resource limits for user processes.
This is a shell builtin hence not shell-agnostic.
ulimit -a
Get the properties of all the user limits:
ulimit -H -n
Get hard limit for the number of simultaneously opened files:
ulimit -S -n
Get soft limit for the number of simultaneously opened files:
