cloudpathlib

(★ 626)

Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.

Owner Repos

cookiecutter-data-science ★ 10,013

A logical, reasonably standardized, but flexible project structure for doing and sharing data science work.

Python
erdantic ★ 416

Entity relationship diagrams for Python data model classes like Pydantic

Python
competition-winners ★ 413

The code for the prize winners in DrivenData competitions.
concept-to-clinic ★ 366

ALCF Concept to Clinic Challenge

Python
deon ★ 310

A command line tool to easily add an ethics checklist to your data science projects.

Python
box-plots-sklearn ★ 296

An implementation of some of the tools used by the winner of the box plots competition using scikit-learn.

Jupyter Notebook

File Explorer

ZIP Download
  • .env.example
  • .gitignore
  • AGENTS.md
  • CODE_OF_CONDUCT.md
  • CONTRIBUTING.md
  • HISTORY.md
  • LICENSE
  • Makefile
  • pyproject.toml
  • README.md
  • requirements-dev.txt
  • setup.cfg

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Link
Example

Command Glossary

Commands referenced in this DOCs, explained below.

🔍

conda install

View Details ▼

Install packages into an existing conda environment.

conda install {{package1 package2 ...}}

Install one or more package into the currently active conda environment:

conda install {{[-c|--channel]}} conda-forge {{package}}

Install a single package into the currently active conda environment using channel conda-forge:

conda install {{[-c|--channel]}} conda-forge --override-channels {{package}}

Install a single package into the currently active conda environment using channel conda-forge and ignoring other channels:

🔍

conda

View Details ▼

Package, dependency, and environment management for any programming language.
Some subcommands such as `create` have their own usage documentation.
See also: `mamba`.

conda create {{[-n|--name]}} {{environment_name}} {{python=3.9 matplotlib}}

Create a new environment, installing named packages into it:

conda info {{[-e|--envs]}}

List all environments:

conda activate {{environment_name}}

Activate an environment:

🔍

glob

View Details ▼

Glob patterns (`glob`) are patterns used to match and search text.
Note: `glob` isn't a command, but syntax to be used with other commands or the shell.
See also: `regex`.

*

Match zero or more of any characters:

?

Match any single character:

[{{abc}}]

Match one character in a set of characters:

🔍

pip install

View Details ▼

Install Python packages.

pip install {{package1 package2 ...}}

Install one or more packages:

pip install {{package1 package2 ...}} {{[-U|--upgrade]}}

Upgrade all specified packages to the latest version, installing any that are not already present:

pip install {{package}}=={{version}}

Install a specific version of a package:

🔍

readlink

View Details ▼

Follow symlinks and get symlink information.

readlink {{path/to/file}}

Get the actual file to which the symlink points:

readlink {{[-f|--canonicalize]}} {{path/to/file}}

Get the absolute path to a file:

🔍

rename

View Details ▼

Rename a file or group of files with a `regex`.
WARNING: This command will overwrite files without prompting unless the dry-run option is used.
Note: This page refers to the Perl version, also known as `file-rename`.

rename 's/{{from}}/{{to}}/' {{*.txt}}

Replace `from` with `to` in the filenames of the specified files:

rename {{foo}} {{bar}} {{*}}

Rename files using simple substitutions (substitute `foo` with `bar` wherever found):

rename -n 's/{{from}}/{{to}}/' {{*.txt}}

Dry-run - display which changes would occur without performing them:

🔍

stat

View Details ▼

Display file and filesystem information.
See also: `file`.

stat {{path/to/file}}

Display properties about a specific file such as size, permissions, creation date, and access date among others:

stat {{path/to/file}}

Show file properties such as size, permissions, creation date, and access date among others:

stat {{[-t|--terse]}} {{path/to/file}}

Display properties about a specific file, only showing the raw result data without labels:

🔍

unlink

View Details ▼

Remove a link to a file from the filesystem.
The file contents is lost if the link is the last one to the file.

unlink {{path/to/file}}

Remove the specified file if it is the last link:

🔍

copy

View Details ▼

Copy files.

COPY {{path/to/source_file}} {{path/to/destination_file}}

Copy a file:

🔍

container

View Details ▼

Create and run Linux containers as lightweight virtual machines on macOS.

container system start

Start the container services (required before running containers):

container run --rm {{[-it|--interactive --tty]}} {{image}} {{sh}}

Run a container from an image interactively and remove it after it exits:

container run {{[-d|--detach]}} --name {{container_name}} {{[-p|--publish]}} {{8080:80}} {{image}}

Run a container in the background with a name and a published port:

🔍

md5

View Details ▼

Calculate MD5 cryptographic checksums.

md5 {{path/to/file}}

Calculate the MD5 checksum for a file:

md5 {{path/to/file1 path/to/file2 ...}}

Calculate MD5 checksums for multiple files:

md5 -q {{path/to/file}}

Output only the MD5 checksum (no filename):

🔍

replace

View Details ▼

Replace files.
See also: `robocopy`, `move`, `del`.

replace {{path\to\file_or_directory}} {{path\to\destination_directory}}

Replace the destination file with the one from the source directory:

replace {{path\to\file_or_directory}} {{path\to\destination_directory}} /a

Add files to the destination directory instead of replacing existing files:

replace {{path\to\file_or_directory}} {{path\to\destination_directory}} /p

Interactively copy multiple files, with a prompt before replacing or adding a destination file:

// repository documentation