smevals
A framework for running evals against small (and large) models
File Explorer
- publish.yml
- test.yml
- haiku-structure
- llm-judge
- default.yaml
- default.yaml
- judge.yaml
- bicycles.yaml
- evals.yaml
- pelicans.yaml
- .gitignore
- eval.yaml
- run-llm
- table-check
- default.yaml
- default.yaml
- empty-cells.yaml
- pipes-and-commas.yaml
- simple.yaml
- eval.yaml
- run-llm
- extract-svg
- llm-judge-image
- render-svg
- default.yaml
- default.yaml
- pelican-svg.yaml
- .gitignore
- eval.yaml
- run-llm
- __init__.py
- app.html
- cli.py
- site.py
- conftest.py
- test_grade.py
- test_report.py
- test_run.py
- test_site.py
- test_units.py
- .gitignore
- ABOUT.md
- catalog-info.yaml
- LICENSE
- pyproject.toml
- README.md
# Use via CDN
jsDelivrjsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.
Command Glossary
Commands referenced in this DOCs, explained below.
llm
View Details ▼
llm
Interact with Large Language Models (LLMs) via remote APIs and models that can be installed and run on your machine.
llm keys set openai
Set up an OpenAI API Key:
llm "{{Ten fun names for a pet pelican}}"
Run a prompt:
cat {{path/to/file.py}} | llm {{[-s|--system]}} "{{Explain this code}}"
Run a system prompt against a file:
pass
View Details ▼
pass
Store and read passwords or other sensitive data.
All data is GPG-encrypted, and managed with a Git repository.
pass init {{gpg_id_1 gpg_id_2 ...}}
Initialize (or re-encrypt) the storage using one or more GPG IDs:
pass insert {{[-m|--multiline]}} {{path/to/data}}
Save a new password and additional information (press `<Ctrl d>` on a new line to complete):
pass edit {{path/to/data}}
Edit an entry:
pip install
View Details ▼
pip install
Install Python packages.
pip install {{package1 package2 ...}}
Install one or more packages:
pip install {{package1 package2 ...}} {{[-U|--upgrade]}}
Upgrade all specified packages to the latest version, installing any that are not already present:
pip install {{package}}=={{version}}
Install a specific version of a package:
uv tool
View Details ▼
uv tool
Install and run commands provided by Python packages.
uv tool run {{command}}
Run a command from a package, without installing it:
uv tool install {{package}}
Install a Python package system-wide:
uv tool upgrade {{package}}
Upgrade an installed Python package:
uvx
View Details ▼
uvx
This command is an alias of `uv tool run`.
tldr uv tool
View documentation for the original command:
prompt
View Details ▼
prompt
Change the default DOS style prompt in a command window.
prompt
Reset the prompt to the default setting:
prompt {{prompt}}
Set a specific prompt:
prompt $D $P$G
Change the prompt to show the current date first:
