minitest-reporters-llm

KO | EN

gitlite — search

#hacktoberfest #ai #typescript #llm #android #machine-learning #docker #macos #nodejs #windows #kubernetes #awesome-list #vue #openai

minitest-reporters-llm

(★ 12)

Token-optimized Minitest reporter for LLM consumption with regression tracking

minitest-reporters-llm 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Minitest::Reporters::LLM

A token-optimized Minitest reporter specifically designed for Large Language Model consumption. Features ultra-compact output, regression tracking, and smart time formatting to minimize token usage while maintaining maximum parsability.

## Installation

Add this line to your application's Gemfile:

```ruby
gem 'minitest-reporters-llm'
```

And then execute:

$ bundle

Or install it yourself as:

$ gem install minitest-reporters-llm

## Usage

### Basic Setup

```ruby
# In test_helper.rb or wherever you configure minitest-reporters
require 'minitest/reporters/llm'

# Use compact format (default)
Minitest::Reporters.use! [Minitest::Reporters::LLMReporter.new]

# Or with options
Minitest::Reporters.use! [
  Minitest::Reporters::LLMReporter.new(
    format: :compact,                    # :compact or :verbose
    results_file: 'tmp/test_results.json',
    report_file: 'tmp/test_report.toml',
    track_regressions: true,             # Track test status changes
    write_reports: true                  # Write JSON/TOML reports
  )
]
```

### Output Formats

#### Compact Mode (Optimized for LLMs)
```
15 tests,12 passed,2 failures,1 error,0 skips 2.3s
reg: 1 new,0 fixed
FAIL user_test.rb:45 validation fails
ERROR api_test.rb:12 connection timeout
```

- Summary line: `{total} tests,{passed} passed,{failures} failures,{errors} errors,{skips} skips {duration}`
- `FAIL/ERROR/SKIP` = Individual failure/error/skip lines
- `reg: X new,Y fixed` = Regression summary (X new failures, Y fixes)

#### Verbose Mode (Human-friendly)
```
15 tests (2.3s)
12 passed
2 failed: validation fails@user_test.rb:45, connection timeout@api_test.rb:12
1 error: api_test.rb:12

Details:
----------------------------------------
FAIL test_validation_fails
   user_test.rb:45
   Expected true, got false
```

### Smart Time Formatting
- `<1ms` - Sub-millisecond tests
- `15ms` - Millisecond precision
- `2.3s` - Second precision
- `1m30s` - Minute/second format

### Environment Variables
```bash
# Override default file paths
export LLM_REPORTER_RESULTS="custom/results.json"
export LLM_REPORTER_TOML="custom/report.toml"

# Override default format
export LLM_REPORTER_FORMAT="verbose"  # or "compact" (default)
```

### Regression Tracking
The reporter automatically tracks test status changes between runs:
- Saves test results to JSON file
- Compares current run with previous results
- Shows `REG +X -Y` for new failures/fixes
- Helps identify flaky or newly broken tests

## Development

After checking out the repo, run `bin/setup` to install dependencies. Then, run `rake test` to run the tests. You can also run `bin/console` for an interactive prompt that will allow you to experiment.

To install this gem onto your local machine, run `bundle exec rake install`. To release a new version, update the version number in `version.rb`, and then run `bundle exec rake release`, which will create a git tag for the version, push git commits and tags, and push the `.gem` file to [rubygems.org](https://rubygems.org).

## Features

- **Token-optimized output**: 70% fewer tokens than traditional reporters
- **Smart time formatting**: Automatically chooses optimal precision (`<1ms`, `15ms`, `2.3s`, `1m30s`)
- **Regression tracking**: Detects new failures and fixes between test runs
- **Dual output modes**: Compact for LLMs, verbose for humans
- **Configurable file paths**: No hardcoded temporary directories
- **TOML/JSON reports**: Structured data export for further analysis
- **Minimal dependencies**: Built on minitest and minitest-reporters

## Why Use This Reporter?

Perfect for:
- **AI-assisted development** workflows
- **CI/CD systems** requiring compact output
- **Log analysis** and automated test result processing
- **Token-conscious** LLM integrations
- **Regression monitoring** across test runs

## Contributing

Bug reports and pull requests are welcome on GitHub at https://github.com/seuros/minitest-reporters-llm.

## License

The gem is available as open source under the terms of the [MIT License](https://opensource.org/licenses/MIT).

minitest-reporters-llm

minitest-reporters-llm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

minitest-reporters-llm

minitest-reporters-llm 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README