iwls2026-ls-contest

KO | EN

gitlite — search

#git #computer-vision #video #containers #kotlin #tailwindcss #deep-learning #c #rag #react

iwls2026-ls-contest

(★ 9)

No description available.

File Explorer

ZIP Download

- - ex200.truth
  - ex201.truth
  - ex202.truth
  - ex203.truth
  - ex204.truth
  - ex205.truth
  - ex206.truth
  - ex207.truth
  - ex208.truth
  - ex209.truth
  - ex210.truth
  - ex211.truth
  - ex212.truth
  - ex213.truth
  - ex214.truth
  - ex215.truth
  - ex216.truth
  - ex217.truth
  - ex218.truth
  - ex219.truth
  - ex220.truth
  - ex221.truth
  - ex222.truth
  - ex223.truth
  - ex224.truth
  - ex225.truth
  - ex226.truth
  - ex227.truth
  - ex228.truth
  - ex229.truth
  - ex230.truth
  - ex231.truth
  - ex232.truth
  - ex233.truth
  - ex234.truth
  - ex235.truth
  - ex236.truth
  - ex237.truth
  - ex238.truth
  - ex239.truth
  - ex240.truth
  - ex241.truth
  - ex242.truth
  - ex243.truth
  - ex244.truth
  - ex245.truth
  - ex246.truth
  - ex247.truth
  - ex248.truth
  - ex249.truth
  - ex250.truth
  - ex251.truth
  - ex252.truth
  - ex253.truth
  - ex254.truth
  - ex255.truth
  - ex256.truth
  - ex257.truth
  - ex258.truth
  - ex259.truth
  - ex260.truth
  - ex261.truth
  - ex262.truth
  - ex263.truth
  - ex264.truth
  - ex265.truth
  - ex266.truth
  - ex267.truth
  - ex268.truth
  - ex269.truth
  - ex270.truth
  - ex271.truth
  - ex272.truth
  - ex273.truth
  - ex274.truth
  - ex275.truth
  - ex276.truth
  - ex277.truth
  - ex278.truth
  - ex279.truth
  - ex280.truth
  - ex281.truth
  - ex282.truth
  - ex283.truth
  - ex284.truth
  - ex285.truth
  - ex286.truth
  - ex287.truth
  - ex288.truth
  - ex289.truth
  - ex290.truth
  - ex291.truth
  - ex292.truth
  - ex293.truth
  - ex294.truth
  - ex295.truth
  - ex296.truth
  - ex297.truth
  - ex298.truth
  - ex299.truth
- iwls2026_truth_tables.tar.gz
- IWLS_2026_Contest_Presentation_Team_Freiburg.pdf
- IWLS_2026_Contest_Presentation_Team_NTHU_CUHK.pdf
- IWLS_2026_Contest_Presentation_Team_NUP.pdf
- - ex200.png
  - ex201.png
  - ex202.png
  - ex203.png
  - ex204.png
  - ex205.png
  - ex206.png
  - ex207.png
  - ex208.png
  - ex209.png
  - ex210.png
  - ex211.png
  - ex212.png
  - ex213.png
  - ex214.png
  - ex215.png
  - ex216.png
  - ex217.png
  - ex218.png
  - ex219.png
  - ex220.png
  - ex221.png
  - ex222.png
  - ex223.png
  - ex224.png
  - ex225.png
  - ex226.png
  - ex227.png
  - ex228.png
  - ex229.png
  - ex230.png
  - ex231.png
  - ex232.png
  - ex233.png
  - ex234.png
  - ex235.png
  - ex236.png
  - ex237.png
  - ex238.png
  - ex239.png
  - ex240.png
  - ex241.png
  - ex242.png
  - ex243.png
  - ex244.png
  - ex245.png
  - ex246.png
  - ex247.png
  - ex248.png
  - ex249.png
  - ex250.png
  - ex251.png
  - ex252.png
  - ex253.png
  - ex254.png
  - ex255.png
  - ex256.png
  - ex257.png
  - ex258.png
  - ex259.png
  - ex260.png
  - ex261.png
  - ex262.png
  - ex263.png
  - ex264.png
  - ex265.png
  - ex266.png
  - ex267.png
  - ex268.png
  - ex269.png
  - ex270.png
  - ex271.png
  - ex272.png
  - ex273.png
  - ex274.png
  - ex275.png
  - ex276.png
  - ex277.png
  - ex278.png
  - ex279.png
  - ex280.png
  - ex281.png
  - ex282.png
  - ex283.png
  - ex284.png
  - ex285.png
  - ex286.png
  - ex287.png
  - ex288.png
  - ex289.png
  - ex290.png
  - ex291.png
  - ex292.png
  - ex293.png
  - ex294.png
  - ex295.png
  - ex296.png
  - ex297.png
  - ex298.png
  - ex299.png
- - ex200.txt
  - ex201.txt
  - ex202.txt
  - ex203.txt
  - ex204.txt
  - ex205.txt
  - ex206.txt
  - ex207.txt
  - ex208.txt
  - ex209.txt
  - ex210.txt
  - ex211.txt
  - ex212.txt
  - ex213.txt
  - ex214.txt
  - ex215.txt
  - ex216.txt
  - ex217.txt
  - ex218.txt
  - ex219.txt
  - ex220.txt
  - ex221.txt
  - ex222.txt
  - ex223.txt
  - ex224.txt
  - ex225.txt
  - ex226.txt
  - ex227.txt
  - ex228.txt
  - ex229.txt
  - ex230.txt
  - ex231.txt
  - ex232.txt
  - ex233.txt
  - ex234.txt
  - ex235.txt
  - ex236.txt
  - ex237.txt
  - ex238.txt
  - ex239.txt
  - ex240.txt
  - ex241.txt
  - ex242.txt
  - ex243.txt
  - ex244.txt
  - ex245.txt
  - ex246.txt
  - ex247.txt
  - ex248.txt
  - ex249.txt
  - ex250.txt
  - ex251.txt
  - ex252.txt
  - ex253.txt
  - ex254.txt
  - ex255.txt
  - ex256.txt
  - ex257.txt
  - ex258.txt
  - ex259.txt
  - ex260.txt
  - ex261.txt
  - ex262.txt
  - ex263.txt
  - ex264.txt
  - ex265.txt
  - ex266.txt
  - ex267.txt
  - ex268.txt
  - ex269.txt
  - ex270.txt
  - ex271.txt
  - ex272.txt
  - ex273.txt
  - ex274.txt
  - ex275.txt
  - ex276.txt
  - ex277.txt
  - ex278.txt
  - ex279.txt
  - ex280.txt
  - ex281.txt
  - ex282.txt
  - ex283.txt
  - ex284.txt
  - ex285.txt
  - ex286.txt
  - ex287.txt
  - ex288.txt
  - ex289.txt
  - ex290.txt
  - ex291.txt
  - ex292.txt
  - ex293.txt
  - ex294.txt
  - ex295.txt
  - ex296.txt
  - ex297.txt
  - ex298.txt
  - ex299.txt
- evaluation_notes.md
- pareto_plots.tar.gz
- pareto_tables.tar.gz
- scores.csv
- scoring_report.md
- cuhk.tar.gz
- freiburg.tar.gz
- hkust.tar.gz
- lix.tar.gz
- ningbo.tar.gz
- nthu.tar.gz
- ntu.tar.gz
- nup.tar.gz
- sjtu1.tar.gz
- sjtu2.tar.gz
- thu.tar.gz
- ucla.tar.gz
IWLS_2026_Contest_Presentation.pdf
IWLS_2026_Programming_Contest.pdf
LICENSE
README.md
score_iwls2026.py
virtual_best_solver.tar.gz

# Use via CDN

jsDelivr

jsDelivr serves any public GitHub repository as a CDN with zero setup. Pick a version and a file to get a ready-to-paste link and snippet.

Version

File

Link

Example

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

## Problems and Results of IWLS 2026 Programming Contest

This repository contains the benchmarks of the [IWLS 2026](https://www.iwls.org/)
Programming Contest, the circuits produced by the participants, the evaluation
script, and the final contest results.

The goal of the contest was to synthesize
[AIGs](https://en.wikipedia.org/wiki/And-inverter_graph) in
[binary AIGER format](http://fmv.jku.at/aiger/) for 100 completely-specified
multi-output Boolean functions represented using truth tables. Unlike previous
years, the 2026 contest evaluated a delay/area Pareto trade-off rather than a
single best circuit per benchmark. The two optimization objectives were:

- **Area**: number of internal two-input AND nodes.
- **Delay**: number of logic levels.

For detailed rules and evaluation criteria, please refer to this year's
[contest description](IWLS_2026_Programming_Contest.pdf).

The contest was organized by Alan Mishchenko and Attila Jurecska
(IWLS 2026 Contest Chairs).

---

### Benchmarks

The [benchmarks](benchmarks/truth) available in this repository include 100
truth tables, named `ex200.truth` through `ex299.truth`. They are also
available as one compressed archive:

- [iwls2026_truth_tables.tar.gz](benchmarks/iwls2026_truth_tables.tar.gz)

The high-level descriptions of the benchmarks are not disclosed because this is
a logic-synthesis competition and the participants are encouraged to develop
optimization methods that are broadly applicable rather than tailored to known
circuits.

---

### Evaluation

Submitted AIGs were checked for functional equivalence against the corresponding
truth table using [ABC](https://github.com/berkeley-abc/abc). Functionally
incorrect AIGs were discarded. Correct submissions were Pareto-pruned within
each team. The union of all team-local Pareto sets was then Pareto-pruned again
to form the virtual best solver (VBS).

The evaluation script is available here:

- [score_iwls2026.py](score_iwls2026.py)

To reproduce the scores, unpack the benchmark truth tables and participant
submission archives into the layout expected by the scoring script:

```text
<root>/
  truth/
    ex200.truth ... ex299.truth
  cuhk/
    ex2NN_LLL.aig ...
  freiburg/
    ex2NN_LLL.aig ...
  ...
```

Then make sure ABC is available on `$PATH` and run:

```bash
python3 score_iwls2026.py --root . --workers 8 --timeout 60
```

The script writes `scores.csv`, creates a `VBS/` directory, and moves files
that fail validation into per-team `buggy/` or `misnamed/` subdirectories.
When reproducing from the public archives, leave HKUST's
`functionally_incorrect/` subdirectory nested inside the HKUST directory; the
scorer considers only top-level `.aig` files, so these already-excluded files
are preserved for reference but are not scored again.

The complete score table and scoring report are available here:

- [scores.csv](results/scores.csv)
- [evaluation_notes.md](results/evaluation_notes.md)
- [scoring_report.md](results/scoring_report.md)
- [pareto_tables](results/pareto_tables)
- [pareto_tables.tar.gz](results/pareto_tables.tar.gz)
- [pareto_plots](results/pareto_plots)
- [pareto_plots.tar.gz](results/pareto_plots.tar.gz)

The virtual best solver (VBS) Pareto-frontier AIGs used for evaluation are
available as a compressed archive:

- [virtual_best_solver.tar.gz](virtual_best_solver.tar.gz)

The [Pareto frontier tables](results/pareto_tables) give one text table per
benchmark. Each table lists the VBS delay levels and the exact-level participant
Pareto entries at those levels. The same tables are also available as one
downloadable archive, [pareto_tables.tar.gz](results/pareto_tables.tar.gz).

The [Pareto frontier plots](results/pareto_plots) visualize the same data as
PNG images, with area on the x-axis and delay on the y-axis. They are also
available as [pareto_plots.tar.gz](results/pareto_plots.tar.gz).

---

### Final Standings

`AIGs` is the number of correct team-local Pareto AIGs after validation and
per-team Pareto pruning. `L_min` and `L_max` are the average minimum and maximum
correct submitted level per testcase. `N_ave` is the average AND-node count over
correct AIGs. `Score` is the final contest score.

| Rank | Team | AIGs | L_min | L_max | N_ave | Score |
|---:|---|---:|---:|---:|---:|---:|
| 1 | JetBrains / NUP / EPFL / MBZUAI | 1935 | 12.9 | 70.2 | 3912.4 | 90.2396 |
| 2 | National Tsing Hua University / CUHK | 1754 | 13.2 | 40.4 | 3057.4 | 74.5007 |
| 3 | University of Freiburg | 668 | 13.8 | 28.0 | 4661.8 | 65.4952 |
| 4 | ALCom Lab, National Taiwan University | 1269 | 13.7 | 37.8 | 3356.3 | 61.3668 |
| 5 | Ningbo University | 668 | 13.5 | 23.9 | 9493.1 | 53.9156 |
| 6 | UCLA | 1052 | 13.4 | 39.2 | 6324.6 | 48.9431 |
| 7 | AIR, Tsinghua University | 742 | 14.2 | 31.7 | 3810.8 | 44.6263 |
| 8 | Shanghai Jiao Tong University (S. Liu) | 728 | 13.2 | 26.9 | 5571.6 | 39.5174 |
| 9 | Chinese University of Hong Kong | 708 | 14.3 | 24.5 | 7356.0 | 35.1767 |
| 10 | HKUST (GZ) | 565 | 14.4 | 24.2 | 8512.3 | 23.2751 |
| 11 | Shanghai Jiao Tong University (Y. Huang) | 213 | 14.9 | 16.3 | 11799.6 | 21.9820 |
| 12 | LIX, Ecole Polytechnique | 233 | 20.5 | 22.0 | 21291.1 | 7.6552 |

For HKUST, `L_min` and `L_max` are averaged over 90 benchmarks because 10
benchmarks had no correct HKUST AIG after validation.

Please refer to the
[results presentation](IWLS_2026_Contest_Presentation.pdf) for more details.

---

### Submissions

With the participants' permission, the circuits submitted to the contest can be
found here:

- [submissions](submissions)

The public submission archives were generated from the unzipped AIG files used
for scoring. They are not the original submitted zip files. Each archive
contains the functionally correct AIGs for one participant. The HKUST archive
also contains a `functionally_incorrect/` subdirectory with submitted AIGs that
did not pass equivalence checking and were excluded from scoring.

| Archive | Team |
|---|---|
| [cuhk.tar.gz](submissions/cuhk.tar.gz) | Chinese University of Hong Kong |
| [freiburg.tar.gz](submissions/freiburg.tar.gz) | University of Freiburg |
| [hkust.tar.gz](submissions/hkust.tar.gz) | HKUST (GZ) |
| [lix.tar.gz](submissions/lix.tar.gz) | LIX, Ecole Polytechnique |
| [ningbo.tar.gz](submissions/ningbo.tar.gz) | Ningbo University |
| [nthu.tar.gz](submissions/nthu.tar.gz) | National Tsing Hua University / CUHK |
| [ntu.tar.gz](submissions/ntu.tar.gz) | ALCom Lab, National Taiwan University |
| [nup.tar.gz](submissions/nup.tar.gz) | JetBrains / NUP / EPFL / MBZUAI |
| [sjtu1.tar.gz](submissions/sjtu1.tar.gz) | Shanghai Jiao Tong University (S. Liu) |
| [sjtu2.tar.gz](submissions/sjtu2.tar.gz) | Shanghai Jiao Tong University (Y. Huang) |
| [thu.tar.gz](submissions/thu.tar.gz) | AIR, Tsinghua University |
| [ucla.tar.gz](submissions/ucla.tar.gz) | UCLA |

---

### Winners

Congratulations to the winners:

1. JetBrains / NUP / EPFL / MBZUAI
2. National Tsing Hua University / CUHK
3. University of Freiburg

Winner presentations can be found here:

- [Team NUP](presentations/IWLS_2026_Contest_Presentation_Team_NUP.pdf)
- [Team NTHU/CUHK](presentations/IWLS_2026_Contest_Presentation_Team_NTHU_CUHK.pdf)
- [Team Freiburg](presentations/IWLS_2026_Contest_Presentation_Team_Freiburg.pdf)

---

iwls2026-ls-contest

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

iwls2026-ls-contest

Owner Repos

File Explorer

# Use via CDN

Was this content helpful?

Recent Feedback

Download README