mmperf

(★ 138)

MatMul Performance Benchmarks for a Single CPU Core comparing both hand engineered and codegen kernels.

File Explorer

Download Latest Version (.zip)

- - ci.yaml
- benchmark_all_sizes.txt
- benchmark_inceptionv3.txt
- benchmark_mobilenetv3_large.txt
- benchmark_resnet50.txt
- benchmark_small_sizes.txt
- benchmark_tiny.txt
- bert_large_matmul.txt
- bert_minilm_l12_h384_matmul.txt
- mobilebert.txt
- torch_bench.txt
- build.sh
- configure.sh
- setup-build-env-ubuntu-20.04-x86_64.sh
- test.sh
- common.cmake
- debugging.md
- benchmark
- cpuinfo
- flatbuffers
- Halide
- iree
- iree-llvm-sandbox
- llvm-project
- ruy
- tvm
- - CMakeLists.txt
- - CMakeLists.txt
  - compile_options.fbs
  - matmul-compile.cpp
- batch_matmul_mlir_BxMxNxK.mlir.in
- CMakeLists.txt
- main.cc
- matmul_column_major_mlir_MxNxK.mlir.in
- matmul_mlir_MxNxK.mlir.in
- matmul_mlircuda_MxNxK.mlir.in
- tiling.json
- tiling_for_large.json
- tiling_for_small.json
- - matmul-iree-common.cmake
- - batch_matmul_BxMxNxK.mlir
  - CMakeLists.txt
  - device_cuda.c
  - device_dylib.c
  - device_vmvx.c
  - matmul_generator.cc
  - matmul_linalg_MxNxK.mlir
  - matmul_MxNxK.mlir
- CMakeLists.txt
- - arch-info
  - matmul.png
  - matmul_accelerate_100x320x1280_perf.out
  - matmul_accelerate_100x384x1280_perf.out
  - matmul_accelerate_100x384x4032_perf.out
  - matmul_accelerate_100x448x1280_perf.out
  - matmul_accelerate_1024x1024x1024_perf.out
  - matmul_accelerate_1024x1024x512_perf.out
  - matmul_accelerate_1024x3072x512_perf.out
  - matmul_accelerate_12544x64x147_perf.out
  - matmul_accelerate_1369x48x256_perf.out
  - matmul_accelerate_1369x64x192_perf.out
  - matmul_accelerate_1369x64x288_perf.out
  - matmul_accelerate_16x1024x512_perf.out
  - matmul_accelerate_18x32x96_perf.out
  - matmul_accelerate_192x128x128_perf.out
  - matmul_accelerate_192x256x256_perf.out
  - matmul_accelerate_192x64x128_perf.out
  - matmul_accelerate_196x1024x256_perf.out
  - matmul_accelerate_196x1024x512_perf.out
  - matmul_accelerate_196x256x1024_perf.out
  - matmul_accelerate_196x256x2304_perf.out
  - matmul_accelerate_196x512x1024_perf.out
  - matmul_accelerate_22201x32x288_perf.out
  - matmul_accelerate_22201x64x288_perf.out
  - matmul_accelerate_22500x32x27_perf.out
  - matmul_accelerate_24x64x256_perf.out
  - matmul_accelerate_24x64x512_perf.out
  - matmul_accelerate_24x64x96_perf.out
  - matmul_accelerate_3072x1024x512_perf.out
  - matmul_accelerate_3136x64x64_perf.out
  - matmul_accelerate_324x384x2592_perf.out
  - matmul_accelerate_324x96x864_perf.out
  - matmul_accelerate_361x192x1120_perf.out
  - matmul_accelerate_361x192x768_perf.out
  - matmul_accelerate_384x128x128_perf.out
  - matmul_accelerate_384x128x512_perf.out
  - matmul_accelerate_384x256x256_perf.out
  - matmul_accelerate_384x384x32_perf.out
  - matmul_accelerate_384x384x512_perf.out
  - matmul_accelerate_384x512x128_perf.out
  - matmul_accelerate_384x512x2_perf.out
  - matmul_accelerate_480x512x16_perf.out
  - matmul_accelerate_480x512x256_perf.out
  - matmul_accelerate_48x64x128_perf.out
  - matmul_accelerate_49x2048x1024_perf.out
  - matmul_accelerate_49x2048x512_perf.out
  - matmul_accelerate_49x512x2048_perf.out
  - matmul_accelerate_49x512x4608_perf.out
  - matmul_accelerate_512x1024x1024_perf.out
  - matmul_accelerate_512x1024x16_perf.out
  - matmul_accelerate_512x1024x3072_perf.out
  - matmul_accelerate_512x3072x1024_perf.out
  - matmul_accelerate_5329x192x720_perf.out
  - matmul_accelerate_5625x80x64_perf.out
  - matmul_accelerate_784x120x40_perf.out
  - matmul_accelerate_784x128x1152_perf.out
  - matmul_accelerate_784x40x120_perf.out
  - matmul_accelerate_784x40x72_perf.out
  - matmul_accelerate_784x512x128_perf.out
  - matmul_accelerate_81x320x1728_perf.out
  - matmul_accelerate_83x192x1728_perf.out
  - matmul_accelerate_9x1001x2048_perf.out
  - matmul_ireedylib_100x320x1280_perf.out
  - matmul_ireedylib_100x384x1280_perf.out
  - matmul_ireedylib_100x384x4032_perf.out
  - matmul_ireedylib_100x448x1280_perf.out
  - matmul_ireedylib_1024x1024x1024_perf.out
  - matmul_ireedylib_1024x1024x512_perf.out
  - matmul_ireedylib_1024x3072x512_perf.out
  - matmul_ireedylib_12544x64x147_perf.out
  - matmul_ireedylib_1369x48x256_perf.out
  - matmul_ireedylib_1369x64x192_perf.out
  - matmul_ireedylib_1369x64x288_perf.out
  - matmul_ireedylib_16x1024x512_perf.out
  - matmul_ireedylib_18x32x96_perf.out
  - matmul_ireedylib_192x128x128_perf.out
  - matmul_ireedylib_192x256x256_perf.out
  - matmul_ireedylib_192x64x128_perf.out
  - matmul_ireedylib_196x1024x256_perf.out
  - matmul_ireedylib_196x1024x512_perf.out
  - matmul_ireedylib_196x256x1024_perf.out
  - matmul_ireedylib_196x256x2304_perf.out
  - matmul_ireedylib_196x512x1024_perf.out
  - matmul_ireedylib_22201x32x288_perf.out
  - matmul_ireedylib_22201x64x288_perf.out
  - matmul_ireedylib_22500x32x27_perf.out
  - matmul_ireedylib_24x64x256_perf.out
  - matmul_ireedylib_24x64x512_perf.out
  - matmul_ireedylib_24x64x96_perf.out
  - matmul_ireedylib_3072x1024x512_perf.out
  - matmul_ireedylib_3136x64x64_perf.out
  - matmul_ireedylib_324x384x2592_perf.out
  - matmul_ireedylib_324x96x864_perf.out
  - matmul_ireedylib_361x192x1120_perf.out
  - matmul_ireedylib_361x192x768_perf.out
  - matmul_ireedylib_384x128x128_perf.out
  - matmul_ireedylib_384x128x512_perf.out
  - matmul_ireedylib_384x256x256_perf.out
  - matmul_ireedylib_384x384x32_perf.out
  - matmul_ireedylib_384x384x512_perf.out
  - matmul_ireedylib_384x512x128_perf.out
  - matmul_ireedylib_384x512x2_perf.out
  - matmul_ireedylib_480x512x16_perf.out
  - matmul_ireedylib_480x512x256_perf.out
  - matmul_ireedylib_48x64x128_perf.out
  - matmul_ireedylib_49x2048x1024_perf.out
  - matmul_ireedylib_49x2048x512_perf.out
  - matmul_ireedylib_49x512x2048_perf.out
  - matmul_ireedylib_49x512x4608_perf.out
  - matmul_ireedylib_512x1024x1024_perf.out
  - matmul_ireedylib_512x1024x16_perf.out
  - matmul_ireedylib_512x1024x3072_perf.out
  - matmul_ireedylib_512x3072x1024_perf.out
  - matmul_ireedylib_5329x192x720_perf.out
  - matmul_ireedylib_5625x80x64_perf.out
  - matmul_ireedylib_784x120x40_perf.out
  - matmul_ireedylib_784x128x1152_perf.out
  - matmul_ireedylib_784x40x120_perf.out
  - matmul_ireedylib_784x40x72_perf.out
  - matmul_ireedylib_784x512x128_perf.out
  - matmul_ireedylib_81x320x1728_perf.out
  - matmul_ireedylib_83x192x1728_perf.out
  - matmul_ireedylib_9x1001x2048_perf.out
  - matmul_ruy_100x320x1280_perf.out
  - matmul_ruy_100x384x1280_perf.out
  - matmul_ruy_100x384x4032_perf.out
  - matmul_ruy_100x448x1280_perf.out
  - matmul_ruy_1024x1024x1024_perf.out
  - matmul_ruy_1024x1024x512_perf.out
  - matmul_ruy_1024x3072x512_perf.out
  - matmul_ruy_12544x64x147_perf.out
  - matmul_ruy_1369x48x256_perf.out
  - matmul_ruy_1369x64x192_perf.out
  - matmul_ruy_1369x64x288_perf.out
  - matmul_ruy_16x1024x512_perf.out
  - matmul_ruy_18x32x96_perf.out
  - matmul_ruy_192x128x128_perf.out
  - matmul_ruy_192x256x256_perf.out
  - matmul_ruy_192x64x128_perf.out
  - matmul_ruy_196x1024x256_perf.out
  - matmul_ruy_196x1024x512_perf.out
  - matmul_ruy_196x256x1024_perf.out
  - matmul_ruy_196x256x2304_perf.out
  - matmul_ruy_196x512x1024_perf.out
  - matmul_ruy_22201x32x288_perf.out
  - matmul_ruy_22201x64x288_perf.out
  - matmul_ruy_22500x32x27_perf.out
  - matmul_ruy_24x64x256_perf.out
  - matmul_ruy_24x64x512_perf.out
  - matmul_ruy_24x64x96_perf.out
  - matmul_ruy_3072x1024x512_perf.out
  - matmul_ruy_3136x64x64_perf.out
  - matmul_ruy_324x384x2592_perf.out
  - matmul_ruy_324x96x864_perf.out
  - matmul_ruy_361x192x1120_perf.out
  - matmul_ruy_361x192x768_perf.out
  - matmul_ruy_384x128x128_perf.out
  - matmul_ruy_384x128x512_perf.out
  - matmul_ruy_384x256x256_perf.out
  - matmul_ruy_384x384x32_perf.out
  - matmul_ruy_384x384x512_perf.out
  - matmul_ruy_384x512x128_perf.out
  - matmul_ruy_384x512x2_perf.out
  - matmul_ruy_480x512x16_perf.out
  - matmul_ruy_480x512x256_perf.out
  - matmul_ruy_48x64x128_perf.out
  - matmul_ruy_49x2048x1024_perf.out
  - matmul_ruy_49x2048x512_perf.out
  - matmul_ruy_49x512x2048_perf.out
  - matmul_ruy_49x512x4608_perf.out
  - matmul_ruy_512x1024x1024_perf.out
  - matmul_ruy_512x1024x16_perf.out
  - matmul_ruy_512x1024x3072_perf.out
  - matmul_ruy_512x3072x1024_perf.out
  - matmul_ruy_5329x192x720_perf.out
  - matmul_ruy_5625x80x64_perf.out
  - matmul_ruy_784x120x40_perf.out
  - matmul_ruy_784x128x1152_perf.out
  - matmul_ruy_784x40x120_perf.out
  - matmul_ruy_784x40x72_perf.out
  - matmul_ruy_784x512x128_perf.out
  - matmul_ruy_81x320x1728_perf.out
  - matmul_ruy_83x192x1728_perf.out
  - matmul_ruy_9x1001x2048_perf.out
  - result_matmul_accelerate_100x320x1280.csv
  - result_matmul_accelerate_100x384x1280.csv
  - result_matmul_accelerate_100x384x4032.csv
  - result_matmul_accelerate_100x448x1280.csv
  - result_matmul_accelerate_1024x1024x1024.csv
  - result_matmul_accelerate_1024x1024x512.csv
  - result_matmul_accelerate_1024x3072x512.csv
  - result_matmul_accelerate_12544x64x147.csv
  - result_matmul_accelerate_1369x48x256.csv
  - result_matmul_accelerate_1369x64x192.csv
  - result_matmul_accelerate_1369x64x288.csv
  - result_matmul_accelerate_16x1024x512.csv
  - result_matmul_accelerate_18x32x96.csv
  - result_matmul_accelerate_192x128x128.csv
  - result_matmul_accelerate_192x256x256.csv
  - result_matmul_accelerate_192x64x128.csv
  - result_matmul_accelerate_196x1024x256.csv
  - result_matmul_accelerate_196x1024x512.csv
  - result_matmul_accelerate_196x256x1024.csv
  - result_matmul_accelerate_196x256x2304.csv
  - result_matmul_accelerate_196x512x1024.csv
  - result_matmul_accelerate_22201x32x288.csv
  - result_matmul_accelerate_22201x64x288.csv
  - result_matmul_accelerate_22500x32x27.csv
  - result_matmul_accelerate_24x64x256.csv
  - result_matmul_accelerate_24x64x512.csv
  - result_matmul_accelerate_24x64x96.csv
  - result_matmul_accelerate_3072x1024x512.csv
  - result_matmul_accelerate_3136x64x64.csv
  - result_matmul_accelerate_324x384x2592.csv
  - result_matmul_accelerate_324x96x864.csv
  - result_matmul_accelerate_361x192x1120.csv
  - result_matmul_accelerate_361x192x768.csv
  - result_matmul_accelerate_384x128x128.csv
  - result_matmul_accelerate_384x128x512.csv
  - result_matmul_accelerate_384x256x256.csv
  - result_matmul_accelerate_384x384x32.csv
  - result_matmul_accelerate_384x384x512.csv
  - result_matmul_accelerate_384x512x128.csv
  - result_matmul_accelerate_384x512x2.csv
  - result_matmul_accelerate_480x512x16.csv
  - result_matmul_accelerate_480x512x256.csv
  - result_matmul_accelerate_48x64x128.csv
  - result_matmul_accelerate_49x2048x1024.csv
  - result_matmul_accelerate_49x2048x512.csv
  - result_matmul_accelerate_49x512x2048.csv
  - result_matmul_accelerate_49x512x4608.csv
  - result_matmul_accelerate_512x1024x1024.csv
  - result_matmul_accelerate_512x1024x16.csv
  - result_matmul_accelerate_512x1024x3072.csv
  - result_matmul_accelerate_512x3072x1024.csv
  - result_matmul_accelerate_5329x192x720.csv
  - result_matmul_accelerate_5625x80x64.csv
  - result_matmul_accelerate_784x120x40.csv
  - result_matmul_accelerate_784x128x1152.csv
  - result_matmul_accelerate_784x40x120.csv
  - result_matmul_accelerate_784x40x72.csv
  - result_matmul_accelerate_784x512x128.csv
  - result_matmul_accelerate_81x320x1728.csv
  - result_matmul_accelerate_83x192x1728.csv
  - result_matmul_accelerate_9x1001x2048.csv
  - result_matmul_ireedylib_100x320x1280.csv
  - result_matmul_ireedylib_100x384x1280.csv
  - result_matmul_ireedylib_100x384x4032.csv
  - result_matmul_ireedylib_100x448x1280.csv
  - result_matmul_ireedylib_1024x1024x1024.csv
  - result_matmul_ireedylib_1024x1024x512.csv
  - result_matmul_ireedylib_1024x3072x512.csv
  - result_matmul_ireedylib_12544x64x147.csv
  - result_matmul_ireedylib_1369x48x256.csv
  - result_matmul_ireedylib_1369x64x192.csv
  - result_matmul_ireedylib_1369x64x288.csv
  - result_matmul_ireedylib_16x1024x512.csv
  - result_matmul_ireedylib_18x32x96.csv
  - result_matmul_ireedylib_192x128x128.csv
  - result_matmul_ireedylib_192x256x256.csv
  - result_matmul_ireedylib_192x64x128.csv
  - result_matmul_ireedylib_196x1024x256.csv
  - result_matmul_ireedylib_196x1024x512.csv
  - result_matmul_ireedylib_196x256x1024.csv
  - result_matmul_ireedylib_196x256x2304.csv
  - result_matmul_ireedylib_196x512x1024.csv
  - result_matmul_ireedylib_22201x32x288.csv
  - result_matmul_ireedylib_22201x64x288.csv
  - result_matmul_ireedylib_22500x32x27.csv
  - result_matmul_ireedylib_24x64x256.csv
  - result_matmul_ireedylib_24x64x512.csv
  - result_matmul_ireedylib_24x64x96.csv
  - result_matmul_ireedylib_3072x1024x512.csv
  - result_matmul_ireedylib_3136x64x64.csv
  - result_matmul_ireedylib_324x384x2592.csv
  - result_matmul_ireedylib_324x96x864.csv
  - result_matmul_ireedylib_361x192x1120.csv
  - result_matmul_ireedylib_361x192x768.csv
  - result_matmul_ireedylib_384x128x128.csv
  - result_matmul_ireedylib_384x128x512.csv
  - result_matmul_ireedylib_384x256x256.csv
  - result_matmul_ireedylib_384x384x32.csv
  - result_matmul_ireedylib_384x384x512.csv
  - result_matmul_ireedylib_384x512x128.csv
  - result_matmul_ireedylib_384x512x2.csv
  - result_matmul_ireedylib_480x512x16.csv
  - result_matmul_ireedylib_480x512x256.csv
  - result_matmul_ireedylib_48x64x128.csv
  - result_matmul_ireedylib_49x2048x1024.csv
  - result_matmul_ireedylib_49x2048x512.csv
  - result_matmul_ireedylib_49x512x2048.csv
  - result_matmul_ireedylib_49x512x4608.csv
  - result_matmul_ireedylib_512x1024x1024.csv
  - result_matmul_ireedylib_512x1024x16.csv
  - result_matmul_ireedylib_512x1024x3072.csv
  - result_matmul_ireedylib_512x3072x1024.csv
  - result_matmul_ireedylib_5329x192x720.csv
  - result_matmul_ireedylib_5625x80x64.csv
  - result_matmul_ireedylib_784x120x40.csv
  - result_matmul_ireedylib_784x128x1152.csv
  - result_matmul_ireedylib_784x40x120.csv
  - result_matmul_ireedylib_784x40x72.csv
  - result_matmul_ireedylib_784x512x128.csv
  - result_matmul_ireedylib_81x320x1728.csv
  - result_matmul_ireedylib_83x192x1728.csv
  - result_matmul_ireedylib_9x1001x2048.csv
  - result_matmul_ruy_100x320x1280.csv
  - result_matmul_ruy_100x384x1280.csv
  - result_matmul_ruy_100x384x4032.csv
  - result_matmul_ruy_100x448x1280.csv
  - result_matmul_ruy_1024x1024x1024.csv
  - result_matmul_ruy_1024x1024x512.csv
  - result_matmul_ruy_1024x3072x512.csv
  - result_matmul_ruy_12544x64x147.csv
  - result_matmul_ruy_1369x48x256.csv
  - result_matmul_ruy_1369x64x192.csv
  - result_matmul_ruy_1369x64x288.csv
  - result_matmul_ruy_16x1024x512.csv
  - result_matmul_ruy_18x32x96.csv
  - result_matmul_ruy_192x128x128.csv
  - result_matmul_ruy_192x256x256.csv
  - result_matmul_ruy_192x64x128.csv
  - result_matmul_ruy_196x1024x256.csv
  - result_matmul_ruy_196x1024x512.csv
  - result_matmul_ruy_196x256x1024.csv
  - result_matmul_ruy_196x256x2304.csv
  - result_matmul_ruy_196x512x1024.csv
  - result_matmul_ruy_22201x32x288.csv
  - result_matmul_ruy_22201x64x288.csv
  - result_matmul_ruy_22500x32x27.csv
  - result_matmul_ruy_24x64x256.csv
  - result_matmul_ruy_24x64x512.csv
  - result_matmul_ruy_24x64x96.csv
  - result_matmul_ruy_3072x1024x512.csv
  - result_matmul_ruy_3136x64x64.csv
  - result_matmul_ruy_324x384x2592.csv
  - result_matmul_ruy_324x96x864.csv
  - result_matmul_ruy_361x192x1120.csv
  - result_matmul_ruy_361x192x768.csv
  - result_matmul_ruy_384x128x128.csv
  - result_matmul_ruy_384x128x512.csv
  - result_matmul_ruy_384x256x256.csv
  - result_matmul_ruy_384x384x32.csv
  - result_matmul_ruy_384x384x512.csv
  - result_matmul_ruy_384x512x128.csv
  - result_matmul_ruy_384x512x2.csv
  - result_matmul_ruy_480x512x16.csv
  - result_matmul_ruy_480x512x256.csv
  - result_matmul_ruy_48x64x128.csv
  - result_matmul_ruy_49x2048x1024.csv
  - result_matmul_ruy_49x2048x512.csv
  - result_matmul_ruy_49x512x2048.csv
  - result_matmul_ruy_49x512x4608.csv
  - result_matmul_ruy_512x1024x1024.csv
  - result_matmul_ruy_512x1024x16.csv
  - result_matmul_ruy_512x1024x3072.csv
  - result_matmul_ruy_512x3072x1024.csv
  - result_matmul_ruy_5329x192x720.csv
  - result_matmul_ruy_5625x80x64.csv
  - result_matmul_ruy_784x120x40.csv
  - result_matmul_ruy_784x128x1152.csv
  - result_matmul_ruy_784x40x120.csv
  - result_matmul_ruy_784x40x72.csv
  - result_matmul_ruy_784x512x128.csv
  - result_matmul_ruy_81x320x1728.csv
  - result_matmul_ruy_83x192x1728.csv
  - result_matmul_ruy_9x1001x2048.csv
- - best_config_128x1536x384.json
  - best_config_128x384x1536.json
  - best_config_128x384x384.json
  - best_config_12x128x128x32.json
  - best_config_12x128x32x128.json
  - best_config_1x384x384.json
- - arch-info
  - core_frequencies
  - cpuinfo
  - gpu-info
  - matmul.png
  - matmul_cublas_1024x1024x1_perf.out
  - matmul_cublas_1024x1024x512_perf.out
  - matmul_cublas_1024x3072x512_perf.out
  - matmul_cublas_1024x5x1_perf.out
  - matmul_cublas_16x1024x512_perf.out
  - matmul_cublas_1x1024x1024_perf.out
  - matmul_cublas_1x1024x5_perf.out
  - matmul_cublas_1x5x1024_perf.out
  - matmul_cublas_3072x1024x512_perf.out
  - matmul_cublas_512x1024x1024_perf.out
  - matmul_cublas_512x1024x16_perf.out
  - matmul_cublas_512x1024x3072_perf.out
  - matmul_cublas_512x3072x1024_perf.out
  - matmul_mlircuda_1024x1024x1_nsys_perf.out
  - matmul_mlircuda_1024x1024x512_nsys_perf.out
  - matmul_mlircuda_1024x3072x512_nsys_perf.out
  - matmul_mlircuda_1024x5x1_nsys_perf.out
  - matmul_mlircuda_16x1024x512_nsys_perf.out
  - matmul_mlircuda_1x1024x1024_nsys_perf.out
  - matmul_mlircuda_1x1024x5_nsys_perf.out
  - matmul_mlircuda_1x5x1024_nsys_perf.out
  - matmul_mlircuda_3072x1024x512_nsys_perf.out
  - matmul_mlircuda_512x1024x1024_nsys_perf.out
  - matmul_mlircuda_512x1024x16_nsys_perf.out
  - matmul_mlircuda_512x1024x3072_nsys_perf.out
  - matmul_mlircuda_512x3072x1024_nsys_perf.out
  - matmul_tvmcuda_1024x1024x1_nsys_perf.out
  - matmul_tvmcuda_1024x1024x512_nsys_perf.out
  - matmul_tvmcuda_1024x3072x512_nsys_perf.out
  - matmul_tvmcuda_1024x5x1_nsys_perf.out
  - matmul_tvmcuda_16x1024x512_nsys_perf.out
  - matmul_tvmcuda_1x1024x1024_nsys_perf.out
  - matmul_tvmcuda_1x1024x5_nsys_perf.out
  - matmul_tvmcuda_1x5x1024_nsys_perf.out
  - matmul_tvmcuda_3072x1024x512_nsys_perf.out
  - matmul_tvmcuda_512x1024x1024_nsys_perf.out
  - matmul_tvmcuda_512x1024x16_nsys_perf.out
  - matmul_tvmcuda_512x1024x3072_nsys_perf.out
  - matmul_tvmcuda_512x3072x1024_nsys_perf.out
  - result_matmul_mlircuda_1024x1024x1.csv
  - result_matmul_mlircuda_1024x1024x512.csv
  - result_matmul_mlircuda_1024x3072x512.csv
  - result_matmul_mlircuda_1024x5x1.csv
  - result_matmul_mlircuda_16x1024x512.csv
  - result_matmul_mlircuda_1x1024x1024.csv
  - result_matmul_mlircuda_1x1024x5.csv
  - result_matmul_mlircuda_1x5x1024.csv
  - result_matmul_mlircuda_3072x1024x512.csv
  - result_matmul_mlircuda_512x1024x1024.csv
  - result_matmul_mlircuda_512x1024x16.csv
  - result_matmul_mlircuda_512x1024x3072.csv
  - result_matmul_mlircuda_512x3072x1024.csv
  - result_matmul_tvmcuda_1024x1024x1.csv
  - result_matmul_tvmcuda_1024x1024x512.csv
  - result_matmul_tvmcuda_1024x3072x512.csv
  - result_matmul_tvmcuda_1024x5x1.csv
  - result_matmul_tvmcuda_16x1024x512.csv
  - result_matmul_tvmcuda_1x1024x1024.csv
  - result_matmul_tvmcuda_1x1024x5.csv
  - result_matmul_tvmcuda_1x5x1024.csv
  - result_matmul_tvmcuda_3072x1024x512.csv
  - result_matmul_tvmcuda_512x1024x1024.csv
  - result_matmul_tvmcuda_512x1024x16.csv
  - result_matmul_tvmcuda_512x1024x3072.csv
  - result_matmul_tvmcuda_512x3072x1024.csv
  - scaling_governor
- cuda_nodai7.png
- cuda_nodai_triton.png
- cuda_nodai_triton_fp16.png
- nodai_sandbox_matmul_results.json
- README.md
- tune_matmul.py
- tuner.py
.gitignore
.gitmodules
.pre-commit-config.yaml
CMakeLists.txt
generate_configs.py
iree_sandbox_matmul.py
LICENSE
mmperf.py
nodai_config_parser.py
README.md
requirements.txt
update_submodules.sh

# Installation Guide

1. Get the code

git clone https://github.com/mmperf/mmperf

Downloads the entire project code from GitHub to your computer.

cd mmperf

Moves into the project folder you just downloaded.

2. Official Install Script

Easy Recommended

Prerequisites

APT (Debian/Ubuntu 계열) Built into Debian/Ubuntu-based Linux distributions.

apt-get install -y clang-11 clang-tools-11 libc++1-11 libc++-11-dev \

Installs directly from the APT package repository (Debian/Ubuntu-based).

sudo apt install libclang-11-dev clang-11 liblld-11-dev

Installs directly from the APT package repository (Debian/Ubuntu-based).

sudo apt install libopenblas-dev

Installs directly from the APT package repository (Debian/Ubuntu-based).

✅ After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.

Pulled directly from this repo's README.

3. CMake

Medium

Prerequisites

Git Needed to download the project code from GitHub.
CMake The tool used to generate build configuration.
C/C++ 컴파일러 Windows needs Visual Studio (Community edition, free), macOS needs Xcode Command Line Tools, Linux needs the gcc/g++ package.

cmake -GNinja \

Type this command into your terminal and run it.

cmake --build build

Type this command into your terminal and run it.

HALIDE_DIR=/home/foo/lokal/halide/ MKL_DIR=/opt/intel/oneapi/mkl/latest/ cmake -GNinja \

Type this command into your terminal and run it.

LLD_DIR=/usr/lib/llvm-11/lib/cmake/lld cmake . -GNinja \

Type this command into your terminal and run it.

✅ Check that an executable was created inside the build folder, then run it directly (e.g. ./build/app_name).

Pulled directly from this repo's README.

4. Python

Easy

Prerequisites

Git Needed to download the project code from GitHub.
Python 3 On Windows, be sure to check 'Add Python to PATH' during installation.

python3 -m venv ./mmperf_env

Runs the Python script (or module).

pip install -r requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

pip install -r ./external/llvm-project/mlir/python/requirements.txt

Installs the Python libraries listed in requirements.txt (or similar).

✅ If it runs without errors and prints output in the terminal, it worked.

Pulled directly from this repo's README.

mmperf

File Explorer

# Installation Guide

2. Official Install Script

3. CMake

4. Python

Today's picks

Was this content helpful?

Recent Feedback

mmperf

File Explorer

# Installation Guide

2. Official Install Script

3. CMake

4. Python

Today's picks

Was this content helpful?

Recent Feedback

Download README