llama-halo-hybrid

(★ 9)

Modified llama.cpp to work with Strix Halo + Radeon R9700 as an accelerator, Dual Strix Halo Machines, or both

파일 탐색기

ZIP 다운로드

파일 수가 많아 일부만 표시됩니다. 전체 파일은 위 다운로드 버튼으로 확인해 주세요.

- - apps.nix
  - devshells.nix
  - docker.nix
  - jetson-support.nix
  - nixpkgs-instances.nix
  - package-gguf-py.nix
  - package.nix
  - python-scripts.nix
  - scope.nix
  - sif.nix
- cann.Dockerfile
- cpu.Dockerfile
- cuda.Dockerfile
- intel.Dockerfile
- llama-cli-cann.Dockerfile
- llama-cpp-cuda.srpm.spec
- llama-cpp.srpm.spec
- musa.Dockerfile
- openvino.Dockerfile
- rocm.Dockerfile
- s390x.Dockerfile
- tools.sh
- vulkan.Dockerfile
- zendnn.Dockerfile
- settings.json
- - 010-bug-compilation.yml
  - 011-bug-results.yml
  - 019-bug-misc.yml
  - 020-enhancement.yml
  - 030-research.yml
  - 040-refactor.yml
  - config.yml
- - ai-issues.yml
  - bench.yml.disabled
  - build-3rd-party.yml
  - build-and-test-snapdragon.yml
  - build-android.yml
  - build-apple.yml
  - build-cache.yml
  - build-cann.yml
  - build-cmake-pkg.yml
  - build-cpu.yml
  - build-cross.yml
  - build-cuda-ubuntu.yml
  - build-cuda-windows.yml
  - build-ibm.yml
  - build-msys.yml
  - build-opencl.yml
  - build-openvino.yml
  - build-riscv.yml
  - build-sanitize.yml
  - build-self-hosted.yml
  - build-sycl.yml
  - build-virtgpu.yml
  - build-vulkan.yml
  - build-wasm.yml
  - build-webgpu.yml
  - check-vendor.yml
  - close-issue.yml
  - code-style.yml
  - copilot-setup-steps.yml
  - docker.yml
  - editorconfig.yml
  - fusion.yml
  - gguf-publish.yml
  - hip-quality-check.yml
  - labeler.yml
  - make-release.yml
  - pr-draft-label.yml
  - pre-tokenizer-hashes.yml
  - python-check-requirements.yml
  - python-lint.yml
  - python-type-check.yml
  - release.yml
  - server-sanitize.yml
  - server-self-hosted.yml
  - server.yml
  - ui-build-self-hosted.yml
  - ui-build.yml
  - ui-publish.yml
  - ui-self-hosted.yml
  - ui.yml
  - update-ops-docs.yml
  - winget.yml
- labeler.yml
- pull_request_template.md
- - SYSTEM.md
- CMakeLists.txt
- download.cpp
- llama.cpp
- - aime25_openai__gpt-oss-120b-high_temp1.0_20251109_094547.html
  - aime25_openai__gpt-oss-120b-high_temp1.0_20251109_094547.json
  - aime25_openai__gpt-oss-120b-high_temp1.0_20251109_094547_allresults.json
  - dgx-spark.md
  - run-aime-120b-t8-x8-high.log
- - mac-m2-ultra.md
- - nemotron-dgx-spark.md
- README-MUSA.md
- README.md
- run.sh
- arm64-apple-clang.cmake
- arm64-linux-clang.cmake
- arm64-windows-llvm.cmake
- arm64-windows-msvc-cuda.cmake
- build-info.cmake
- common.cmake
- download-models.cmake
- git-vars.cmake
- license.cmake
- llama-config.cmake.in
- llama.pc.in
- riscv64-spacemit-linux-gnu-gcc.cmake
- x64-windows-llvm.cmake
- - caps.cpp
  - caps.h
  - lexer.cpp
  - lexer.h
  - parser.cpp
  - parser.h
  - README.md
  - runtime.cpp
  - runtime.h
  - string.cpp
  - string.h
  - utils.h
  - value.cpp
  - value.h
- - cohere2moe.cpp
  - deepseek.cpp
  - functionary-v3-2.cpp
  - gemma4.cpp
  - gigachat-v3.cpp
  - gpt-oss.cpp
  - kimi-k2.cpp
  - kimi-k3.cpp
  - lfm2.cpp
  - minicpm5.cpp
  - minimax-m3.cpp
  - ministral3.cpp
  - muse-glimmer.cpp
  - parsers.cpp
  - parsers.h
  - qwen3-coder.cpp
  - sources.cmake
- arg.cpp
- arg.h
- base64.hpp
- build-info.cpp.in
- build-info.h
- chat-auto-parser-generator.cpp
- chat-auto-parser-helpers.cpp
- chat-auto-parser-helpers.h
- chat-auto-parser.h
- chat-diff-analyzer.cpp
- chat-peg-parser.cpp
- chat-peg-parser.h
- chat.cpp
- chat.h
- CMakeLists.txt
- common.cpp
- common.h
- console.cpp
- console.h
- debug.cpp
- debug.h
- download.cpp
- download.h
- fit.cpp
- fit.h
- hf-cache.cpp
- hf-cache.h
- http.h
- imatrix-loader.cpp
- imatrix-loader.h
- json-schema-to-grammar.cpp
- json-schema-to-grammar.h
- json-schema.cpp
- json-schema.h
- json.cpp
- json.h
- llguidance.cpp
- log.cpp
- log.h
- ngram-cache.cpp
- ngram-cache.h
- ngram-map.cpp
- ngram-map.h
- ngram-mod.cpp
- ngram-mod.h
- peg-parser.cpp
- peg-parser.h
- preset.cpp
- preset.h
- reasoning-budget.cpp
- reasoning-budget.h
- sampling.cpp
- sampling.h
- speculative.cpp
- speculative.h
- subproc.cpp
- subproc.h
- trie.cpp
- trie.h
- unicode.cpp
- unicode.h
- __init__.py
- afmoe.py
- arctic.py
- baichuan.py
- bailingmoe.py
- bailingmoe3.py
- base.py
- bert.py
- bitnet.py
- bloom.py
- chameleon.py
- chatglm.py
- codeshell.py
- cogvlm.py
- command_r.py
- dbrx.py
- deci.py
- deepseek.py
- dots1.py
- dots3.py
- dotsocr.py
- dream.py
- ernie.py
- exaone.py
- falcon.py
- falcon_h1.py
- gemma.py
- glm.py
- glm5next.py
- gpt2.py
- gpt_oss.py
- gptneox.py
- granite.py
- grok.py
- grovemoe.py
- hunyuan.py
- hy_v4.py
- internlm.py
- internvl.py
- jais.py
- jamba.py
- januspro.py
- kimi_k3.py
- kimi_linear.py
- kimivl.py
- laguna.py
- lfm2.py
- lighton_ocr.py
- llada.py
- llama.py
- llama4.py
- llava.py
- maincoder.py
- mamba.py
- mellum.py
- mimo.py
- minicpm.py
- minimax.py
- mistral.py
- mistral3.py
- mpt.py
- muse_glimmer.py
- nanbeige.py
- nemotron.py
- olmo.py
- openelm.py
- orion.py
- pangu.py
- phi.py
- pixtral.py
- plamo.py
- plm.py
- pockettts.py
- qwen.py
- qwen3tts.py
- qwen3vl.py
- qwen4exp.py
- qwenvl.py
- refact.py
- rwkv.py
- sarashina2.py
- smallthinker.py
- smolvlm.py
- spark2_5.py
- stablelm.py
- starcoder.py
- step3.py
- t5.py
- talkie.py
- ultravox.py
- wavtokenizer.py
- xverse.py
- youtuvl.py
- - imported-into-android-studio.jpg
- - BLIS.md
  - CANN.md
  - CUDA-FEDORA.md
  - ET.md
  - OPENCL.md
  - OPENVINO.md
  - SYCL.md
  - VirtGPU.md
  - zDNN.md
  - ZenDNN.md
- - debugging-tests.md
  - HOWTO-add-model.md
  - parsing.md
  - token_generation_performance_tips.md
- - build.jpeg
  - export_mtp.py
  - lane_pattern.hip
  - review-2026-09-08.md
  - run_glm_two_host.sh
- - gemma3.md
  - glmedge.md
  - granitevision.md
  - llava.md
  - minicpmo2.6.md
  - minicpmo4.0.md
  - minicpmv2.5.md
  - minicpmv2.6.md
  - minicpmv4.0.md
  - minicpmv4.5.md
  - minicpmv4.6.md
  - MobileVLM.md
- - BLAS.csv
  - CANN.csv
  - CPU.csv
  - CUDA.csv
  - ET.csv
  - Hexagon.csv
  - Metal.csv
  - OpenCL.csv
  - SYCL.csv
  - Vulkan.csv
  - WebGPU.csv
  - zDNN.csv
  - ZenDNN.csv
- android.md
- autoparser.md
- build-profiling.md
- build-riscv64-spacemit.md
- build-s390x.md
- build.md
- completions.md
- docker.md
- function-calling.md
- install.md
- llguidance.md
- models.md
- multi-gpu.md
- multimodal.md
- ops.md
- preset.md
- release.md
- speculative.md
- xcframework.md
- - batched.cpp
  - CMakeLists.txt
  - README.md
- - .gitignore
  - Makefile
  - Package.swift
  - README.md
- - CMakeLists.txt
  - convert-llama2c-to-ggml.cpp
  - README.md
- - CMakeLists.txt
  - debug.cpp
  - README.md
- - deprecation-warning.cpp
  - README.md
- - CMakeLists.txt
  - diffusion-cli.cpp
  - diffusion.cpp
  - diffusion.h
  - README.md
- - CMakeLists.txt
  - embedding.cpp
  - README.md
- - CMakeLists.txt
  - eval-callback.cpp
  - README.md
- - CMakeLists.txt
  - gen-docs.cpp
- - CMakeLists.txt
  - gguf.cpp
- - CMakeLists.txt
  - gguf-hash.cpp
  - README.md
- - CMakeLists.txt
  - idle.cpp
  - README.md
- - llama-eval.py
  - llama-server-simulator.py
  - README.md
  - test-simulator.sh
- - .gitignore
  - build.gradle.kts
  - gradle.properties
  - gradlew
  - settings.gradle.kts
- - .gitignore
  - README.md
- - CMakeLists.txt
  - lookahead.cpp
  - README.md
- - CMakeLists.txt
  - lookup-create.cpp
  - lookup-merge.cpp
  - lookup-stats.cpp
  - lookup.cpp
  - README.md
- - .gitignore
  - Makefile
  - README.md
  - requirements.txt
- - CMakeLists.txt
  - parallel.cpp
  - README.md
- - CMakeLists.txt
  - passkey.cpp
  - README.md
- - CMakeLists.txt
  - README.md
  - retrieval.cpp
- - CMakeLists.txt
  - README.md
  - simple.cpp
- - CMakeLists.txt
  - README.md
  - simple-chat.cpp
- - .gitignore
  - CMakeLists.txt
  - README.md
- - CMakeLists.txt
  - README.md
  - speculative.cpp
- - CMakeLists.txt
  - README.md
  - speculative-simple.cpp
- - build.sh
  - CMakeLists.txt
  - ls-sycl-device.cpp
  - README.md
  - run-llama2.sh
  - start-svr.sh
  - test.sh
  - update-ops-doc.sh
  - win-build-sycl.bat
  - win-run-llama2.bat
  - win-start-svr.bat
  - win-test.bat
  - win-update-ops-doc.bat
- - .gitignore
  - build-install.sh
  - build.sh
  - CMakeLists.txt
  - README.md
  - test-cmake.cpp
- - CMakeLists.txt
  - finetune.cpp
  - README.md
- CMakeLists.txt
- convert_legacy_llama.py
- json_schema_pydantic_example.py
- llama.vim
- pydantic_models_to_grammar.py
- pydantic_models_to_grammar_examples.py
- reason-act.sh
- server-llama2-13B.sh
- server_embd.py
- - common.cmake
  - FindNCCL.cmake
  - ggml-config.cmake.in
  - GitVars.cmake
- - ggml-alloc.h
  - ggml-backend.h
  - ggml-blas.h
  - ggml-cann.h
  - ggml-cpp.h
  - ggml-cpu.h
  - ggml-cuda.h
  - ggml-et.h
  - ggml-hexagon.h
  - ggml-metal.h
  - ggml-opencl.h
  - ggml-openvino.h
  - ggml-opt.h
  - ggml-rpc.h
  - ggml-sycl.h
  - ggml-virtgpu.h
  - ggml-vulkan.h
  - ggml-webgpu.h
  - ggml-zdnn.h
  - ggml-zendnn.h
  - ggml.h
  - gguf.h
- - CMakeLists.txt
  - ggml-alloc.c
  - ggml-backend-dl.cpp
  - ggml-backend-dl.h
  - ggml-backend-impl.h
  - ggml-backend-meta.cpp
  - ggml-backend-reg.cpp
  - ggml-backend.cpp
  - ggml-common.h
  - ggml-feats.h
  - ggml-impl.h
  - ggml-opt.cpp
  - ggml-quants.c
  - ggml-quants.h
  - ggml-threading.cpp
  - ggml-threading.h
  - ggml-version.h.in
  - ggml.c
  - ggml.cpp
  - gguf.cpp
- .gitignore
- CMakeLists.txt
- - reader.py
  - writer.py
- - __init__.py
  - constants.py
  - gguf.py
  - gguf_reader.py
  - gguf_writer.py
  - lazy.py
  - metadata.py
  - py.typed
  - quants.py
  - tensor_mapping.py
  - utility.py
  - vocab.py
- - __init__.py
  - test_gguf_reader_validation.py
  - test_metadata.py
  - test_quants.py
- LICENSE
- pyproject.toml
- README.md
- arithmetic.gbnf
- c.gbnf
- chess.gbnf
- english.gbnf
- japanese.gbnf
- json.gbnf
- json_arr.gbnf
- list.gbnf
- README.md
- llama-cpp.h
- llama.h
- LICENSE-jsonhpp
- llama0-banner.png
- llama0-logo.png
- llama1-banner.png
- llama1-icon-transparent.png
- llama1-icon-transparent.svg
- llama1-icon.png
- llama1-icon.svg
- llama1-logo.png
- llama1-logo.svg
- matmul.png
- matmul.svg
- - Apertus-8B-Instruct.jinja
  - Apriel-1.6-15b-Thinker-fixed.jinja
  - Bielik-11B-v3.0-Instruct.jinja
  - ByteDance-Seed-OSS.jinja
  - Cohere2MoE.jinja
  - CohereForAI-c4ai-command-r-plus-tool_use.jinja
  - CohereForAI-c4ai-command-r7b-12-2024-tool_use.jinja
  - deepseek-ai-DeepSeek-R1-Distill-Llama-8B.jinja
  - deepseek-ai-DeepSeek-R1-Distill-Qwen-32B.jinja
  - deepseek-ai-DeepSeek-V3.1.jinja
  - deepseek-ai-DeepSeek-V3.2.jinja
  - deepseek-ai-DeepSeek-V4-Flash-0731.jinja
  - deepseek-ai-DeepSeek-V4.jinja
  - fireworks-ai-llama-3-firefunction-v2.jinja
  - GigaChat3-10B-A1.8B.jinja
  - GigaChat3.1-10B-A1.8B.jinja
  - GLM-4.6.jinja
  - GLM-4.7-Flash.jinja
  - google-gemma-2-2b-it.jinja
  - google-gemma-4-31B-it-interleaved.jinja
  - google-gemma-4-31B-it.jinja
  - HuggingFaceTB-SmolLM3-3B.jinja
  - ibm-granite-granite-3.3-2B-Instruct.jinja
  - ibm-granite-granite-4.0.jinja
  - ibm-granite-granite-4.1.jinja
  - Kimi-K2-Instruct.jinja
  - Kimi-K2-Thinking.jinja
  - Kimi-K3.jinja
  - LFM2-8B-A1B.jinja
  - LFM2.5-8B-A1B.jinja
  - LFM2.5-Instruct.jinja
  - llama-cpp-deepseek-r1.jinja
  - llama-cpp-rwkv-world.jinja
  - meetkai-functionary-medium-v3.1.jinja
  - meetkai-functionary-medium-v3.2.jinja
  - meta-llama-Llama-3.1-8B-Instruct.jinja
  - meta-llama-Llama-3.2-3B-Instruct.jinja
  - meta-llama-Llama-3.3-70B-Instruct.jinja
  - microsoft-Phi-3.5-mini-instruct.jinja
  - MiMo-VL.jinja
  - MiniMax-M1.jinja
  - MiniMax-M2.jinja
  - MiniMax-M3.jinja
  - Mistral-Small-3.2-24B-Instruct-2506.jinja
  - mistralai-Ministral-3-14B-Reasoning-2512.jinja
  - mistralai-Mistral-Nemo-Instruct-2407.jinja
  - moonshotai-Kimi-K2.jinja
  - muse-glimmer.jinja
  - NousResearch-Hermes-2-Pro-Llama-3-8B-tool_use.jinja
  - NousResearch-Hermes-3-Llama-3.1-8B-tool_use.jinja
  - NVIDIA-Nemotron-3-Nano-30B-A3B-BF16.jinja
  - NVIDIA-Nemotron-Nano-v2.jinja
  - openai-gpt-oss-120b.jinja
  - openbmb-MiniCPM5-1B.jinja
  - poolside-Laguna-S-2.1.jinja
  - poolside-Laguna-XS-2.1.jinja
  - poolside-Laguna-XS.2.jinja
  - Qwen-Qwen2.5-7B-Instruct.jinja
  - Qwen-Qwen3-0.6B.jinja
  - Qwen-QwQ-32B.jinja
  - Qwen3-Coder.jinja
  - Qwen3.5-4B.jinja
  - README.md
  - Reka-Edge.jinja
  - Spark2.5.jinja
  - StepFun3.5-Flash.jinja
  - tencent-Hy3.jinja
  - unsloth-Apriel-1.5.jinja
  - unsloth-mistral-Devstral-Small-2507.jinja
  - upstage-Solar-Open-100B.jinja
- .editorconfig
- ggml-vocab-aquila.gguf
- ggml-vocab-baichuan.gguf
- ggml-vocab-bert-bge.gguf
- ggml-vocab-bert-bge.gguf.inp
- ggml-vocab-bert-bge.gguf.out
- ggml-vocab-command-r.gguf
- ggml-vocab-command-r.gguf.inp
- ggml-vocab-command-r.gguf.out
- ggml-vocab-deepseek-coder.gguf
- ggml-vocab-deepseek-coder.gguf.inp
- ggml-vocab-deepseek-coder.gguf.out
- ggml-vocab-deepseek-llm.gguf
- ggml-vocab-deepseek-llm.gguf.inp
- ggml-vocab-deepseek-llm.gguf.out
- ggml-vocab-falcon.gguf
- ggml-vocab-falcon.gguf.inp
- ggml-vocab-falcon.gguf.out
- ggml-vocab-gemma-4.gguf
- ggml-vocab-gemma-4.gguf.inp
- ggml-vocab-gemma-4.gguf.out
- ggml-vocab-gpt-2.gguf
- ggml-vocab-gpt-2.gguf.inp
- ggml-vocab-gpt-2.gguf.out
- ggml-vocab-gpt-neox.gguf
- ggml-vocab-llama-bpe.gguf
- ggml-vocab-llama-bpe.gguf.inp
- ggml-vocab-llama-bpe.gguf.out
- ggml-vocab-llama-spm.gguf
- ggml-vocab-llama-spm.gguf.inp
- ggml-vocab-llama-spm.gguf.out
- ggml-vocab-mpt.gguf
- ggml-vocab-mpt.gguf.inp
- ggml-vocab-mpt.gguf.out
- ggml-vocab-nomic-bert-moe.gguf
- ggml-vocab-phi-3.gguf
- ggml-vocab-phi-3.gguf.inp
- ggml-vocab-phi-3.gguf.out
- ggml-vocab-qwen2.gguf
- ggml-vocab-qwen2.gguf.inp
- ggml-vocab-qwen2.gguf.out
- ggml-vocab-qwen35.gguf
- ggml-vocab-qwen35.gguf.inp
- ggml-vocab-qwen35.gguf.out
- ggml-vocab-refact.gguf
- ggml-vocab-refact.gguf.inp
- ggml-vocab-refact.gguf.out
- ggml-vocab-starcoder.gguf
- ggml-vocab-starcoder.gguf.inp
- ggml-vocab-starcoder.gguf.out
- - CMakeLists.txt
  - q8dot.cpp
  - vdot.cpp
- CMakeLists.txt
- requirements-all.txt
- requirements-compare-llama-bench.txt
- requirements-convert_hf_to_gguf.txt
- requirements-convert_hf_to_gguf_update.txt
- requirements-convert_legacy_llama.txt
- requirements-convert_llama_ggml_to_gguf.txt
- requirements-convert_lora_to_gguf.txt
- requirements-gguf_editor_gui.txt
- requirements-pydantic.txt
- requirements-server-bench.txt
- requirements-test-tokenizer-random.txt
- requirements-tool_bench.txt
- - validate-apps.sh
  - validate-ios.sh
  - validate-macos.sh
  - validate-tvos.sh
  - validate-visionos.sh
- - gcn-cdna-vgpr-check.py
- - jinja-tester.py
  - requirements.txt
- - build.py
  - ggml-hexagon-align-macros.py
  - ggml-hexagon-profile.py
  - ggml-hexagon-trace.py
  - run.py
  - sdk.py
  - setup-sdk.py
- bench-models.sh
- build-info.sh
- build-profile.ps1
- build-profile.sh
- ccache-clear.sh
- check-requirements.sh
- compare-commits.sh
- compare-llama-bench.py
- compare-logprobs.py
- create_ops_docs.py
- debug-test.sh
- gen-authors.sh
- gen-unicode-data.py
- get-flags.mk
- get-hellaswag.sh
- get-pg.sh
- get-wikitext-2.sh
- get-winogrande.sh
- get_chat_template.py
- git-bisect-run.sh
- git-bisect.sh
- hf.sh
- install-oneapi.bat
- make-release-checks.sh
- make-release-desc.sh
- make-release-summary.txt
- pr2wt.sh
- release.sh
- serve-static.js
- server-bench.py
- server-test-function-call.py
- server-test-model.py
- server-test-parallel-tc.py
- server-test-structured.py
- sync-ggml-am.sh
- sync-ggml.last
- sync-ggml.sh
- sync_vendor.py
- tool_bench.py
- tool_bench.sh
- ui-assets.cmake
- verify-checksum-models.py
- wc2wt.sh
- - SKILL.md
- - SKILL.md
- - afmoe.cpp
  - apertus.cpp
  - arcee.cpp
  - arctic.cpp
  - arwkv7.cpp
  - baichuan.cpp
  - bailingmoe.cpp
  - bailingmoe2.cpp
  - bailingmoe3.cpp
  - bert.cpp
  - bitnet.cpp
  - bloom.cpp
  - chameleon.cpp
  - chatglm.cpp
  - clip.cpp
  - codeshell.cpp
  - cogvlm.cpp
  - cohere2.cpp
  - cohere2moe.cpp
  - command-r.cpp
  - dbrx.cpp
  - deci.cpp
  - deepseek.cpp
  - deepseek2.cpp
  - deepseek2ocr.cpp
  - deepseek32.cpp
  - deepseek4.cpp
  - delta-net-base.cpp
  - dflash.cpp
  - dots1.cpp
  - dots3note.cpp
  - dream.cpp
  - eagle3.cpp
  - ernie4-5-moe.cpp
  - ernie4-5.cpp
  - eurobert.cpp
  - exaone-moe.cpp
  - exaone.cpp
  - exaone4.cpp
  - falcon-h1.cpp
  - falcon.cpp
  - gemma-embedding.cpp
  - gemma.cpp
  - gemma2.cpp
  - gemma3.cpp
  - gemma3n.cpp
  - gemma4-assistant.cpp
  - gemma4.cpp
  - glm-dsa.cpp
  - glm4-moe.cpp
  - glm4.cpp
  - glm5next.cpp
  - gpt2.cpp
  - gptneox.cpp
  - granite-hybrid.cpp
  - granite-moe.cpp
  - granite-swa.cpp
  - granite-switch.cpp
  - granite.cpp
  - grok.cpp
  - grovemoe.cpp
  - hunyuan-dense.cpp
  - hunyuan-moe.cpp
  - hunyuan-vl.cpp
  - hy-v3.cpp
  - hy-v4.cpp
  - internlm2.cpp
  - jais.cpp
  - jais2.cpp
  - jamba.cpp
  - jina-bert-v2.cpp
  - jina-bert-v3.cpp
  - kimi-k3.cpp
  - kimi-linear.cpp
  - laguna.cpp
  - lfm2.cpp
  - lfm2moe.cpp
  - llada-moe.cpp
  - llada.cpp
  - llama-embed.cpp
  - llama.cpp
  - llama4.cpp
  - maincoder.cpp
  - mamba-base.cpp
  - mamba.cpp
  - mamba2.cpp
  - mellum.cpp
  - mimo2.cpp
  - minicpm.cpp
  - minicpm3.cpp
  - minimax-01.cpp
  - minimax-m2.cpp
  - minimax-m3.cpp
  - mistral3.cpp
  - mistral4.cpp
  - models.h
  - modern-bert.cpp
  - mpt.cpp
  - muse-glimmer.cpp
  - nanbeige.cpp
  - nemotron-h-moe.cpp
  - nemotron-h.cpp
  - nemotron.cpp
  - neo-bert.cpp
  - nomic-bert-moe.cpp
  - nomic-bert.cpp
  - olmo.cpp
  - olmo2.cpp
  - olmoe.cpp
  - openai-moe.cpp
  - openelm.cpp
  - orion.cpp
  - paddleocr.cpp
  - pangu-embed.cpp
  - phi2.cpp
  - phi3.cpp
  - phimoe.cpp
  - plamo.cpp
  - plamo2.cpp
  - plamo3.cpp
  - plm.cpp
  - pockettts.cpp
  - qwen.cpp
  - qwen2.cpp
  - qwen2moe.cpp
  - qwen2vl.cpp
  - qwen3.cpp
  - qwen35.cpp
  - qwen35moe.cpp
  - qwen3moe.cpp
  - qwen3next.cpp
  - qwen3tts.cpp
  - qwen3vl.cpp
  - qwen3vlmoe.cpp
  - qwen4exp.cpp
  - refact.cpp
  - rnd1.cpp
  - rwkv6-base.cpp
  - rwkv6.cpp
  - rwkv6qwen2.cpp
  - rwkv7-base.cpp
  - rwkv7.cpp
  - seed-oss.cpp
  - smallthinker.cpp
  - smollm3.cpp
  - spark2-5.cpp
  - stablelm.cpp
  - starcoder.cpp
  - starcoder2.cpp
  - step35.cpp
  - t5.cpp
  - t5encoder.cpp
  - talkie.cpp
  - wavtokenizer-dec.cpp
  - xverse.cpp
- CMakeLists.txt
- llama-adapter.cpp
- llama-adapter.h
- llama-arch.cpp
- llama-arch.h
- llama-batch.cpp
- llama-batch.h
- llama-chat.cpp
- llama-chat.h
- llama-context.cpp
- llama-context.h
- llama-cparams.cpp
- llama-cparams.h
- llama-ext.h
- llama-grammar.cpp
- llama-grammar.h
- llama-graph.cpp
- llama-graph.h
- llama-hparams.cpp
- llama-hparams.h
- llama-impl.cpp
- llama-impl.h
- llama-io.cpp
- llama-io.h
- llama-kv-cache-dsa-iswa.cpp
- llama-kv-cache-dsa-iswa.h
- llama-kv-cache-dsa.cpp
- llama-kv-cache-dsa.h
- llama-kv-cache-dsv4.cpp
- llama-kv-cache-dsv4.h
- llama-kv-cache-iswa.cpp
- llama-kv-cache-iswa.h
- llama-kv-cache-kpool.cpp
- llama-kv-cache-kpool.h
- llama-kv-cache-msa.cpp
- llama-kv-cache-msa.h
- llama-kv-cache.cpp
- llama-kv-cache.h
- llama-kv-cells.h
- llama-memory-hybrid-idx.cpp
- llama-memory-hybrid-idx.h
- llama-memory-hybrid-iswa.cpp
- llama-memory-hybrid-iswa.h
- llama-memory-hybrid.cpp
- llama-memory-hybrid.h
- llama-memory-recurrent.cpp
- llama-memory-recurrent.h
- llama-memory.cpp
- llama-memory.h
- llama-mmap.cpp
- llama-mmap.h
- llama-model-loader.cpp
- llama-model-loader.h
- llama-model-saver.cpp
- llama-model-saver.h
- llama-model.cpp
- llama-model.h
- llama-quant.cpp
- llama-quant.h
- llama-sampler.cpp
- llama-sampler.h
- llama-version.h.in
- llama-vocab.cpp
- llama-vocab.h
- llama.cpp
- unicode-data.cpp
- unicode-data.h
- unicode.cpp
- unicode.h
- - MTL.csv
- - simple-tokenize.cpp
  - simple-tokenize.h
  - test-basic.cpp
  - test-gbnf-generation.cpp
  - test-json-parser.cpp
  - test-json-serialization.cpp
  - test-python-dict-parser.cpp
  - test-unicode.cpp
  - tests.h
- - deepseek-v3.1.schema
  - gemma-3-4b-it.schema
  - glm-4.6v.schema
  - gpt-oss-120b.schema
  - meta-llama-3.1-70b-instruct.schema
  - nemotron-nano-3-30b-a3b.schema
  - qwen3-0.6b.schema
  - qwen3-14b.schema
  - qwen3-coder-next.schema
  - qwen3.5-397b-a17b.schema
  - qwen3.6-27b.schema
  - step-3.5-flash.schema
- .gitignore
- CMakeLists.txt
- gguf-model-data.cpp
- gguf-model-data.h
- test-alloc.cpp
- test-arg-parser.cpp
- test-autorelease.cpp
- test-backend-ops.cpp
- test-backend-sampler.cpp
- test-barrier.cpp
- test-batch-alloc.cpp
- test-c.c
- test-chat-analysis.cpp
- test-chat-auto-parser.cpp
- test-chat-peg-parser.cpp
- test-chat-template.cpp
- test-chat.cpp
- test-col2im-1d.cpp
- test-double-float.cpp
- test-export-graph-ops.cpp
- test-fusion.cpp
- test-gbnf-validator.cpp
- test-gguf-model-data.cpp
- test-gguf.cpp
- test-grammar-integration.cpp
- test-grammar-llguidance.cpp
- test-grammar-parser.cpp
- test-jinja.cpp
- test-json-schema-to-grammar.cpp
- test-json-schema.cpp
- test-llama-archs.cpp
- test-llama-grammar.cpp
- test-log.cpp
- test-lora-conversion-inference.sh
- test-model-load-cancel.cpp
- test-model-resolution.cpp
- test-mtmd-c-api.c
- test-mtmd-impl.cpp
- test-opt.cpp
- test-peg-parser.cpp
- test-quant-type-selection.cpp
- test-quantize-fns.cpp
- test-quantize-perf.cpp
- test-quantize-stats.cpp
- test-reasoning-budget.cpp
- test-recurrent-state-rollback.cpp
- test-rope.cpp
- test-rpc-multi-server.cpp
- test-rpc-multi-server.sh
- test-rset-release.cpp
- test-sampling.cpp
- test-save-load-state.cpp
- test-state-restore-fragmented.cpp
- test-thread-safety.cpp
- test-tokenizer-0.cpp
- test-tokenizer-0.py
- test-tokenizer-0.sh
- test-tokenizer-1-bpe.cpp
- test-tokenizer-1-spm.cpp
- test-tokenizer-random.py
- test-tokenizers-repo.sh
- test-unicode.cpp
- testing.h
- - batched-bench.cpp
  - CMakeLists.txt
  - main.cpp
  - README.md
- - cli-client.cpp
  - cli-client.h
  - cli-context.cpp
  - cli-context.h
  - cli-server.h
  - cli-ui.h
  - cli.cpp
  - CMakeLists.txt
  - main.cpp
  - README.md
- - CMakeLists.txt
  - completion.cpp
  - main.cpp
  - README.md
- - CMakeLists.txt
  - completions.txt
  - cvector-generator.cpp
  - mean.hpp
  - negative.txt
  - pca.hpp
  - positive.txt
  - README.md
- - CMakeLists.txt
  - export-lora.cpp
  - README.md
- - CMakeLists.txt
  - fit-params.cpp
  - main.cpp
  - README.md
- - CMakeLists.txt
  - gguf-split.cpp
  - README.md
  - tests.sh
- - CMakeLists.txt
  - imatrix.cpp
  - README.md
- - CMakeLists.txt
  - llama-bench.cpp
  - main.cpp
  - README.md
- - clip-graph.h
  - clip-impl.h
  - clip-model.h
  - clip.cpp
  - clip.h
  - CMakeLists.txt
  - deprecation-warning.cpp
  - mtmd-audio.cpp
  - mtmd-audio.h
  - mtmd-cli.cpp
  - mtmd-helper-common.h
  - mtmd-helper-gen.cpp
  - mtmd-helper.cpp
  - mtmd-helper.h
  - mtmd-image.cpp
  - mtmd-image.h
  - mtmd-internal.h
  - mtmd.cpp
  - mtmd.h
  - README-dev.md
  - README.md
  - requirements.txt
  - test-1.jpeg
  - test-2.mp3
  - test-3.mp4
  - tests.sh
- - CMakeLists.txt
  - main.cpp
  - perplexity.cpp
  - README.md
- - CMakeLists.txt
  - main.cpp
  - quantize.cpp
  - README.md
  - tests.sh
- - CMakeLists.txt
  - README.md
  - results.cpp
- - CMakeLists.txt
  - README.md
  - rpc-server.cpp
- - CMakeLists.txt
  - main.cpp
  - README-dev.md
  - README.md
  - server-chat.cpp
  - server-chat.h
  - server-common.cpp
  - server-common.h
  - server-context.cpp
  - server-context.h
  - server-cors-proxy.h
  - server-http.cpp
  - server-http.h
  - server-mcp.cpp
  - server-mcp.h
  - server-models.cpp
  - server-models.h
  - server-queue.cpp
  - server-queue.h
  - server-schema.cpp
  - server-schema.h
  - server-stream.cpp
  - server-stream.h
  - server-task.cpp
  - server-task.h
  - server-tools.cpp
  - server-tools.h
  - server.cpp
- CMakeLists.txt
.clang-format
.clang-tidy
.dockerignore
.ecrc
.editorconfig
.flake8
.gitignore
.gitmodules
.pre-commit-config.yaml
AGENTS.md
AUTHORS
build-xcframework.sh
CLAUDE.md
CMakeLists.txt
CMakePresets.json
CODEOWNERS
CONTRIBUTING.md
convert_hf_to_gguf.py
convert_hf_to_gguf_update.py
convert_llama_ggml_to_gguf.py
convert_lora_to_gguf.py
flake.nix
HALO-HYBRID.md
LICENSE
Makefile
mypy.ini
pyproject.toml
pyrightconfig.json
README.md
requirements.txt
SECURITY.md

# CDN으로 사용하기

jsDelivr

jsDelivr는 공개 GitHub 리포지토리를 별도 설정 없이 CDN으로 즉시 서빙합니다. 버전과 파일을 고르면 웹페이지에 바로 붙일 수 있는 링크와 예시 코드가 만들어집니다.

버전

파일

파일 목록이 많아 일부만 표시됩니다.

링크

예시

# 프로젝트 배지

llama

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

llama-halo-hybrid

오너의 다른 레포

파일 탐색기

# CDN으로 사용하기

# 프로젝트 배지

Was this content helpful?

Recent Feedback

llama-halo-hybrid

오너의 다른 레포

파일 탐색기

# CDN으로 사용하기

# 프로젝트 배지

Was this content helpful?

Recent Feedback

Download README