LLM-Inference/ik_llama.cpp
1
0
Fork 0
mirror of https://github.com/ikawrakow/ik_llama.cpp.git synced 2026-08-12 22:29:39 +04:00
Code Issues Packages Projects Releases Wiki Activity
Files
f0f6ae4bb0650c1e1cc49046bc6806926dd1c40d
ik_llama.cpp/examples
T
History
KawrakowandGitHub f0f6ae4bb0 MXFP4_R8 (#2196) 
* Adding MXFP4_R8 with AVX2 implementation

* Also offline repack

* Add AVX512 implementation for MXFP4_R8
2026-07-28 08:03:59 +03:00
..
baby-llama
Merge mainline - Aug 12 2024 (#17)
2024-08-12 15:14:32 +02:00
batched
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
batched-bench
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
batched.swift
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
benchmark
Quantization options (#1677)
2026-04-23 09:05:39 +02:00
convert-llama2c-to-ggml
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
cvector-generator
Split mode graph for dense Gemma4 assistant (#2022)
2026-06-24 18:29:32 +02:00
deprecation-warning
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
embedding
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
eval-callback
eval-callback : sum over the full tensor, not just the printed slice (#2019)
2026-06-24 08:57:19 +02:00
export-lora
Merge vulkan code from mainline up to commit of 6/28/2025 (#563)
2025-07-02 08:49:42 +02:00
gbnf-validator
common : introduce composable PEG parser combinators for chat parsing and new jinja template engine (#1369)
2026-03-09 11:03:33 +01:00
gguf
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
gguf-hash
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
gguf-split
gguf-split: fix the split output files naming (#1336)
2026-03-02 08:43:47 +01:00
gritlm
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
imatrix
help: document all previously undocumented CLI options across tools (#2180)
2026-07-25 16:04:30 +03:00
infill
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
jeopardy
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
llama-bench
Remove deprecated Kompute (Vulkan compute) backend (#2097)
2026-07-08 10:01:01 +02:00
llama.android
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
llama.swiftui
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
lookahead
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
lookup
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
main
feat: allow dflash to work with spec auto tune (#2112)
2026-07-12 07:49:03 +03:00
main-cmake-pkg
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
mtmd
mtmd: add MiniMax M3 vision support (#2086)
2026-07-12 07:19:14 +03:00
parallel
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
parser
Autoparser - complete refactoring of parser architecture (#1376)
2026-04-22 10:04:13 +02:00
passkey
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
perplexity
perplexity: fix int overflows in large context x vocab buffer sizing (#2150)
2026-07-18 09:13:47 +03:00
quantize
MXFP4_R8 (#2196)
2026-07-28 08:03:59 +03:00
quantize-stats
Update autofix and presets (#1867)
2026-05-24 07:30:44 +03:00
retrieval
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
rpc
fix(rpc): update ggml_backend_cuda_init to 3-arg signature (#2084)
2026-07-06 09:26:45 +02:00
save-load-state
server: enable checkpoint for recurrent models (#1310)
2026-02-26 06:51:18 +01:00
server
server : remove usage field from intermediate streaming chunks (#2189)
2026-07-26 19:20:57 +03:00
simple
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
speculative
Fix two speculative-decoding crashes that prevent any usage (#1760)
2026-05-09 08:36:38 +03:00
sweep-bench
help: document all previously undocumented CLI options across tools (#2180)
2026-07-25 16:04:30 +03:00
sycl
Merge mainline - Aug 12 2024 (#17)
2024-08-12 15:14:32 +02:00
tokenize
spec : add self speculative decoding, ngram and refactor (#1261)
2026-02-13 19:04:55 +01:00
base-translate.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
chat-13B.bat
Create chat-13B.bat (#592)
2023-03-29 20:21:09 +03:00
chat-13B.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
chat-persistent.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
chat-vicuna.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
chat.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
CMakeLists.txt
Port mdmd from mainline + Qwen2/2.5-VL support (#798)
2025-09-27 08:45:29 +02:00
convert_legacy_llama.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
json_schema_pydantic_example.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
json_schema_to_grammar.py
Autoparser - complete refactoring of parser architecture (#1376)
2026-04-22 10:04:13 +02:00
llama.vim
llama.vim : added api key support (#5090)
2024-01-23 08:51:27 +02:00
llm.vim
llm.vim : stop generation at multiple linebreaks, bind to <F2> (#2879)
2023-08-30 09:50:55 +03:00
Miku.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
pydantic_models_to_grammar_examples.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
pydantic_models_to_grammar.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
reason-act.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
regex_to_grammar.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
server_embd.py
Merge mainline llama.cpp (#3)
2024-07-27 07:55:01 +02:00
server-llama2-13B.sh
build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809)
2024-06-13 00:41:52 +01:00
ts-type-to-grammar.sh
JSON schema conversion: ⚡️ faster repetitions, min/maxLength for strings, cap number length (#6555)
2024-04-12 19:43:38 +01:00