Repository navigation
Fix typo in readme - #272
Merged
Merged
Conversation
Closed
j-f1
approved these changes
Mar 18, 2023
phuongncn
pushed a commit
to phuongncn/llama.cpp-gx10-dgx-sparks-deepseekv4
that referenced
this pull request
Apr 28, 2026
…l-org#272) * Repack a model with the quantize tool * WIP * Fixed various issues As we don't have a way to tell if a repacked quant has been modified, I had to remove the modification at the expense of a slight decrease in performance. This affects q8_0_r8, q8_KV_r8, q8_k_r8 on Zen4, and q4_0_r8 on ARM. * Create wk_b and wv_b as Q8_0_R8 if the wkv_b type is interleaved * Fix GCC 13.3 compilation error * Another one * Add missing include --------- Co-authored-by: Iwan Kawrakow <iwan.kawrakow@gmail.com>
ckti
pushed a commit
to ckti/llama.cpp-consolidated
that referenced
this pull request
Aug 22, 2026
docs : add TurboQuant project overview to AGENTS.md and skills
Soket1
pushed a commit
to Soket1/llama.cpp-xdna
that referenced
this pull request
Aug 24, 2026
…h4->sh7) Mirrors the IRON-windows emitter fix: the production nm tail flow is unroutable on sh4 S2MM:1 and now targets sh7. Cache identity must change so the fixed xclbin cannot be shadowed by a stale artifact. Co-Authored-By: Claude <noreply@anthropic.com>
UltraRabbit
pushed a commit
to UltraRabbit/llama.cpp
that referenced
this pull request
Sep 29, 2026
…drafting (ggml-org#203) (ggml-org#272) * server: make speculative decoding visible when it is enabled but not drafting (ggml-org#203) With --spec-type ngram-* the server gave no sign that speculation was on: the startup confirmation was logged at trace level, and timings.draft_n / draft_n_accepted were omitted whenever nothing had been drafted. An n-gram speculator that finds no match in a short completion (e.g. ngram-mod with --spec-ngram-mod-n-match 32 on a ~100-token reply) therefore looked exactly like speculation being disabled (ggml-org#203). - report draft_n / draft_n_accepted (possibly 0) whenever the slot can speculate, so "enabled, nothing drafted" is distinguishable from "off" - log the enabled speculative types at info level at startup - warn when speculation was requested but could not be enabled Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012Q6ecxozUXFFFLE3N2SMiR * server: log only the speculative types that initialized common_speculative_init() skips types it cannot build (for example draft types without a draft model) and still returns a context, so the startup log listed requested types as enabled. Add common_speculative_get_types() and log the initialized types, with a warning for requested types that were skipped. Also shorten the draft-counter comment. --------- Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
imaami
pushed a commit
to imaami/llama.cpp
that referenced
this pull request
Oct 10, 2026
…drafting (ggml-org#203) (ggml-org#272) * server: make speculative decoding visible when it is enabled but not drafting (ggml-org#203) With --spec-type ngram-* the server gave no sign that speculation was on: the startup confirmation was logged at trace level, and timings.draft_n / draft_n_accepted were omitted whenever nothing had been drafted. An n-gram speculator that finds no match in a short completion (e.g. ngram-mod with --spec-ngram-mod-n-match 32 on a ~100-token reply) therefore looked exactly like speculation being disabled (ggml-org#203). - report draft_n / draft_n_accepted (possibly 0) whenever the slot can speculate, so "enabled, nothing drafted" is distinguishable from "off" - log the enabled speculative types at info level at startup - warn when speculation was requested but could not be enabled Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_012Q6ecxozUXFFFLE3N2SMiR * server: log only the speculative types that initialized common_speculative_init() skips types it cannot build (for example draft types without a draft model) and still returns a context, so the startup log listed requested types as enabled. Add common_speculative_get_types() and log the initialized types, with a warning for requested types that were skipped. Also shorten the draft-counter comment. --------- Co-authored-by: Claude Opus 5.5 (1M context) <noreply@anthropic.com> (cherry picked from commit 9a5c96a) Assisted-by: GitHub Copilot
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #271