mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-02 02:51:17 +02:00

Files

T

Concedo e1f97f7fb5 Merge branch 'upstream' into concedo_experimental

# Conflicts:
#	.devops/llama-server.Dockerfile
#	README.md
#	flake.lock
#	ggml/src/ggml-vulkan.cpp
#	ggml/src/vulkan-shaders/concat.comp
#	ggml/src/vulkan-shaders/pad.comp
#	ggml/src/vulkan-shaders/vulkan-shaders-gen.cpp
#	scripts/sync-ggml-am.sh
#	scripts/sync-ggml.last
#	src/llama.cpp
#	tests/test-backend-ops.cpp

2024-08-06 16:33:26 +08:00

lookup-create.cpp

common : Changed tuple to struct (TODO fix) (#8823 )

2024-08-05 18:14:10 +02:00

lookup-merge.cpp

build: rename main → llama-cli, server → llama-server, llava-cli → llama-llava-cli, etc... (#7809 )

2024-06-13 00:41:52 +01:00

lookup-stats.cpp

common : Changed tuple to struct (TODO fix) (#8823 )

2024-08-05 18:14:10 +02:00

lookup.cpp

common : Changed tuple to struct (TODO fix) (#8823 )

2024-08-05 18:14:10 +02:00

README.md

Removes multiple newlines at the end of files that is breaking the editorconfig step of CI. (#8258 )

2024-07-02 12:18:10 -04:00

README.md

llama.cpp/examples/lookup

Demonstration of Prompt Lookup Decoding

https://github.com/apoorvumang/prompt-lookup-decoding

The key parameters for lookup decoding are ngram_min, ngram_max and n_draft. The first two determine the size of the ngrams to search for in the prompt for a match. The latter specifies how many subsequent tokens to draft if a match is found.

More info:

https://github.com/ggerganov/llama.cpp/pull/4484 https://github.com/ggerganov/llama.cpp/issues/4226