llama : refactor sampling v2 (#9294)

Browse Source

- Add `struct llama_sampler` and `struct llama_sampler_i`
- Add `llama_sampler_` API
- Add `llama_sampler_chain_` API for chaining multiple samplers
- Remove `LLAMA_API_INTERNAL`
- Add `llama_perf_` API and remove old `llama_print_timings` and `llama_reset_timings`

...

This commit is contained in:

Georgi Gerganov

2024-09-07 15:16:19 +03:00

committed by GitHub

parent 947538acb8

commit df270ef745

48 changed files with 3497 additions and 2914 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

src/llama-sampling.cpp

+1092 -308

File diff suppressed because it is too large Load Diff