Concedo f75bbb945f speculative decoding initial impl completed (+6 squashed commit) ...

Squashed commit:

[0a6306ca0] draft wip dont use (will be squashed)

[a758a1c9c] wip dont use (will be squashed)

[e1994d3ce] wip dont use

[f59690d68] wip

[77228147d] wip on spec decoding. dont use yet

[2445bca54] wip adding speculative decoding (+1 squashed commits)

Squashed commits:

[50e341bb7] wip adding speculative decoding

2024-11-30 10:41:10 +08:00

..

sdcpp

speculative decoding initial impl completed (+6 squashed commit)

2024-11-30 10:41:10 +08:00

tools

move kcpp params out

2024-09-10 16:30:12 +08:00

whispercpp

speculative decoding initial impl completed (+6 squashed commit)

2024-11-30 10:41:10 +08:00

ggml_v1.c

Merge branch 'master' into concedo_experimental

2023-10-31 20:44:04 +08:00

ggml_v1.h

Various enhancement and integration pygmalion.cpp

2023-04-03 00:04:43 +08:00

ggml_v2-cuda-legacy.cu

attempts a backflip, but does he stick the landing?

2024-11-16 17:05:45 +08:00

ggml_v2-cuda-legacy.h

Wip, CUDA porting malloc improvements, gpu accel for non-llama, backport old quants

2023-06-28 18:20:46 +08:00

ggml_v2-cuda.cu

attempts a backflip, but does he stick the landing?

2024-11-16 17:05:45 +08:00

ggml_v2-cuda.h

cleanup indentation, fixing cublas build

2023-06-08 22:40:53 +08:00

ggml_v2-opencl-legacy.c

Merge remote-tracking branch 'occam/opencl-dev' into concedo_experimental

2023-05-22 16:16:48 +08:00

ggml_v2-opencl-legacy.h

still merging in process

2023-05-20 15:58:33 +08:00

ggml_v2-opencl.cpp

Reduce warnings. (#439)

2023-09-16 18:52:09 +08:00

ggml_v2-opencl.h

still merging in process

2023-05-20 15:58:33 +08:00

ggml_v2.c

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

ggml_v2.h

remove old filever checks (+7 squashed commit)

2023-05-21 00:15:39 +08:00

ggml_v3-cuda.cu

attempts a backflip, but does he stick the landing?

2024-11-16 17:05:45 +08:00

ggml_v3-cuda.h

attempts a backflip, but does he stick the landing?

2024-11-16 17:05:45 +08:00

ggml_v3-opencl.cpp

fossilize ggml library ver 3, to support ggjtv3

2024-01-20 10:49:25 +08:00

ggml_v3-opencl.h

fossilize ggml library ver 3, to support ggjtv3

2024-01-20 10:49:25 +08:00

ggml_v3.c

try fix compile issues

2024-09-19 13:56:19 +08:00

ggml_v3.h

try to use allocator for cuda ggml v3

2024-01-20 12:53:31 +08:00

gpt2_v1.cpp

fixed other arch

2023-05-24 00:20:43 +08:00

gpt2_v2.cpp

Reduce warnings. (#439)

2023-09-16 18:52:09 +08:00

gpt2_v3.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

gptj_v1.cpp

remove old filever checks (+7 squashed commit)

2023-05-21 00:15:39 +08:00

gptj_v2.cpp

Reduce warnings. (#439)

2023-09-16 18:52:09 +08:00

gptj_v3.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

llama_v2-util.h

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

llama_v2.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

llama_v2.h

still merging in process

2023-05-20 15:58:33 +08:00

llama_v3.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

llama_v3.h

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

llama-util.h

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

mpt_v3.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

neox_v2.cpp

fixed other arch

2023-05-24 00:20:43 +08:00

neox_v3.cpp

Merge commit '280345968dabc00d212d43e31145f5c9961a7604' into concedo_experimental

2024-04-07 20:27:17 +08:00

otherarch.h

speculative decoding initial impl completed (+6 squashed commit)

2024-11-30 10:41:10 +08:00

rwkv_v2.cpp

Reduce warnings. (#439)

2023-09-16 18:52:09 +08:00

rwkv_v2.h

wip integrating new rwkv

2023-05-27 22:45:28 +08:00

rwkv_v3.cpp

added llava letterboxing feature

2024-08-25 23:15:38 +08:00

rwkv_v3.h

fix compile errors, rwkv not working

2023-07-10 18:23:25 +08:00

rwkv_vocab.cpp

vae test

2024-05-14 19:17:01 +08:00

utils.cpp

speculative decoding initial impl completed (+6 squashed commit)

2024-11-30 10:41:10 +08:00

utils.h

speculative decoding initial impl completed (+6 squashed commit)

2024-11-30 10:41:10 +08:00