Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-26 06:31:13 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,961 Commits 3 Branches 252 Tags
e49d398f732e8c239cb91e32e50798bfda170b72
Commit Graph

20 Commits

Author SHA1 Message Date
Concedo 9e0dee769b Merge branch 'master' into concedo_experimental 
# Conflicts:
#	.github/workflows/build.yml
#	flake.lock
#	flake.nix
 2024-01-01 16:04:17 +08:00
Georgi Gerganov e39106c055 ggml : add ggml_vdotq_s32 alias (#4715) 
ggml-ci
 2023-12-31 11:43:31 +02:00
Concedo 69ab1bf2f8 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	README.md
 2023-12-27 21:43:46 +08:00
Georgi Gerganov 951010fa53 ggml : fix dot product for ARM (#4630) 
ggml-ci
 2023-12-27 11:02:13 +02:00
Concedo b814bb217d Merge branch 'master' into concedo_experimental 
# Conflicts:
#	Makefile
#	README.md
 2023-12-23 00:01:21 +08:00
FantasyGmm a55876955b cuda : fix jetson compile error (#4560) 
* fix old jetson compile error

* Update Makefile

* update jetson detect and cuda version detect

* update cuda marco define

* update makefile and cuda,fix some issue

* Update README.md

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

* Update Makefile

* Update README.md

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-12-22 17:11:12 +02:00
Concedo c2c238b4f3 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	Makefile
#	tests/test-grad0.cpp
#	tests/test-quantize-perf.cpp
 2023-12-13 14:49:03 +08:00
Richard Kiss 9494d7c477 english : use typos to fix comments and logs (#4354) 2023-12-12 11:53:36 +02:00
Concedo 6bf8ee4aea Merge branch 'master' into concedo_experimental 
# Conflicts:
#	Makefile
#	ggml-cuda.cu
#	tests/test-tokenizer-0-falcon.py
#	tests/test-tokenizer-0-llama.py
 2023-11-18 11:10:45 +08:00
Roger Meier 8e9361089d build : support ppc64le build for make and CMake (#3963) 
* build: support ppc64le build for make and CMake

* build: keep __POWER9_VECTOR__ ifdef and extend with __powerpc64__

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-11-17 18:11:23 +02:00
Concedo 35a97e14b2 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	Makefile
#	README.md
#	docs/token_generation_performance_tips.md
#	grammars/README.md
#	scripts/sync-ggml.sh
#	tests/CMakeLists.txt
#	tests/test-grad0.cpp
#	tests/test-opt.cpp
 2023-11-15 16:59:53 +08:00
Michael Potter 6bb4908a17 Fix MacOS Sonoma model quantization (#4052) 
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
 2023-11-14 12:34:41 -05:00
Georgi Gerganov 3d68f364f1 ggml : sync (im2col, GPU conv, 32-bit arm compat) (#4060) 
ggml-ci
 2023-11-13 16:55:52 +02:00
Concedo 1ab18ecb53 Merge commit 'c43c2da8afacaddfe51c09b21dbd9922cd0ea46b' into concedo_experimental 
# Conflicts:
#	llama.cpp
 2023-11-02 11:17:59 +08:00
Georgi Gerganov 9a3b4f6c86 ggml : fix UNUSED macro (#3762) 2023-11-01 13:50:45 +02:00
Andrew Godfrey 73bdcb395e finetune : add -ngl parameter (#3762) 
* Add '-ngl' support to finetune.cpp

* Add fprintf in ggml_cuda_op_add

When I tried CUDA offloading during finetuning following the readme, I got an assert here.
This probably isn't an important case because inference later gives a warning saying you should use f16 or f32 instead when using lora

* Add 'finetune.sh', which currently fails when using GPU

"error: operator (): Finetuning on tensors with type 'f16' is not yet supported"

* tweak finetune.sh

* Suppress some warnings in ggml.c

* Add f16 implementation to ggml_compute_forward_add_f16_f32

* Add an f16 case to ggml_add_cast_impl and llama_build_lora_finetune_graphs

* finetune.sh: Edit comments

* Add "add_f16_f32_f32_cuda"

* Tweak an error message

* finetune.sh: Add an optional LLAMA_MODEL_DIR variable

* finetune.sh: Add an optional LLAMA_TRAINING_DIR variable

* train : minor

* tabs to spaces

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Co-authored-by: cebtenzzre <cebtenzzre@gmail.com>
 2023-11-01 13:49:04 +02:00
Concedo e62f38abd1 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	tests/test-double-float.cpp
#	tests/test-quantize-fns.cpp
 2023-10-31 21:09:49 +08:00
Concedo cc5b282350 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	CMakeLists.txt
#	Makefile
#	build.zig
#	flake.lock
#	flake.nix
#	ggml.c
 2023-10-31 20:44:04 +08:00
Georgi Gerganov 207b51900e ggml : move FP16 <-> FP32 code to ggml-impl.h (#3861) 
* ggml : move FP16 <-> FP32 stuff to ggml-impl.h

ggml-ci

* tests : fix ARM build

* ggml : explicitly initialize deprecated type traits

* ggml : add math.h to ggml-impl.h

* ggml : remove duplicate static assert macros

* ggml : prefix lookup tables with ggml_

ggml-ci

* ggml-impl : move extern "C" to start of file
 2023-10-30 19:19:15 +02:00
Georgi Gerganov d69d777c02 ggml : quantization refactoring (#3833) 
* ggml : factor all quantization code in ggml-quants

ggml-ci

* ggml-quants : fix Zig and Swift builds + quantize tool

ggml-ci

* quantize : --pure option for disabling k-quant mixtures

---------

Co-authored-by: cebtenzzre <cebtenzzre@gmail.com>
 2023-10-29 18:32:28 +02:00