Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-19 17:25:07 +02:00
Code Issues Packages Projects Releases Wiki Activity
5,200 Commits 3 Branches 254 Tags
4d9ccddc2c2ddccb2c8a26a7ca3b8fde08d35cfe
Commit Graph

5200 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
DannyDaemonic 2485d7a4d3 Process escape sequences given in prompts (#1173) 2023-05-02 18:46:20 -07:00
DannyDaemonic 13b0c68ed7 Handle signals properly on Windows (#1123) 2023-05-02 18:01:57 -07:00
DannyDaemonic 55bc5f0900 Call sh on build-info.sh (#1294) 2023-05-02 17:52:35 -07:00
kuvaus 9daff419f6 fix build-info.h for git submodules (#1289) 
* make git build info work with submodules

---------

Co-authored-by: Green Sky <green@g-s.xyz>
 2023-05-03 02:43:43 +02:00
slaren bf4b22ffe4 fix missing parameters in llama_init_from_gpt_params (#1293) 2023-05-03 01:36:45 +02:00
Ron Evans 67c77799e0 examples : add llama_init_from_gpt_params() common function (#1290) 
Signed-off-by: deadprogram <ron@hybridgroup.com>
 2023-05-02 23:39:51 +03:00
Georgi Gerganov 0e6cbff1b7 llama : fix compile warnings 2023-05-02 23:09:08 +03:00
Georgi Gerganov 5d5817ca60 ggml : fix 32-bit ARM 2023-05-02 22:14:50 +03:00
Ron Evans 8c9be35ff9 examples : improve vertical alignment of a few variables (#1286) 
Signed-off-by: deadprogram <ron@hybridgroup.com>
 2023-05-02 20:53:52 +03:00
Marvin Gießing cc0bb7235c ggml : fix ppc64le build error and make cmake detect Power processors (#1284) 
* Fix ppc64le build issue

* Added support to detect ppc64* processors
 2023-05-02 19:42:16 +03:00
Robert Brisita 2bb992f034 llama : allow 0 as a seed number. (#1275) 2023-05-02 19:23:44 +03:00
Ron Evans e2cd506999 main : switch input_noecho to input_echo to remove negation (#979) 
Signed-off-by: deadprogram <ron@hybridgroup.com>
 2023-05-02 19:13:26 +03:00
Concedo 966cd2ce91 Merge remote-tracking branch 'temp/concedo' into concedo_experimental 
# Conflicts:
#	koboldcpp.py
v1.18 		2023-05-02 22:43:34 +08:00
Concedo 58f25dce86 added flag to increase processs priority 2023-05-02 22:26:55 +08:00
slaren 2d099e5193 ggml: add names to tensors (#1268) 
* ggml: add names to tensors

* minor improvements to dot file formatting
 2023-05-02 16:03:00 +02:00
Sergey Kucher 069b3d4c37 Adds --mlock argument 2023-05-02 16:19:37 +03:00
Concedo 5a10ea50da up ver 2023-05-02 18:19:08 +08:00
Concedo 9a9b217e57 updated embedded kobold lite with multiuser chat 2023-05-02 18:18:05 +08:00
Concedo 6f702f2700 fixed stop sequence crash 2023-05-02 14:56:50 +08:00
Concedo 94827172e0 Merge branch 'master' into concedo 
# Conflicts:
#	CMakeLists.txt
#	Makefile
#	ggml-cuda.cu
#	ggml-cuda.h
 2023-05-02 14:38:31 +08:00
Concedo 433fa1e8b2 fix for stop sequence missing, added print for exception when loading GUI 2023-05-02 14:18:04 +08:00
Concedo 0703cdf2eb remove cloudflare insights v1.17 2023-05-02 00:38:10 +08:00
DannyDaemonic f4cef87edf Add git-based build information for better issue tracking (#1232) 
* Add git-based build information for better issue tracking

* macOS fix

* "build (hash)" and "CMAKE_SOURCE_DIR" changes

* Redo "CMAKE_CURRENT_SOURCE_DIR" and clearer build messages

* Fix conditional dependency on missing target

* Broke out build-info.cmake, added find_package fallback, and added build into to all examples, added dependencies to Makefile

* 4 space indenting for cmake, attempt to clean up my mess in Makefile

* Short hash, less fancy Makefile, and don't modify build-info.h if it wouldn't change it
 2023-05-01 18:23:47 +02:00
slaren 58b367c2d7 cuBLAS: refactor and optimize f16 mat mul performance (#1259) 
* cuBLAS: refactor, convert fp16 to fp32 on device

* cuBLAS: use multiple streams, choose smartly between mul_mat_q and mul_mat_f16

* fix build

* cuBLAS: update block_q5_1
 2023-05-01 18:11:07 +02:00
xloem ea3a0ad6b6 llama : update stubs for systems without mmap and mlock (#1266) 
Co-authored-by: John Doe <john.doe@example.com>
 2023-05-01 15:58:51 +03:00
Kerfuffle 2bdc09646d ggml : fix ggml_used_mem() (#1264) 2023-05-01 14:56:07 +03:00
Georgi Gerganov 70269cae37 llama : fix session load / save (#1263) 2023-05-01 14:54:59 +03:00
slaren b925f1f1b0 cuBLAS: fall back to pageable memory if pinned alloc fails (#1233) 
* cuBLAS: fall back to pageable memory if pinned alloc fails

* cuBLAS: do not use pinned memory if env variable GGML_CUDA_NO_PINNED is set
 2023-05-01 13:32:22 +02:00
Alex Klinkhamer 90b19bd6ee llama : let context be const when accessing const data (#1261) 2023-05-01 10:24:20 +03:00
Concedo 4d38795563 add UI for token unbanning 2023-05-01 12:10:21 +08:00
Concedo 3de34ee492 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	CMakeLists.txt
#	Makefile
#	ggml-opencl.c
 2023-05-01 12:03:46 +08:00
Concedo 560dacedbd update readme 2023-05-01 11:41:25 +08:00
Georgi Gerganov 7ff0dcd320 ggml : fix UB (int << 31) 2023-04-30 22:28:51 +03:00
Pavol Rusnak 6f79699286 build: add armv{6,7,8} support to cmake (#1251) 
- flags copied from Makefile
- updated comments in both CMakeLists.txt and Makefile to match reality
 2023-04-30 20:48:38 +02:00
jon-chuang a5d30b1f53 common : better default number of threads (#934) 
* commit

* fix

* try-catch

* apply code review

* improve

* improve

* add macos headers

* done

* remove color

* fix windows

* minor

* fix

* Apply suggestions from code review

Co-authored-by: DannyDaemonic <DannyDaemonic@gmail.com>

* remove

* minor

* minor

---------

Co-authored-by: jon-chuang <jon-chuang@users.noreply.github.com>
Co-authored-by: DannyDaemonic <DannyDaemonic@gmail.com>
 2023-04-30 21:41:35 +03:00
0cc4m 76a884920a ggml : add CLBlast q5_0, q5_1, q8_0 dequant kernels (#1225) 
* Implement q5_0, q5_1 and q8_0

* Work around q5_0 OpenCL issue

* Fix q8_0 dequant kernel

* Move cl kernels into ggml-opencl.c

* Use two memcpy calls for q5_0 buffer transfer
 2023-04-30 21:34:52 +03:00
Georgi Gerganov 6bc4400e67 ggml : add Q5 WASM SIMD + GGML_FTYPE 2023-04-30 19:07:43 +03:00
Concedo 25201233ca fixed unbantokens not following EOS 2023-05-01 00:02:45 +08:00
Concedo 294a5d00b1 Merge remote-tracking branch 'occam/clblast-further-dequant-kernels' into concedo_experimental 
# Conflicts:
#	ggml-opencl.c
 2023-04-30 23:56:24 +08:00
Concedo 3b5df18dbb temp fix for compilation issues on OSX (M1) 2023-04-30 23:48:46 +08:00
Stephan Walter f0d70f147d Various fixes to mat_mul benchmark (#1253) 2023-04-30 12:32:37 +00:00
0cc4m e69c924ad1 Use two memcpy calls for q5_0 buffer transfer 2023-04-30 10:44:48 +02:00
Concedo fdd21d0eba add missing include 2023-04-30 16:15:11 +08:00
Georgi Gerganov 3e5aa8a1c4 ggml : fix labels for GGML_OP_ALIBI 2023-04-30 10:25:46 +03:00
Concedo b3315459c7 pilled the new dequants for clblast, fixed some ooms v1.16 2023-04-30 14:15:44 +08:00
Concedo 0061b90ec6 Merge branch 'master' into concedo_experimental 
# Conflicts:
#	CMakeLists.txt
#	Makefile
 2023-04-30 10:35:02 +08:00
Georgi Gerganov c3ca7a5f05 ggml : fix 32-bit ARM NEON 2023-04-29 21:34:23 +03:00
Georgi Gerganov e8c051611a ggml : use vzip instead of vuzp for consistency 2023-04-29 21:12:56 +03:00
Georgi Gerganov 0b5a935099 ggml : fix visibility and unused warnings 2023-04-29 19:28:36 +03:00
Georgi Gerganov ec728e44d7 ggml : fix #if for f32_f32 mul_mat (CLBlast) (#1229) 2023-04-29 18:43:42 +03:00