Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-09-11 15:29:12 +02:00
Code Issues Packages Projects Releases Wiki Activity
6,961 Commits 3 Branches 253 Tags
39fad991cc047195036fde1a49d06fdcc7140f8a
Commit Graph

6961 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Concedo 39fad991cc Merge branch 'upstream' into concedo_experimental 
# Conflicts:
#	README.md
#	examples/main/README.md
#	examples/run/run.cpp
 2025-02-14 11:34:29 +08:00
Weizhao Ouyang 198b1ec611 ggml-cpu: Fix duplicate MATMUL_INT8 (#11817) 
Signed-off-by: Weizhao Ouyang <o451686892@gmail.com>
 2025-02-12 13:22:58 +01:00
Johannes Gäßler c3d6af7cd2 CUDA: fix CUDART_VERSION checks (#11821) 2025-02-12 13:16:39 +01:00
Daniel Bevenius 369be5598a llama : fix typo in llama-grammar.h [no ci] (#11816) 2025-02-12 09:40:01 +02:00
Concedo 71016db617 remove tts audio caching 2025-02-12 11:37:43 +08:00
lhez 4078c77f98 docs: add OpenCL (#11697) 2025-02-11 15:04:13 -07:00
Sheldon Robinson 90e4dba461 Fix #11802: Compile bug - RegQueryValueExA changed to RegQueryValueEx (#11803) 
* Fix #11802: Compile bug - RegQueryValueExA changed to RegQueryValueEx

* Fix #11802: PR #11803 - keep RegQueryValueExA, remove TEXT macro, description needs to be ANSI string
 2025-02-11 16:55:45 +01:00
Daniel Bevenius a18f481f99 server : use common_token_to_piece instead of common_detokenize (#11740) 
* server : use common_token_to_piece instead of common_detokenize

This commit replaces the call to common_detokenize with
common_token_to_piece in the populate_token_probs.

The motivation for this change is to avoid an issue where
common_detokenize would remove the word boundary character for tokens,
which caused a regression in the server generated token probabilities.

Resolves: https://github.com/ggerganov/llama.cpp/issues/11728

* squash! server : use common_token_to_piece instead of common_detokenize

Use common_token_to_piece for post_sampling_probs as well.
 2025-02-11 14:06:45 +01:00
Johannes Gäßler b9ab0a4d0b CUDA: use arch list for compatibility check (#11775) 
* CUDA: use arch list for feature availability check

---------

Co-authored-by: Diego Devesa <slarengh@gmail.com>
 2025-02-11 00:17:22 +01:00
Maxim Evtush 7b891bdc86 fix: typos in documentation files (#11791) 
* Update ggml.c

* Update arg.cpp

* Update speculative.h
 2025-02-10 23:21:31 +01:00
jason_w 81732619fd docs: utilize the forward slash (/) as the path separator for Unix-like systems (#11770) 2025-02-10 23:17:48 +01:00
Xuan-Son Nguyen 507f9174fe server : (webui) introduce conversation branching + idb storage (#11792) 
* server : (webui) introduce conversation branching + idb storage

* mark old conv as "migrated" instead deleting them

* improve migration

* add more comments

* more clarification
 2025-02-10 21:23:17 +01:00
Wilken Gottwalt 19b392d58d llama-mmap: fix missing include (#11796) 
Technically the fixed width types come only from iostream and
cstdint/stdint.h headers. memory and vector headers should not provide
these. In GCC 15 the headers are cleaned up and you require the proper
header cstdint.

src/llama-mmap.h:26:5: error: ‘uint32_t’ does not name a type
   26 |     uint32_t read_u32() const;
      |     ^~~~~~~~
 2025-02-10 20:58:18 +02:00
Xuan-Son Nguyen 0893e0114e server : correct signal handler (#11795) 2025-02-10 18:03:28 +01:00
Concedo b162c25a5e fixed moe experts to use detected arch for key 2025-02-10 17:46:08 +08:00
Olivier Chafik d7b31a9d84 sync: minja (https://github.com/google/minja/commit/a72057e5190de2c612d4598bb10b4bfd0f53011f) (#11774) 2025-02-10 09:34:09 +00:00
pascal-lc 9ac3457b39 Update README.md [no ci] (#11781) 
typo: `\` -> `/`
Change the UNIX path separator to` \`.
 2025-02-10 09:05:57 +01:00
Danny Milosavljevic c2a67efe38 vulkan: Make Vulkan optional at runtime (#11493). (#11494) 
Co-authored-by: Jeff Bolz <jbolz@nvidia.com>
 2025-02-10 07:17:21 +01:00
Wagner Bruna b044a0fe3c vulkan: add environment variable GGML_VK_PREFER_HOST_MEMORY to avoid VRAM allocation (#11592) 2025-02-10 07:08:22 +01:00
Concedo c1d38897ee fix for websearch button visibility 2025-02-09 22:06:12 +08:00
Eric Curtin 19d3c8293b There's a better way of clearing lines (#11756) 
Use the ANSI escape code for clearing a line.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>
 2025-02-09 10:34:49 +00:00
Concedo bdade9be1b ensure scale before rep pen v1.83.1 2025-02-09 16:59:56 +08:00
Concedo 076e61effc fixed missing param 2025-02-09 16:02:59 +08:00
Jeff Bolz 98f6b0fd1e vulkan: account for lookup tables when checking shared memory size (#11502) 2025-02-09 08:43:51 +01:00
Concedo ed8b881c68 rc 1.83.1 2025-02-09 13:20:17 +08:00
Concedo fc50a29426 Merge branch 'concedo_experimental' of https://github.com/LostRuins/koboldcpp into concedo_experimental 2025-02-09 13:17:29 +08:00
Concedo 1cb42bf260 support running in single process mode without admin flag 2025-02-09 13:17:14 +08:00
Concedo fb87ca5cec Merge branch 'upstream' into concedo_experimental 2025-02-09 12:54:19 +08:00
Roman Garanin c0a16b5d4f Sort model configs in admin menu (#1357) 2025-02-09 12:53:52 +08:00
Concedo 4aa09bd1d4 updated lite 2025-02-09 12:47:48 +08:00
Concedo d22eca6c47 fix potential crash in autoguess 2025-02-09 12:33:28 +08:00
Xuan-Son Nguyen 55ac8c7791 server : (webui) revamp Settings dialog, add Pyodide interpreter (#11759) 
* redo Settings modal UI

* add python code interpreter

* fix auto scroll

* build

* fix overflow for long output lines

* bring back sticky copy button

* adapt layout on mobile view

* fix multiple lines output and color scheme

* handle python exception

* better state management

* add webworker

* add headers

* format code

* speed up by loading pyodide on page load

* (small tweak) add small animation to make it feels like claude
 2025-02-08 21:54:50 +01:00
Woof Dog e6e6583199 server : (webui) increase edit textarea size (#11763) 2025-02-08 20:09:55 +01:00
Georgi Gerganov aaa5505307 server : minor log updates (#11760) 
ggml-ci
 2025-02-08 18:08:43 +02:00
Concedo 3fa4843850 Merge branch 'upstream' into concedo_experimental 
# Conflicts:
#	examples/server/README.md
#	src/llama-model.cpp
 2025-02-08 22:57:18 +08:00
Concedo a83f2d5fce reduce some spamminess 2025-02-08 22:49:48 +08:00
Georgi Gerganov bdcf8b6a56 cont : fix mmap flag print (#11699) 2025-02-08 16:49:38 +02:00
Concedo 816d9b7989 edit makefile flags 2025-02-08 22:36:26 +08:00
Karol Kontny 4d3465c5ae ggml: Fix data race in ggml threadpool (#11736) 
After the barrier in last iteration is executed, still the loop termination
condition will be executed. However main thread can destroy the cgraph object
and its nodes already, then another thread will access it, but the thing is already gone.
Also trouble can happen when n_nodes == 0 or abort is called, but I'm not sure if the
prior situation is possible.

Last syncronization should be done after the loop to ensure the cgraph/cplan won't be
accessed after the main thread exits from the function.
 2025-02-08 15:30:53 +01:00
Johannes Gäßler d80be897ac CUDA: fix min. version for movmatrix (#11751) 2025-02-08 10:46:07 +01:00
Nikolaos Pothitos 3ab410f55f readme : update front-end framework (#11753) 
After the migration to React with #11688
 2025-02-08 10:43:04 +01:00
Xuan-Son Nguyen 0cf867160c server : (webui) fix numeric settings being saved as string (#11739) 
* server : (webui) fix numeric settings being saved as string

* add some more comments
 2025-02-08 10:42:34 +01:00
Concedo e68a3cf1dc fixed some functions when no model is loaded 2025-02-08 11:15:26 +08:00
Concedo b100bcb9e6 allow ssl with remote tunnel v1.83 2025-02-08 02:11:10 +08:00
Concedo 27b9358baf Merge branch 'upstream' into concedo_experimental 
# Conflicts:
#	examples/run/run.cpp
#	scripts/sync-ggml.last
 2025-02-08 01:31:49 +08:00
Concedo 58e2b19d56 check against platform.machine() 2025-02-08 01:20:31 +08:00
FlippFuzz 5a0ed19c96 Remote Tunnel for ARM64 Linux (#1353) 
* Update koboldcpp.py

* Fix style. Changed to double quotes to match.
 2025-02-08 01:16:30 +08:00
Concedo cf4d0085f6 more bugfixes for admin mode 2025-02-08 01:00:52 +08:00
Eric Curtin d2fe216fb2 Make logging more verbose (#11714) 
Debugged an issue with a user who was on a read-only filesystem.

Signed-off-by: Eric Curtin <ecurtin@redhat.com>
 2025-02-07 14:42:46 +00:00
Georgi Gerganov ed926d8833 llama : fix defrag logic (#11707) 
* llama : fix defrag logic

ggml-ci

* cont : better logic

ggml-ci

* cont : clamp fragmentation to 0.0

ggml-ci
 2025-02-07 16:05:34 +02:00