 Concedo
|
92afdfcae4
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/labeler.yml
# .github/workflows/server.yml
# .gitignore
# CMakeLists.txt
# Makefile
# README-sycl.md
# README.md
# llama.cpp
# requirements/requirements-convert-hf-to-gguf-update.txt
# requirements/requirements-convert-hf-to-gguf.txt
# requirements/requirements-convert-legacy-llama.txt
# scripts/sync-ggml.last
# tests/test-tokenizer-random.py
|
2024-06-22 01:33:44 +08:00 |
|
|
Concedo
|
a0ecd0d8e6
|
update build job count, updated lite
|
2024-06-18 21:12:16 +08:00 |
|
|
Concedo
|
5c647419a9
|
updated lite
|
2024-06-17 21:22:37 +08:00 |
|
|
Concedo
|
e69da9c9d8
|
strings rename kobold lite to koboldai lite
|
2024-06-13 20:00:28 +08:00 |
|
|
Concedo
|
49e4c3fd7b
|
adjust lite default port, disable double BOS warning, whisper and SD go quiet when horde mode is set too
|
2024-06-13 15:10:35 +08:00 |
|
|
Concedo
|
92bbebb357
|
Check for keyanti before accessing it
|
2024-06-13 12:54:23 +08:00 |
|
|
Concedo
|
562d980140
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/full-cuda.Dockerfile
# .devops/full.Dockerfile
# .devops/main-cuda.Dockerfile
# .devops/main-rocm.Dockerfile
# .devops/main-vulkan.Dockerfile
# .devops/main.Dockerfile
# .devops/server-cuda.Dockerfile
# .devops/server.Dockerfile
# README.md
# common/CMakeLists.txt
# grammars/README.md
# tests/test-grammar-integration.cpp
# tests/test-grammar-parser.cpp
# tests/test-json-schema-to-grammar.cpp
|
2024-06-09 17:30:05 +08:00 |
|
|
Concedo
|
813cf829b5
|
allow selecting multigpu on vulkan
|
2024-06-06 18:36:56 +08:00 |
|
|
Concedo
|
3e4c44bace
|
update lite
|
2024-06-05 11:41:56 +08:00 |
|
|
Concedo
|
10b148f4c2
|
added skip bos for tokenize endpoint
|
2024-06-05 10:49:11 +08:00 |
|
|
Concedo
|
5789417802
|
logit bias tokenize feature
|
2024-06-04 15:47:34 +08:00 |
|
|
Concedo
|
cb62ab237b
|
updated settings menu
|
2024-06-03 22:06:38 +08:00 |
|
|
Concedo
|
0978806a3c
|
fix inverted probability
|
2024-06-03 16:02:35 +08:00 |
|
|
Concedo
|
10a1d628ad
|
added new binding fields for quant k and quant v
|
2024-06-03 14:35:59 +08:00 |
|
|
Concedo
|
b0a7d1aba6
|
fixed makefile (+1 squashed commits)
Squashed commits:
[ef6ddaf5] try fix makefile
|
2024-06-02 15:21:48 +08:00 |
|
|
Concedo
|
7ef31e541c
|
update lite and readme
|
2024-06-01 23:21:40 +08:00 |
|
|
Concedo
|
cb93aa5243
|
updated lite
|
2024-06-01 18:02:44 +08:00 |
|
|
Concedo
|
10cf077848
|
tweaking audio capture
|
2024-06-01 10:56:00 +08:00 |
|
|
Concedo
|
a65e0800ab
|
update docs, added gui for whisper
|
2024-06-01 02:01:49 +08:00 |
|
|
Concedo
|
318d5b87fc
|
fixed html replace
|
2024-05-25 02:15:04 +08:00 |
|
|
Concedo
|
dd558d8458
|
impersonate user bug
|
2024-05-25 00:54:50 +08:00 |
|
|
Concedo
|
13d1405104
|
fixed sysprompt and swapped toggles
|
2024-05-25 00:31:58 +08:00 |
|
|
Concedo
|
f6ab54aeff
|
updated lite, add api key masking
|
2024-05-23 20:00:53 +08:00 |
|
|
Concedo
|
cb872f7d9b
|
change gemini default
|
2024-05-22 21:58:47 +08:00 |
|
|
Concedo
|
ff5743100e
|
updated lite
|
2024-05-21 22:11:52 +08:00 |
|
|
Concedo
|
6c3fe1a17f
|
big clamp
|
2024-05-19 22:24:38 +08:00 |
|
|
Concedo
|
4b664b3409
|
improved EOT handling
|
2024-05-19 22:04:51 +08:00 |
|
|
Concedo
|
d5d5dda02b
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/nix/package.nix
# .github/workflows/build.yml
# .github/workflows/server.yml
# CMakeLists.txt
# Makefile
# README.md
# ggml-cuda.cu
# tests/test-backend-ops.cpp
|
2024-05-19 17:55:20 +08:00 |
|
|
Concedo
|
8633a71489
|
update lite
|
2024-05-17 22:01:54 +08:00 |
|
|
Concedo
|
51aa32b928
|
fixed a path bug in lite
|
2024-05-16 10:40:00 +08:00 |
|
|
Concedo
|
ebbb969526
|
update lite
|
2024-05-15 15:00:22 +08:00 |
|
|
Concedo
|
dbe72b959e
|
tidy up and refactor code to support old flags
|
2024-05-10 16:50:53 +08:00 |
|
|
Concedo
|
caf9f21888
|
update lite
|
2024-05-09 15:03:52 +08:00 |
|
|
Concedo
|
bd0ef8f366
|
add characterhub.org support
|
2024-05-08 19:53:18 +08:00 |
|
|
Concedo
|
165a56088b
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# ggml.c
# scripts/compare-llama-bench.py
# tests/test-backend-ops.cpp
|
2024-05-08 18:19:28 +08:00 |
|
|
Concedo
|
173c7272d5
|
EOS bypass mode added
|
2024-05-06 18:01:49 +08:00 |
|
|
Concedo
|
3667cc0113
|
fixed stableui btn (+4 squashed commit)
Squashed commit:
[1d4714f1] update default amount to gen
[6eacba33] updated lite
[033589af] added first ver sdui
[16f66d57] updated lite
|
2024-05-06 00:55:16 +08:00 |
|
|
Concedo
|
17a24d753c
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/main-intel.Dockerfile
# .devops/main-vulkan.Dockerfile
# .devops/server-intel.Dockerfile
# .devops/server-vulkan.Dockerfile
# .github/workflows/bench.yml
# .github/workflows/build.yml
# .github/workflows/python-lint.yml
# .github/workflows/server.yml
# .gitignore
# Makefile
# README-sycl.md
# README.md
# ci/run.sh
# flake.lock
# llama.cpp
# models/ggml-vocab-falcon.gguf
# models/ggml-vocab-llama-spm.gguf
# models/ggml-vocab-mpt.gguf
# models/ggml-vocab-stablelm.gguf
# models/ggml-vocab-starcoder.gguf
# requirements.txt
# scripts/check-requirements.sh
# tests/CMakeLists.txt
# tests/test-backend-ops.cpp
# tests/test-grammar-integration.cpp
# tests/test-tokenizer-0-bpe.py
# tests/test-tokenizer-0-spm.py
# tests/test-tokenizer-1-spm.cpp
|
2024-04-30 21:04:17 +08:00 |
|
|
Concedo
|
4025efb497
|
anti wi keys
|
2024-04-30 00:25:37 +08:00 |
|
|
Concedo
|
46c9785bb5
|
default max ctx to true max ctx if found
|
2024-04-28 15:49:45 +08:00 |
|
|
Concedo
|
8faa6ed84d
|
clarify some descriptions
|
2024-04-28 15:16:02 +08:00 |
|
|
Concedo
|
6c3fd5b685
|
updated lite (+2 squashed commit)
Squashed commit:
[d10a731e] update lite
[2554b8e6] update docs
|
2024-04-28 10:40:57 +08:00 |
|
|
Concedo
|
c230b78906
|
refactored a lot of code, remove bantokens, move it to api
|
2024-04-27 17:57:13 +08:00 |
|
|
Concedo
|
4ec8a9c57b
|
expose stop reason in generation
|
2024-04-27 01:12:12 +08:00 |
|
|
Concedo
|
a681cdd9ef
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# common/sampling.h
# llama.h
# tests/test-chat-template.cpp
|
2024-04-24 21:29:07 +08:00 |
|
|
Concedo
|
69dcffa4ec
|
updated lite and colab
|
2024-04-21 16:48:48 +08:00 |
|
|
Concedo
|
b01820dec7
|
auto rope scaling changes
|
2024-04-19 23:08:55 +08:00 |
|
|
Concedo
|
5b6ac9cc6e
|
add llama3 template
|
2024-04-19 22:15:35 +08:00 |
|
|
Concedo
|
bb7eb36134
|
test copying from install
|
2024-04-16 16:49:38 +08:00 |
|
|
Concedo
|
010b2a5a71
|
fixed bad handling for malformed requests
|
2024-04-14 20:37:08 +08:00 |
|