 Concedo
|
12fd16bfd4
|
Merge commit 'df270ef74596da8f1178f08991f4c51f18c9ee82' into concedo_experimental
# Conflicts:
# Makefile
# common/CMakeLists.txt
# common/common.h
# common/sampling.cpp
# common/sampling.h
# examples/infill/infill.cpp
# examples/llama-bench/llama-bench.cpp
# examples/quantize-stats/quantize-stats.cpp
# examples/server/server.cpp
# include/llama.h
# src/llama-sampling.cpp
# src/llama-sampling.h
# src/llama.cpp
# tests/test-grammar-integration.cpp
# tests/test-grammar-parser.cpp
# tests/test-json-schema-to-grammar.cpp
# tests/test-llama-grammar.cpp
# tests/test-sampling.cpp
|
2024-09-09 17:10:08 +08:00 |
|
|
Concedo
|
2e74bd0327
|
updated lite, added compile flag fix
|
2024-09-07 10:27:37 +08:00 |
|
|
Concedo
|
73dca7e5bc
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/full-cuda.Dockerfile
# .devops/nix/devshells.nix
# .devops/nix/nixpkgs-instances.nix
# .devops/nix/package.nix
# .devops/nix/scope.nix
# README.md
# docs/docker.md
# examples/llama-bench/llama-bench.cpp
# flake.lock
# flake.nix
# grammars/README.md
# src/llama.cpp
|
2024-09-06 01:07:31 +08:00 |
|
|
Concedo
|
d777995991
|
able to handle kcpp protected model name endpoints
|
2024-09-04 16:26:28 +08:00 |
|
|
Concedo
|
b6f9aaa9ab
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# docs/backend/SYCL.md
|
2024-08-30 20:25:34 +08:00 |
|
|
Concedo
|
a22a666f3b
|
allow online apis when in nomodel mode
|
2024-08-27 15:30:54 +08:00 |
|
|
Concedo
|
97aa8648ed
|
allow launching with no models loaded
|
2024-08-25 23:57:32 +08:00 |
|
|
Concedo
|
5bf527a6ae
|
added xtc sampler
|
2024-08-21 23:57:15 +08:00 |
|
|
Concedo
|
cd69ab218e
|
fixed DRY
|
2024-08-21 17:01:28 +08:00 |
|
|
Concedo
|
7ee359a59b
|
on multigpu setups, pick lowest free mem instead of highest for auto layers
|
2024-08-20 19:02:16 +08:00 |
|
|
Concedo
|
b3b00750b7
|
update lite
|
2024-08-18 18:23:21 +08:00 |
|
|
Concedo
|
e9eb6fe51a
|
move chat compl to models tab
|
2024-08-18 14:56:10 +08:00 |
|
|
Concedo
|
98dff80b9c
|
update lite
|
2024-08-18 12:00:06 +08:00 |
|
|
Concedo
|
d71b5477c5
|
update lite, cleanup, fix interrogate format
|
2024-08-18 00:48:53 +08:00 |
|
|
Concedo
|
1edf83761a
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/workflows/bench.yml.disabled
# Makefile
# README.md
# ggml/CMakeLists.txt
# ggml/src/CMakeLists.txt
# ggml/src/ggml-vulkan.cpp
|
2024-08-17 16:21:14 +08:00 |
|
|
Concedo
|
e8de0af3ec
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/workflows/bench.yml
# .github/workflows/build.yml
# .github/workflows/python-check-requirements.yml
# README.md
# docs/backend/SYCL.md
# flake.lock
# ggml/CMakeLists.txt
# ggml/src/kompute-shaders/op_rope_f16.comp
# ggml/src/kompute-shaders/op_rope_f32.comp
# ggml/src/kompute-shaders/rope_common.comp
|
2024-08-14 22:25:43 +08:00 |
|
|
Concedo
|
86e687ae8b
|
updated lite, added promptlimit
|
2024-08-10 16:05:24 +08:00 |
|
|
Concedo
|
6b8b50b350
|
try fix ipv6 (+1 squashed commits)
Squashed commits:
[8d95a639] try fix ipv6
|
2024-08-06 15:36:46 +08:00 |
|
|
Concedo
|
bfdf4b021f
|
adjust v4-v6 allocation, default back to localhost
|
2024-08-04 11:42:16 +08:00 |
|
|
Concedo
|
9a0976761e
|
use loopback ip instead of localhost
|
2024-08-03 00:41:32 +08:00 |
|
|
Concedo
|
bf35652ef7
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/workflows/build.yml
# .gitignore
# flake.lock
# ggml/CMakeLists.txt
# ggml/src/CMakeLists.txt
|
2024-07-30 22:31:49 +08:00 |
|
|
Concedo
|
ba5babb876
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/nix/apps.nix
# .devops/tools.sh
# Makefile
# README.md
# docs/backend/SYCL.md
# docs/build.md
# examples/CMakeLists.txt
# ggml/include/ggml.h
# src/llama-vocab.cpp
# tests/test-backend-ops.cpp
# tests/test-chat-template.cpp
# tests/test-sampling.cpp
|
2024-07-27 23:15:54 +08:00 |
|
|
Concedo
|
e28c42d7f7
|
adjusted layer estimation
|
2024-07-24 21:54:49 +08:00 |
|
|
Concedo
|
b7fc8e644a
|
fix broken template, updated lite
|
2024-07-24 20:47:05 +08:00 |
|
|
Concedo
|
44ef87f14c
|
update lite, try fix ci
|
2024-07-24 16:31:34 +08:00 |
|
|
Concedo
|
0ecf13fc13
|
updated lite, extra error logging
|
2024-07-21 17:55:47 +08:00 |
|
|
Concedo
|
1a23d49c32
|
serve tags endpoint
|
2024-07-19 16:08:54 +08:00 |
|
|
Concedo
|
6080fa38ce
|
updated lite
|
2024-07-18 15:55:45 +08:00 |
|
|
Concedo
|
eca7521c13
|
allowed embedded chat adapters
|
2024-07-17 18:08:43 +08:00 |
|
|
Concedo
|
d775a419b2
|
updated lite with chat inject, added layer detect, added more console logging
|
2024-07-16 23:10:15 +08:00 |
|
|
Concedo
|
21179d675b
|
try ci for avx1, up ver (+2 squashed commit)
Squashed commit:
[74150175] up version
[97b6163c] try ci for avx1 linux
|
2024-07-15 23:07:07 +08:00 |
|
|
Concedo
|
066e7ac540
|
minor fixes: colab gpu backend, lite bugs, package python file with embd
|
2024-07-15 17:36:03 +08:00 |
|
|
Concedo
|
5caf5f9770
|
update lite
|
2024-07-13 23:36:42 +08:00 |
|
|
Concedo
|
97c7cf66fe
|
fixed typo
|
2024-07-13 19:03:00 +08:00 |
|
|
Concedo
|
33c51d3987
|
updated lite (+1 squashed commits)
Squashed commits:
[5af323f9] updated lite
|
2024-07-13 16:32:49 +08:00 |
|
|
Concedo
|
116d5fe58e
|
updated lite
|
2024-07-09 20:42:51 +08:00 |
|
|
Concedo
|
82202aebda
|
updated lite, add gemma 2 template
|
2024-07-02 21:02:52 +08:00 |
|
|
Concedo
|
e433afb261
|
updated lite
|
2024-06-27 15:51:34 +08:00 |
|
|
Concedo
|
24bfa54f3c
|
updated lite
|
2024-06-26 18:53:32 +08:00 |
|
|
Concedo
|
92afdfcae4
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .github/labeler.yml
# .github/workflows/server.yml
# .gitignore
# CMakeLists.txt
# Makefile
# README-sycl.md
# README.md
# llama.cpp
# requirements/requirements-convert-hf-to-gguf-update.txt
# requirements/requirements-convert-hf-to-gguf.txt
# requirements/requirements-convert-legacy-llama.txt
# scripts/sync-ggml.last
# tests/test-tokenizer-random.py
|
2024-06-22 01:33:44 +08:00 |
|
|
Concedo
|
a0ecd0d8e6
|
update build job count, updated lite
|
2024-06-18 21:12:16 +08:00 |
|
|
Concedo
|
5c647419a9
|
updated lite
|
2024-06-17 21:22:37 +08:00 |
|
|
Concedo
|
e69da9c9d8
|
strings rename kobold lite to koboldai lite
|
2024-06-13 20:00:28 +08:00 |
|
|
Concedo
|
49e4c3fd7b
|
adjust lite default port, disable double BOS warning, whisper and SD go quiet when horde mode is set too
|
2024-06-13 15:10:35 +08:00 |
|
|
Concedo
|
92bbebb357
|
Check for keyanti before accessing it
|
2024-06-13 12:54:23 +08:00 |
|
|
Concedo
|
562d980140
|
Merge branch 'upstream' into concedo_experimental
# Conflicts:
# .devops/full-cuda.Dockerfile
# .devops/full.Dockerfile
# .devops/main-cuda.Dockerfile
# .devops/main-rocm.Dockerfile
# .devops/main-vulkan.Dockerfile
# .devops/main.Dockerfile
# .devops/server-cuda.Dockerfile
# .devops/server.Dockerfile
# README.md
# common/CMakeLists.txt
# grammars/README.md
# tests/test-grammar-integration.cpp
# tests/test-grammar-parser.cpp
# tests/test-json-schema-to-grammar.cpp
|
2024-06-09 17:30:05 +08:00 |
|
|
Concedo
|
813cf829b5
|
allow selecting multigpu on vulkan
|
2024-06-06 18:36:56 +08:00 |
|
|
Concedo
|
3e4c44bace
|
update lite
|
2024-06-05 11:41:56 +08:00 |
|
|
Concedo
|
10b148f4c2
|
added skip bos for tokenize endpoint
|
2024-06-05 10:49:11 +08:00 |
|
|
Concedo
|
5789417802
|
logit bias tokenize feature
|
2024-06-04 15:47:34 +08:00 |
|