bdf16d7a3c
aria2 needs to show more info
2023-11-05 22:13:22 +08:00
351dcabd3e
lite fix
2023-11-05 14:47:02 +08:00
faae84ee1d
removed c flag in wget
2023-11-05 10:21:28 +08:00
02595f9d21
Colabcpp improvements ( #512 )
...
* Aria2
* Aria2 Typo fix
* Streamlined Wget
* Streamlining Fix
* Back to .so downloading
* Crash colab if no GPU is present
* Created using Colaboratory
* Restore proper link
Colab overwrite the link, manually changing it back so people don't land on my branch.
* Restore file juggle
* Fixing the colab link... again
2023-11-05 10:19:09 +08:00
5e5be717c3
fix for removing inaccessible backends in gui
2023-11-05 10:12:12 +08:00
1e7088a80b
autopick cublas in gui if possible, better layer picking logic
2023-11-05 01:35:27 +08:00
7a8c0df2e5
Merge branch 'master' into concedo_experimental
2023-11-04 09:18:28 +08:00
135001abc4
try to make the tunnel more reliable
2023-11-04 09:18:19 +08:00
38471fbe06
tensor core info better printout (+1 squashed commits)
...
Squashed commits:
[be4ef93f] tensor core info better printout
2023-11-04 08:38:25 +08:00
d9b33fe95b
metal : round up to 16 to fix MTLDebugComputeCommandEncoder assertion ( #3938 )
2023-11-03 21:18:18 +02:00
5ba3746171
ggml-metal: fix yarn rope ( #3937 )
2023-11-03 14:00:31 -04:00
36f43ae834
syntax correction
2023-11-04 00:03:45 +08:00
9bc2e35b2e
Merge branch 'master' into concedo_experimental
2023-11-03 23:51:32 +08:00
373c20ad51
print error log if tunnel fails
2023-11-03 23:48:21 +08:00
abb77e7319
ggml-cuda : move row numbers to x grid dim in mmv kernels ( #3921 )
2023-11-03 12:13:09 +01:00
c794fd5ceb
sampler seed added (+1 squashed commits)
...
Squashed commits:
[8a1b0d3d] sampler seed added
2023-11-03 17:30:16 +08:00
d7729ac3eb
Merge branch 'master' into concedo_experimental
2023-11-03 16:00:05 +08:00
8f961abdc4
speculative : change default p_accept to 0.5 + CLI args ( #3919 )
...
ggml-ci
2023-11-03 09:41:56 +02:00
05816027d6
common : YAYF (yet another YARN fix) ( #3925 )
...
ggml-ci
2023-11-03 09:24:00 +02:00
3fdbe6b66b
llama : change yarn_ext_factor placeholder to -1 ( #3922 )
2023-11-03 08:31:58 +02:00
8c14c81b33
hopefully this fixes the dotnet nonsense
2023-11-03 11:23:56 +08:00
bc2027b008
Merge remote-tracking branch 'ceb/fix-fast-ext-factor' into concedo_experimental
2023-11-03 11:21:14 +08:00
c07c9b857d
Merge branch 'master' into concedo_experimental
...
# Conflicts:
# README.md
2023-11-03 11:17:07 +08:00
25fef506cf
llama : change yarn_ext_factor placeholder to -1
2023-11-02 21:53:59 -04:00
629f917cd6
cuda : add ROCM aliases for CUDA pool stuff ( #3918 )
2023-11-02 21:58:22 +02:00
51b2fc11f7
cmake : fix relative path to git submodule index ( #3915 )
2023-11-02 21:40:31 +02:00
224e7d5b14
readme : add notice about #3912
2023-11-02 20:44:12 +02:00
c7743fe1c1
cuda : fix const ptrs warning causing ROCm build issues ( #3913 )
2023-11-02 20:32:11 +02:00
d6069051de
cuda : use CUDA memory pool with async memory allocation/deallocation when available ( #3903 )
...
* Using cuda memory pools for async alloc/dealloc.
* If cuda device doesnt support memory pool than use old implementation.
* Removed redundant cublasSetStream
---------
Co-authored-by: Oleksii Maryshchenko <omaryshchenko@dtis.com >
2023-11-02 19:10:39 +02:00
879061c5d5
noavx2 clblast selector
2023-11-02 23:13:16 +08:00
c7c3f3d9ab
updated lite
2023-11-02 22:46:54 +08:00
b0c7b88eac
try fix clouflare tunnel (+2 squashed commit)
...
Squashed commit:
[87d96bf2] update remote option
[c30bc909] updated fixed colab (+1 squashed commits)
Squashed commits:
[97b77563] updated fixed colab (+2 squashed commit)
Squashed commit:
[d851b04c] replaced cloudflare manual dl with remotetunnel in colab
[90ff1790] updated lite
2023-11-02 22:27:35 +08:00
4ff1046d75
gguf : print error for GGUFv1 files ( #3908 )
2023-11-02 16:22:30 +02:00
6dbb8d82b0
Merge branch 'master' into concedo_experimental
...
# Conflicts:
# CMakeLists.txt
# models/ggml-vocab-llama.gguf
2023-11-02 20:51:45 +08:00
42eabf2f2f
rope fixes
2023-11-02 20:41:16 +08:00
21958bb393
cmake : disable LLAMA_NATIVE by default ( #3906 )
2023-11-02 14:10:33 +02:00
bc4ff72317
not working merge
2023-11-02 17:52:40 +08:00
2756c4fbff
gguf : remove special-case code for GGUFv1 ( #3901 )
...
ggml-ci
2023-11-02 11:20:21 +02:00
1efae9b7dc
llm : prevent from 1-D tensors being GPU split ( #3697 )
2023-11-02 09:54:44 +02:00
fca7a4c054
added noavx2 model for clblast (+1 squashed commits)
...
Squashed commits:
[291ecae6] added noavx2 mode for clblast (+1 squashed commits)
Squashed commits:
[562bc872] wip adding noavx2 cl
2023-11-02 15:22:34 +08:00
b12fa0d1c1
build : link against build info instead of compiling against it ( #3879 )
...
* cmake : fix build when .git does not exist
* cmake : simplify BUILD_INFO target
* cmake : add missing dependencies on BUILD_INFO
* build : link against build info instead of compiling against it
* zig : make build info a .cpp source instead of a header
Co-authored-by: Matheus C. França <matheus-catarino@hotmail.com >
* cmake : revert change to CMP0115
---------
Co-authored-by: Matheus C. França <matheus-catarino@hotmail.com >
2023-11-02 08:50:16 +02:00
4d719a6d4e
cuda : check if this fixes Pascal card regression ( #3882 )
2023-11-02 08:35:10 +02:00
183b3fac6c
metal : fix build errors and kernel sig after #2268 ( #3898 )
2023-11-02 08:33:37 +02:00
82267e5e69
switched back to clinfo since it's possibly more cross platform and can get memory vals easily
2023-11-02 14:12:05 +08:00
2fffa0d61f
cuda : fix RoPE after #2268 ( #3897 )
2023-11-02 07:49:44 +02:00
d480d2c204
ggml-cuda : compute ptrs for cublasGemmBatchedEx in a kernel ( #3891 )
...
* ggml-cuda : compute ptrs for cublasGemmBatchedEx in a kernel
* fix warnings
(cherry picked from commit d02e98cde0
2023-11-02 11:19:53 +08:00
1ab18ecb53
Merge commit 'c43c2da8afacaddfe51c09b21dbd9922cd0ea46b' into concedo_experimental
...
# Conflicts:
# llama.cpp
2023-11-02 11:17:59 +08:00
0eb332a10f
llama : fix llama_context_default_params after #2268 ( #3893 )
2023-11-01 19:29:14 -04:00
d02e98cde0
ggml-cuda : compute ptrs for cublasGemmBatchedEx in a kernel ( #3891 )
...
* ggml-cuda : compute ptrs for cublasGemmBatchedEx in a kernel
* fix warnings
2023-11-01 23:10:09 +01:00
898aeca90a
llama : implement YaRN RoPE scaling ( #2268 )
...
Co-authored-by: cebtenzzre <cebtenzzre@gmail.com >
Co-authored-by: Jeffrey Quesnelle <jquesnelle@gmail.com >
2023-11-01 18:04:33 -04:00
Concedo
henk717
Peter Sugihara
Xiao-Yong Jin
slaren
Georgi Gerganov
cebtenzzre
Kerfuffle
Andrei
Oleksii Maryshchenko