Public/koboldcpp
1
0
Fork 0
mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-27 15:40:50 +02:00
Code Issues Packages Projects Releases Wiki Activity

use same struct size for cuda and non cuda (+1 squashed commits)

Browse Source 
Squashed commits:

[6eee8e2f] use same struct size for cuda and non cuda
This commit is contained in:
Concedo
2024-01-03 16:03:36 +08:00
parent 94e68fe474
commit e49d398f73
2 changed files with 4 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
llama.h
+3 -2
View File
@@ -4,9 +4,10 @@
#include "ggml.h"
#ifdef GGML_USE_CUBLAS
#include "ggml-cuda.h"
#define LLAMA_MAX_DEVICES GGML_CUDA_MAX_DEVICES
#define LLAMA_MAX_DEVICES 16
#else
#define LLAMA_MAX_DEVICES 1
//just max it out, same as GGML_CUDA_MAX_DEVICES
#define LLAMA_MAX_DEVICES 16
#endif // GGML_USE_CUBLAS
#include <stddef.h>
#include <stdint.h>