4 Commits

Author	SHA1	Message	Date
Concedo	59fb174678	fixed compile errors, made mmap automatic when lora is selected, added updated quantizers and quantization handling for gpt neox gpt 2 and gptj	2023-04-24 23:20:06 +08:00
Concedo	1b9b9068b1	merged q4_2 and q4_3 dequants and FIXED CLBLAST SLOWNESS!	2023-04-24 21:33:01 +08:00
Concedo	8bf2e50a11	converted the cl file to be a string literal instead	2023-04-16 15:57:30 +08:00
0cc4m	57d046eeb6	Enable dequantization on GPU for ClBlast	2023-04-15 18:04:24 +02:00