mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-09-15 03:08:49 +02:00
213c4a0b81
* support flash-attention for fp32/fp16/Q4/Q5/Q8 * rm warining * update for JIT