mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-08-26 23:20:49 +02:00
014dca49d6
* CUDA: manage NCCL communicators in context * add check that all backends are CUDA * remove unused vector, limit init to > 1 GPUs * fix warnings * fix cuda device, cache allreduce