mirror of
https://github.com/LostRuins/koboldcpp.git
synced 2026-09-18 00:35:04 +02:00
dcca0d3ab8
Factor out the core FA loop into flash_atten_f16_one_chunk and add an outter loop on top that handles the chunks.