koboldcpp

mirror of https://github.com/LostRuins/koboldcpp.git synced 2026-08-26 23:20:49 +02:00

Files

T

SebastianApel 95ea26f6e9 benchmark : add tool for timing q4_0 matrix multiplication (#653 )

* Initial version of q4_0 matrix multiplication benchmark

* Bugfix: Added dependency to ggml.o to benchmark

* Reviewer requests: added parameter for threads, switched to ggml_time_us()

* Reviewer input: removed rtsc, use epsilon for check

* Review comment: Removed set_locale

* Feature: Param for numer of iterations, Bugfix for use of parameter threads

* Reviewer suggestion: Moved to examples

* Reviewer feedback: Updated clean: and benchmark: sections

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

2023-04-13 15:46:23 +03:00

benchmark

benchmark : add tool for timing q4_0 matrix multiplication (#653 )

2023-04-13 15:46:23 +03:00

embedding

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )

2023-04-11 19:45:44 +00:00

main

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )

2023-04-11 19:45:44 +00:00

perplexity

Fix whitespace, add .editorconfig, add GitHub workflow (#883 )