mirror of
https://github.com/ggml-org/llama.cpp.git
synced 2026-09-13 02:10:45 +02:00
docs: remove README.md from llama-eval
This commit is contained in:
@@ -1,17 +0,0 @@
|
||||
# llama.cpp/example/llama-eval
|
||||
|
||||
`llama-eval.py` is a single-script evaluation runner that sends prompt/response pairs to any OpenAI-compatible HTTP server (the default `llama-server`).
|
||||
|
||||
```bash
|
||||
./llama-server -m model.gguf --port 8033
|
||||
python examples/llama-eval/llama-eval.py --path_server http://localhost:8033 --n_prompts 100 --prompt_source arc
|
||||
```
|
||||
|
||||
The supported tasks are:
|
||||
|
||||
- **GSM8K** — grade-school math
|
||||
- **AIME** — competition math (integer answers)
|
||||
- **MMLU** — multi-domain multiple choice
|
||||
- **HellaSwag** — commonsense reasoning multiple choice
|
||||
- **ARC** — grade-school science multiple choice
|
||||
- **WinoGrande** — commonsense coreference multiple choice
|
||||
Reference in New Issue
Block a user