From 315efe7c92e458e5eb45c48766ae21e02646c120 Mon Sep 17 00:00:00 2001 From: brian khuu Date: Tue, 11 Jun 2024 23:21:55 +1000 Subject: [PATCH] some elements are not actually part of gguf spec --- dev-notes.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/dev-notes.md b/dev-notes.md index 595fde1..62c732a 100644 --- a/dev-notes.md +++ b/dev-notes.md @@ -42,6 +42,12 @@ the gguf file standard. | Tensor Info Entry - Tensor shape sizing array | gguf_tensor_info.ne | `uint64_t[GGML_MAX_DIMS]` | `struct gguf_tensor_info` | `@gguf_tensor_info` | | Tensor Info Entry - Tensor Encoding Scheme / Strategy | gguf_tensor_info.type | `ggml_type` | `struct gguf_tensor_info` | `@gguf_tensor_info` | | Tensor Info Entry - Offset from start of 'data' | gguf_tensor_info.offset | `uint64_t` | `struct gguf_tensor_info` | `@gguf_tensor_info` | + +Also just note that these values are not actually part of gguf but is there for internal usage and is calculated during model loading. +Aka it's for the writing/reading api + +| GGML Elements Of Interest | c name | c type | gguf.c reference | vscode search line | +|-------------------------------------------------------|-------------------------|---------------------------|---------------------------|---------------------| | Alignment | alignment | `size_t` | `struct gguf_context` | `@gguf_context` | | Offset Of 'Data' From Beginning Of File | offset | `size_t` | `struct gguf_context` | `@gguf_context` | | Size Of 'Data' In Bytes | size | `size_t` | `struct gguf_context` | `@gguf_context` |