mistralrs uqff
Inspect, report, or verify UQFF artifacts
mistralrs uqff [OPTIONS] <COMMAND>mistralrs uqff report
Section titled “mistralrs uqff report”Print or write a UQFF report
mistralrs uqff report [OPTIONS] --model-id <MODEL_ID>| Option | Default | Description |
|---|---|---|
-m, --model-id <MODEL_ID> |
required | Hugging Face model ID or local path containing UQFF files |
--quant <QUANT> |
Quant group to inspect, such as 3, q3k, afq3, or all | |
--revision <REVISION> |
Hugging Face revision to use | |
--write |
false |
Write uqff_report.json beside the artifacts |
--json |
false |
Print JSON instead of human-readable text |
--base-model <BASE_MODEL> |
Base model ID to include in a written report | |
--repo-id <REPO_ID> |
Hugging Face repo ID to include in a written report |
mistralrs uqff verify
Section titled “mistralrs uqff verify”Validate UQFF artifact structure
mistralrs uqff verify [OPTIONS] --model-id <MODEL_ID>| Option | Default | Description |
|---|---|---|
-m, --model-id <MODEL_ID> |
required | Hugging Face model ID or local path containing UQFF files |
--quant <QUANT> |
Quant group to inspect, such as 3, q3k, afq3, or all | |
--revision <REVISION> |
Hugging Face revision to use | |
--json |
false |
Print JSON instead of human-readable text |
--strict |
false |
Fail on missing report/producer metadata or fallback layers |
--allow-newer-minor |
false |
Allow same-major UQFF files with a newer minor version |
mistralrs uqff inspect
Section titled “mistralrs uqff inspect”Open a UQFF-aware tensor explorer
mistralrs uqff inspect [OPTIONS] --model-id <MODEL_ID>| Option | Default | Description |
|---|---|---|
-m, --model-id <MODEL_ID> |
required | Hugging Face model ID or local path containing UQFF files |
--quant <QUANT> |
Quant group to inspect, such as 3, q3k, afq3, or all | |
--revision <REVISION> |
Hugging Face revision to use |