Public/automatic
1
0
Fork 0
mirror of https://github.com/vladmandic/automatic synced 2026-09-19 17:24:32 +02:00
Code Issues Packages Projects Releases Wiki Activity

update unipc

Browse Source
This commit is contained in:
Vladimir Mandic
2023-03-13 13:10:44 -04:00
parent f2e9991de5
commit 08f170f87a
10 changed files with 15 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files
cli/random/dynamotest.py
-6
View File
@@ -94,10 +94,4 @@ Inference-only backends:
dynamo.optimize("ofi") - Uses Torchscript optimize_for_inference
dynamo.optimize("fx2trt") - Uses Nvidia TensorRT for inference optimizations
dynamo.optimize("onnxrt") - Uses ONNXRT for inference on CPU/GPU
Results:
"default": 4.247040033340454,
"ofi": 3.820032000541687,
"aot_cudagraphs": 6.460927963256836,
"inductor": RuntimeError: CUDA: Error- no device
"fx2trt": ImportError: libtorch_cuda_cu.so: cannot open shared object file: No such file or directory
"""