Search results

TensorRT trying to gobble 100% GPU VRAM without considering what's already in use

Module:Engine BuildIssues with building TensorRT enginesIssues with building TensorRT engines

Status: Open.

#4663 In NVIDIA/TensorRT;

· Mashrien opened on Dec 7, 2025

Is there any why to make safe trt fp16 conversion according the torch AMP training process

Module:QuantizationIssues related to QuantizationIssues related to Quantization

Status: Open.

#4662 In NVIDIA/TensorRT;

· JohnHerry opened on Dec 5, 2025

onnx to engine failure of TensorRT 10.8.0 when running trtexec.exe on GPU 3060TI

Module:ONNXIssues relating to ONNX usage and importIssues relating to ONNX usage and import

Status: Open.

#4658 In NVIDIA/TensorRT;

· HaohuiHU opened on Dec 4, 2025

[Question] [TREx] Unexpected TREx Layer-Sum vs End-to-End Latency Behavior in LLM Generation Phase (Qwen2-VL on NVIDIA Thor)

Module:QuantizationIssues related to QuantizationIssues related to Quantization

Module:TRExIssues with TRExIssues with TREx

Status: Open.

#4657 In NVIDIA/TensorRT;

· taoz27 opened on Dec 4, 2025

What is recommended way to convert into fp16 from fp32

Feature RequestRequest for new functionalityRequest for new functionality

Status: Open.

#4656 In NVIDIA/TensorRT;

· sarahliu-cisco opened on Dec 4, 2025

<code>configurePlugin</code> is called repeatedly for my BF16 SDPA plugin — how to run initialization graph only once?

Status: Open.

#4654 In NVIDIA/TensorRT;

· KarlDe1 opened on Dec 3, 2025

TRT installation issue : Test post

Status: Open.

#4650 In NVIDIA/TensorRT;

· aakankshas-debug opened on Nov 26, 2025

enqueueV3() return false, don't how to debug. i present my infer code

Status: Open.

#4649 In NVIDIA/TensorRT;

· Kivw opened on Nov 26, 2025

ONNX and TensorRT output different

Status: Open.

#4647 In NVIDIA/TensorRT;

· godbaz opened on Nov 24, 2025

GridSample outputs incorrect results in ONNX opset 20 (opset 18 works correctly)

Status: Open.

#4646 In NVIDIA/TensorRT;

· Alcoholrithm opened on Nov 20, 2025

Precision/behavior failure of TensorRT 10.12 when running mixed FP32/FP16 image restoration on GPU RTX 3080 Laptop

Status: Open.

#4645 In NVIDIA/TensorRT;

· rushdawn opened on Nov 19, 2025

Python Doc Incorrect

Status: Open.

#4643 In NVIDIA/TensorRT;

· leimao opened on Nov 14, 2025