BlogVibe

DeepBench Inference: RNN & Sparse GEMM

DeepBench Inference: RNN and Sparse GEMM

Rounding out the last of our DeepBench inference tests are RNN and Sparse GEMM, both available in single precision only. That being said, the FP16 parameter could be selected anyway. Given the low results all around, this is more of an artifact than anything else.

DL Inference: DeepBench - RNN (LSTM)

DL Inference: DeepBench - RNN (GRU)

DL Inference: DeepBench - Sparse GEMM

While RNNs might also be accelerated, DeepBench and NVIDIA only support single precision RNN inference at this time.

ncG1vNJzZmivp6x7orrAp5utnZOde6S7zGiqoaenZH5zgpZsZq2hpJa7bsKMnZyeqF2hsqK%2BzaKloGWUmrKxecOirZ5nYWc%3D

Fernande Dalal

Update: 2024-06-08