DeepBench Inference: RNN & Sparse GEMM
DeepBench Inference: RNN and Sparse GEMM
Rounding out the last of our DeepBench inference tests are RNN and Sparse GEMM, both available in single precision only. That being said, the FP16 parameter could be selected anyway. Given the low results all around, this is more of an artifact than anything else.



While RNNs might also be accelerated, DeepBench and NVIDIA only support single precision RNN inference at this time.
ncG1vNJzZmivp6x7orrAp5utnZOde6S7zGiqoaenZH5zgpZsZq2hpJa7bsKMnZyeqF2hsqK%2BzaKloGWUmrKxecOirZ5nYWc%3D
Fernande Dalal
Update: 2024-06-08