NIM
bench
NIM
bench
Bench
Data
Your prompt
Run on 4 models
Add your NIM API key to run
Provider
Select a provider…
4 selected
Select all
Clear
Enter your Nvidia API key above to fetch all available models.
#
Model
tok/s
TTFT
p95
Runs
·
llama-3.1-8b-instruct
—
—
—
—
·
llama-3.1-nemotron-70b-instruct
—
—
—
—
·
deepseek-r1
—
—
—
—
·
qwen2.5-72b-instruct
—
—
—
—