use this on local models

[Akash08naik]

See i have a model with weights locally in my system . Now without calling it from any platform how can i check the inference and throughput and other metrics for that model.

[xieus]

The dashboard uses llmperf benchmarking tool to run tests over different LLM APIs.

You can use the exact same llmperf benchmarking tool to run test against models deployed in your local machine.