MCP Server
MCP
io.github.RudrenduPaul/inferbench
Benchmarks local LLM inference speed (tokens/sec) on your own hardware via MCP tools.
Install
uvx inferbench-cli
Configuration Example
{
"remotes": [],
"packages": [
{
"registryType": "pypi",
"identifier": "inferbench-cli",
"version": "0.1.7",
"runtimeHint": "uvx",
"transport": {
"type": "stdio"
},
"runtimeArguments": [
{
"value": "inferbench-cli",
"type": "named",
"name": "--from"
}
],
"packageArguments": [
{
"value": "inferbench-mcp",
"type": "positional",
"valueHint": "script_name"
}
]
}
]
}
mcp
model-context-protocol
pypi
By
Comments
Sign in to leave a comment