Updated today
by sybil-solutions
inference-optimisation-skill
Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
51 GitHub stars (51)
+51 in 1 day
- 1 skill (1 skills found in its SKILL.md files)
- 3 forks (3 forks)
- Today last update (Last updated today)
Install
Skills CLI
npx skills add sybil-solutions/inference-optimisation-skill
Asks which agents to install it for. Add -g to install it for every project.
Claude Code
git clone https://github.com/sybil-solutions/inference-optimisation-skillcp -r "inference-optimisation-skill/skills/inference-optimisation" ~/.claude/skills/
Copies the inference-optimisation skill into ~/.claude/skills/ for every project (use .claude/skills/ for one project).
Plugin
/plugin marketplace add sybil-solutions/inference-optimisation-skill
Run inside Claude Code if the repository ships a plugin marketplace, then pick plugins from /plugin.
Skills can run code on your machine — read the SKILL.md first.
What it does
In the author's own words, from each skill's SKILL.md.
-
inference-optimisation
Hill-climb the serving speed of a local LLM on any hardware (NVIDIA, AMD, Intel, Apple, unified-memory laptops, multi-GPU) and any quantization (GGUF, EXL2/EXL3, AWQ/GPTQ, FP8, MLX, BF16): single-user and concurrent decode tok/s, speculative decoding, prefill tok/s, KV cache size, startup time and TTFT, under a memory cap and with full-context stability. Computes the theoretical ceiling first, ru…
skills/inference-optimisation/ on GitHub (opens in a new tab)SKILL.md
No skill matches that filter.
Review before you install
A skill is a set of instructions and scripts your agent will follow, and it can run code on your machine. Read the SKILL.md and any scripts first — this listing is not a security review.