{"name":"Shoehorn","tagline":"Quantize any language model to fit your machine's actual VRAM, then serve it locally.","url":"https://notactuallytreyanastasio.github.io/shoehorn/","category":"dev-infra","pricing":"free","price_note":"open source; bring your own compute and API keys","free_tier":true,"open_source":true,"api":false,"self_host":true,"verdict":"situational","verdict_text":"A practical answer to \"will this model run on my GPU?\" Shoehorn solves a per-tensor mixed-precision assignment from your real memory budget instead of forcing a preset quantization, squeezing out quality other presets waste. Free, local, and genuinely useful for anyone running LLMs on consumer hardware.","limitations":["Requires a working llama.cpp setup and some CLI comfort; the web UI still shells the same pipeline.","Windows support is compile-tested but not yet field-tested.","Auto-generated imatrices are skipped on Windows, so you need repos that publish one."],"strengths":["Quantizes any language model to fit your machine's actual VRAM budget.","Per-tensor mixed-precision assignment squeezes out quality other presets waste.","Free and local for running LLMs on consumer hardware."],"use_for":["Local LLM inference on consumer GPUs with tight VRAM constraints.","Scenarios where preset quantization throws away usable quality."],"skip_when":["You are not comfortable with llama.cpp and command-line workflows.","You run Windows and need auto-generated imatrices for every model.","A one-click web GUI is a hard requirement."],"receipts":["https://github.com/notactuallytreyanastasio/shoehorn"],"affiliate":"none","evidence_tier":"source-verified","momentum":"blueshift","featured":false,"data_sensitivity":{"trains_on_inputs":"unknown","local_processing":true},"last_verified":"2026-08-19","observed_by":"whysanesanders","slug":"shoehorn","canonical_url":"https://noemium.com/tools/shoehorn/","attribution":"Noemium catalog data is licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). See https://noemium.com/method/ for how entries are verified."}