Averaging Specialists Produces A Generalist Nobody Hired
Model merging promises multiple skills without multiple deployments. Static averaging is cheap, but conflicting task vectors can cancel the exact behavior worth keeping.
taskrouter builds three transparent experts with distinct input regions. The baseline averages every prediction. The router chooses the nearest expert prototype without training another network.
Route First, Merge Second
Similarity is enough when task regions are separable. The route is logged, the expert functions are readable, and there is no calibration set quietly training a gate.
The benchmark also makes its limit obvious: overlapping task regions would require uncertainty or abstention. Training-free does not mean assumption-free.
The Number
Static merging produces 1.399 mean absolute error across 240 noisy requests. Similarity routing produces 0.276 mean absolute error on the same separated-task benchmark, an 80.2% reduction.
The source paper is current research rather than settled consensus. The repository labels that status and keeps the claim scoped to its synthetic test.
Research Basis
Inspired by the 2026 TR-Merging submission. The portfolio number above comes from this repository's own controlled benchmark, not from the paper.