FLASHRSI / RESULTS MATRIX
Source-task and transfer performance (%)
Rows are methods × target harnesses. Columns separate the source benchmark, evaluation type, and benchmark route so the full study stays readable without repeating one route per row.
positive Δ ppzeronegative Δ ppFinal score shown above the change from the initial harness
| Method | Target harness | SourceIn-domain | Near-domainFrozen transfer | Far-OODFrozen transfer | ||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SearchQAIn-domain | HotpotQAIn-domain | Terminal-Bench 2.0In-domain | AppWorldIn-domain | SearchQANQ | SearchQATriviaQA | HotpotQAMuSiQue | Terminal-Bench 2.0SWE-bench | AppWorldBFCL Multi-Turn | SearchQAOfficeQA Pro | HotpotQADeepSearchQA | ||
| Initial harness | Claude Code | 73.93 | 57.32 | 63.33 | 64.88 | 56.67 | 68.67 | 67.50 | 76.67 | 65.00 | 44.19 | 62.00 |
| Mini-Agent | 76.43 | 58.54 | 66.67 | 65.48 | 59.33 | 74.33 | 65.83 | 80.00 | 70.00 | 27.91 | 52.00 | |
| SkillOpt | Claude Code | 83.14+9.21 | 60.98+3.66 | 70.00+6.67 | 84.52+19.64 | 69.00+12.33 | 82.00+13.33 | 76.67+9.17 | 80.00+3.33 | 68.75+3.75 | 46.51+2.32 | 36.00-26.00 |
| Mini-Agent | 82.93+6.50 | 59.76+1.22 | 66.670.00 | 91.67+26.19 | 62.00+2.67 | 84.33+10.00 | 74.17+8.34 | 86.67+6.67 | 68.75-1.25 | 37.21+9.30 | 46.00-6.00 | |
| OPRO | Claude Code | 81.43+7.50 | 62.20+4.88 | 63.330.00 | 66.07+1.19 | 69.67+13.00 | 80.33+11.66 | 73.33+5.83 | 80.00+3.33 | 66.25+1.25 | 51.16+6.97 | 30.00-32.00 |
| Mini-Agent | 80.71+4.28 | 60.98+2.44 | 66.670.00 | 59.52-5.96 | 64.67+5.34 | 81.33+7.00 | 78.33+12.50 | 80.000.00 | 68.75-1.25 | 41.86+13.95 | 44.00-8.00 | |
| AHE | Claude Code | 79.36+5.43 | 60.98+3.66 | 70.00+6.67 | 91.67+26.79 | 66.00+9.33 | 81.67+13.00 | 74.17+6.67 | 80.00+3.33 | 71.25+6.25 | 46.51+2.32 | 46.00-16.00 |
| Mini-Agent | 78.57+2.14 | 57.32-1.22 | 60.00-6.67 | 71.43+5.95 | 66.33+7.00 | 79.00+4.67 | 73.33+7.50 | 83.33+3.33 | 72.50+2.50 | 34.88+6.97 | 46.00-6.00 | |
| ACE | Claude Code | 83.93+10.00 | 63.41+6.09 | 66.67+3.34 | 91.07+26.19 | 64.00+7.33 | 85.67+17.00 | 72.50+5.00 | 73.33-3.34 | 73.75+8.75 | 41.86-2.33 | 36.00-26.00 |
| Mini-Agent | 84.71+8.28 | 63.41+4.87 | 70.00+3.33 | 91.67+26.19 | 62.67+3.34 | 85.33+11.00 | 75.83+10.00 | 70.00-10.00 | 67.50-2.50 | 30.23+2.32 | 54.00+2.00 | |
| EvoPrompt | Claude Code | 74.07+0.14 | 58.54+1.22 | 63.330.00 | 61.90-2.98 | 59.67+3.00 | 69.00+0.33 | 70.00+2.50 | 83.33+6.66 | 66.25+1.25 | 44.190.00 | 44.00-18.00 |
| Mini-Agent | 76.71+0.28 | 59.76+1.22 | 76.67+10.00 | 64.29-1.19 | 58.67-0.66 | 74.00-0.33 | 67.50+1.67 | 86.67+6.67 | 63.75-6.25 | 34.88+6.97 | 40.00-12.00 | |
| GEPA | Claude Code | 82.43+8.50 | 62.20+4.88 | 66.67+3.34 | 67.86+2.98 | 65.33+8.66 | 83.67+15.00 | 78.33+10.83 | 76.670.00 | 70.00+5.00 | 41.86-2.33 | 38.00-24.00 |
| Mini-Agent | 84.64+8.21 | 59.76+1.22 | 70.00+3.33 | 75.00+9.52 | 61.67+2.34 | 86.33+12.00 | 75.83+10.00 | 70.00-10.00 | 62.50-7.50 | 51.16+23.25 | 34.00-18.00 | |
| ADAS | Claude Code | 81.36+7.43 | 60.98+3.66 | 73.33+10.00 | 89.88+25.00 | 63.67+7.00 | 83.33+14.66 | 77.50+10.00 | 73.33-3.34 | 70.00+5.00 | 51.16+6.97 | 42.00-20.00 |
| Mini-Agent | 84.86+8.43 | 60.98+2.44 | 66.670.00 | 79.76+14.28 | 62.33+3.00 | 84.33+10.00 | 74.17+8.34 | 73.33-6.67 | 70.000.00 | 32.56+4.65 | 34.00-18.00 | |
| DarwinX | Claude Code | 80.50+6.57 | 60.98+3.66 | 63.330.00 | 70.83+5.95 | 65.67+9.00 | 82.00+13.33 | 77.50+10.00 | 66.67-10.00 | 72.50+7.50 | 48.84+4.65 | 36.00-26.00 |
| Mini-Agent | 79.29+2.86 | 60.98+2.44 | 66.670.00 | 69.05+3.57 | 64.67+5.34 | 83.00+8.67 | 75.83+10.00 | 83.33+3.33 | 67.50-2.50 | 41.86+13.95 | 34.00-18.00 | |
| MetaHarness | Claude Code | 85.07+11.14 | 62.20+4.88 | 70.00+6.67 | 90.48+25.60 | 64.00+7.33 | 86.33+17.66 | 80.00+12.50 | 80.00+3.33 | 66.25+1.25 | 53.49+9.30 | 28.00-34.00 |
| Mini-Agent | 79.14+2.71 | 59.76+1.22 | 73.33+6.66 | 88.10+22.62 | 65.67+6.34 | 81.00+6.67 | 72.50+6.67 | 76.67-3.33 | 73.75+3.75 | 41.86+13.95 | 38.00-14.00 | |
| ModularRSI | Claude Code | 81.07+7.14 | 59.76+2.44 | 60.00-3.33 | 56.55-8.33 | 63.00+6.33 | 84.00+15.33 | 72.50+5.00 | 80.00+3.33 | 65.000.00 | 44.190.00 | 46.00-16.00 |
| Mini-Agent | 78.64+2.21 | 59.76+1.22 | 70.00+3.33 | 69.05+3.57 | 67.00+7.67 | 81.00+6.67 | 65.830.00 | 73.33-6.67 | 75.00+5.00 | 53.49+25.58 | 40.00-12.00 | |
| RRSI | Claude Code | 82.79+8.86 | 60.98+3.66 | 76.67+13.34 | 92.86+27.98 | 64.00+7.33 | 83.67+15.00 | 79.17+11.67 | 80.00+3.33 | 72.50+7.50 | 53.49+9.30 | 52.00-10.00 |
| Mini-Agent | 81.64+5.21 | 59.76+1.22 | 76.67+10.00 | 84.52+19.04 | 68.67+9.34 | 83.00+8.67 | 76.67+10.84 | 76.67-3.33 | 66.25-3.75 | 53.49+25.58 | 36.00-16.00 | |
| Evo-Harness | Claude Code | 75.36+1.43 | 60.98+3.66 | 66.67+3.34 | 81.55+16.67 | 58.67+2.00 | 71.33+2.66 | 77.50+10.00 | 80.00+3.33 | 65.000.00 | 34.88-9.31 | 60.00-2.00 |
| Mini-Agent | 80.64+4.21 | 59.76+1.22 | 66.670.00 | 77.38+11.90 | 65.33+6.00 | 80.00+5.67 | 75.00+9.17 | 76.67-3.33 | 72.50+2.50 | 48.84+20.93 | 58.00+6.00 | |
Reading: each method has two rows, one for Claude Code and one for Mini-Agent. Source columns are in-domain; Near-domain and Far-OOD columns show frozen transfer routes. Bold marks the highest final score per benchmark and harness, including ties.