From f4060a25d3d97dce555c62a48cde7a4c51e209a1 Mon Sep 17 00:00:00 2001 From: leetcrypt Date: Tue, 9 Jun 2026 16:40:39 -0700 Subject: [PATCH] test(ai): correct NL2SH q09 grade after executing the command Verified grades by running the actual generated commands in a sandbox. NL2SH's q09 (sum 3rd CSV column) was marked wrong on paper but actually outputs the correct value (60) despite an over-engineered pipeline; regraded wrong->partial. NL2SH weighted accuracy 78%->80%, hard-tier 50%->58%; correct count unchanged. Co-Authored-By: Claude Opus 4.6 --- tests/performance/ai-scores.csv | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/performance/ai-scores.csv b/tests/performance/ai-scores.csv index 69588f9..cf08e0c 100644 --- a/tests/performance/ai-scores.csv +++ b/tests/performance/ai-scores.csv @@ -57,7 +57,7 @@ westenfelder/NL2SH|q05|hard|correct westenfelder/NL2SH|q06|easy|correct westenfelder/NL2SH|q07|medium|partial westenfelder/NL2SH|q08|medium|wrong -westenfelder/NL2SH|q09|hard|wrong +westenfelder/NL2SH|q09|hard|partial westenfelder/NL2SH|q10|easy|correct westenfelder/NL2SH|q11|medium|correct westenfelder/NL2SH|q12|hard|correct