test(ai): bench executes run_shell via PTY stub — 3/3 (was 2/3)

The headless bench stubbed _send_sbx_input to a no-op, so run_shell
commands were staged to /tmp/.hh_*.cmd but the typed wrapper never ran —
the rc/out poll timed out and any shell-dependent task FAILed (mkdir+list
burned ~248s then failed). Make the stub run typed input in the bench
process (CWD == workdir), faithfully standing in for the room PTY, so
_run_shell_in_pty (staging/poll/cleanup) is exercised end-to-end.

Result: 3/3 pass. Surfaced a separate model-side argument leak in
script+run (tool JSON-schema dict passed as the command) — fixed next.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
leetcrypt
2026-06-27 15:26:51 -07:00
parent b55743bada
commit 77f6203475
+10 -2
View File
@@ -98,8 +98,16 @@ def make_bridge(provider, workdir: str):
b._inject = cap_inject
async def cap_sbx_input(ws, data): # PTY-mirror frames — broker-only in prod
b._chat.append("[pty] " + data.decode(errors="replace").rstrip("\n"))
async def cap_sbx_input(ws, data): # stand in for the shared PTY
# In prod the broker writes these keystrokes to the room's PTY shell; here
# there's no PTY, so run them in the bench process (CWD == workdir) to
# exercise run_shell end-to-end. Mirror lines are `# `-prefixed comments,
# so the shell no-ops them; the only real command is the staged wrapper.
line = data.decode(errors="replace")
b._chat.append("[pty] " + line.rstrip("\n"))
proc = await asyncio.create_subprocess_shell(
line, stdout=asyncio.subprocess.DEVNULL, stderr=asyncio.subprocess.DEVNULL)
await proc.wait()
b._send_sbx_input = cap_sbx_input
return b