Meta-Eval/EvalHarness
3
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

LocalSandbox.exec: accept entrypoint kwarg (signature parity)

Browse Source 
The entrypoint override added only DockerSandbox the parameter; the
execution scorer now always passes it, so every local-sandbox bench
(live_code_bench) died with 'got an unexpected keyword argument' and
scored 0. Accepted (and ignored) in local/base for parity.

Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
sora 2026-09-17 07:24:48 +00:00
parent 3cc0158236
commit 6da45e0218
2 changed files with 4 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
evalharness/sandbox/base.py
View File

@ -65,6 +65,8 @@ class Sandbox:
mounts: Optional[Dict[str, str]] = None, mounts: Optional[Dict[str, str]] = None,
timeout_s: int = 60, timeout_s: int = 60,
image: str = '', image: str = '',
entrypoint: str = '', # docker-only override; accepted for
# signature parity (local runs a plain python)
) -> ExecResult: ) -> ExecResult:
"""Run ``python <entry>`` with ``files`` (name->content) in isolation. """Run ``python <entry>`` with ``files`` (name->content) in isolation.

2
evalharness/sandbox/local.py
View File

@ -25,6 +25,8 @@ class LocalSandbox(Sandbox):
mounts: Optional[Dict[str, str]] = None, mounts: Optional[Dict[str, str]] = None,
timeout_s: int = 60, timeout_s: int = 60,
image: str = '', image: str = '',
entrypoint: str = '', # docker-only override; accepted for
# signature parity (local runs a plain python)
) -> ExecResult: ) -> ExecResult:
with tempfile.TemporaryDirectory(prefix='eh-local-') as td: with tempfile.TemporaryDirectory(prefix='eh-local-') as td:
work = Path(td) work = Path(td)