27cf8b3c7e
- progress/: Rich per-sample terminal progress plugin (Run Plan panel,
in-flight/rate/ETA bar); shared console + log-through-live to avoid
interleaved writes, rollback() pairs begin_sample on the retry path,
begin moved inside the semaphore (in-flight = actually generating),
graceful degradation when rich is absent
- cli.py: --provider/--api-url/--model composition (openai-chat |
openai-pool), --disable-thinking/--perf/--textools as first-class
flags, per-bench phase lines and done/failed result lines
- __init__: top-level run()/arun() entries (event-loop safe for notebooks)
- third_party/bfcl: vendored official BFCL ast_checker + type mappings
(Apache-2.0, provenance in __init__.py); imports rerouted locally,
underscore_to_dot parameterized; verified bit-identical with the
bfcl-eval package on 100 real rows -- removes the heavy extra
(pinned numpy + cloud SDK wall) from the install path
- runner: progress/status hooks through generate+evaluate, checkpoint
key scheme fix (empty-store falsy bug), tiered retry backoff,
multi-segment pool {range} expansion fix, adapter-instance passthrough
- pyproject: tree_sitter family joins core deps; [bfcl] extra retired
- README: rewritten (zh) -- install/quickstart/flags reference/bench
table/reliability/extension/architecture/validation
Co-Authored-By: Claude <noreply@anthropic.com>
9 lines
387 B
Python
9 lines
387 B
Python
"""Vendored BFCL official AST checker (from bfcl-eval, Apache-2.0).
|
|
|
|
Source: bfcl_eval/eval_checker/ast_eval/{ast_checker.py,type_convertor/}
|
|
+ bfcl_eval/constants/type_mappings.py
|
|
Only change: imports rerouted locally and the MODEL_CONFIG_MAPPING lookup
|
|
replaced by an explicit ``underscore_to_dot`` argument. Upstream license
|
|
and notice apply to the files in this directory.
|
|
"""
|