Skip to content
This repository has been archived by the owner on Jun 9, 2024. It is now read-only.

Conversation

lc0rp
Copy link
Contributor

@lc0rp lc0rp commented Aug 6, 2023

Background

  • When creating, debugging or fixing tests or agents' performance on tests, it'd be helpful to have an option between the configured data.cutoff, and --nc.
  • Similarly, it's sometimes useful to prevent workspace destruction, when debugging failing tests.

Changes

  • Added --cutoff (seconds) so you can override the cutoff time from commandline
  • Added a "keep_workspace_files" config option to prevent workspace teardown after tests

PR Quality Checklist

  • I have run the following commands against my code to ensure it passes our linters:
    black . --exclude test.py
    isort .
    mypy .
    autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring --in-place agbenchmark

==> Mypy had a few notes, unrelated to this code. I'm happy to help look at them later.

lc0rp added 3 commits August 6, 2023 16:10
Added a config option "keep_workspace_files" to prevent workspace teardown.
Both of these are useful when fixing & debugging tests.
…-GPT-Benchmarks into add_configurable_timeout_and_keep_workspace_files_option
@waynehamadi waynehamadi merged commit 9326ef7 into Significant-Gravitas:master Aug 7, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants