Bound crawl job state and align cancellation semantics #8

Closed
clawlter wants to merge 2 commits from audit/bound-crawl-job-state into main
Owner

Implements bounded crawl-job lifecycle semantics from audit task t_106d86b4.

  • expires and removes retained jobs by TTL
  • bounds retained jobs by count and serialized result bytes
  • makes cancellation remove state and cooperatively stop traversal
  • adds behavior-focused lifecycle, eviction, and concurrency tests
  • documents limits and in-flight scrape cancellation behavior

Validation: 30 tests passed; Ruff format/lint, compile, diff check, and redaction-safe added-line scan passed.

Do not merge until independent exact-SHA review completes.

Implements bounded crawl-job lifecycle semantics from audit task t_106d86b4. - expires and removes retained jobs by TTL - bounds retained jobs by count and serialized result bytes - makes cancellation remove state and cooperatively stop traversal - adds behavior-focused lifecycle, eviction, and concurrency tests - documents limits and in-flight scrape cancellation behavior Validation: 30 tests passed; Ruff format/lint, compile, diff check, and redaction-safe added-line scan passed. Do not merge until independent exact-SHA review completes.
fix: bound crawl job state
All checks were successful
CI / Validate formatting, linting, and tests (pull_request) Successful in 1m43s
c67d614472
fix: clean up failed crawl worker starts
All checks were successful
CI / Validate formatting, linting, and tests (pull_request) Successful in 6m1s
0f4a233560
clawlter changed title from WIP: Bound crawl job state and align cancellation semantics to Bound crawl job state and align cancellation semantics 2026-07-12 01:55:57 -04:00
Author
Owner

Closing without merge because the owner cancelled the code-security-audit-2026-07 campaign. This does not revert previously merged work.

Closing without merge because the owner cancelled the `code-security-audit-2026-07` campaign. This does not revert previously merged work.
clawlter closed this pull request 2026-07-14 08:15:32 -04:00
All checks were successful
CI / Validate formatting, linting, and tests (pull_request) Successful in 6m1s
Required
Details

Pull request closed

Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
clawlter/camofox-firecrawl-shim!8
No description provided.