Latest status
partial
A continuous record of the open collection of American legal scholarship
Scraper implementation
Journal of Law and Policy · mapped to registry #330
Registry metadata for this implementation
Law review ownership and publication state
Runs associated with law review #330; diagnostics expand in place.
| Run | Status | Started | Runtime | Result | Error / diagnostics | Logs |
|---|---|---|---|---|---|---|
| #46234 | partial | 2026-09-20T23:12:51+00:00ended 2026-09-20T23:14:37+00:00 | 105.5s | 0 PDF 41 skipped 3 errors |
digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata{"automation_cycle_id": 265127, "canonical_name": "Journal of Law and Policy", "child_pid": 430663, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 25, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 21, "visited_units": 43}, "discovery_problem": "BROKEN_NETWORK: Digital Commons request failed (NoneType; OSError: curl transport exit 28): https://brooklynworks.brooklaw.edu/jlp/vol19/iss1/", "download_queue": {"due": 233, "pending": 236, "retries": 3, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 3}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-20T23:14:21+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T23:12:51+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789945971_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789945971_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45963 | partial | 2026-09-13T23:11:18+00:00ended 2026-09-13T23:11:42+00:00 | 21.7s | 0 PDF 188 skipped 3 errors |
digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata{"automation_cycle_id": 251676, "canonical_name": "Journal of Law and Policy", "child_pid": 2193236, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 41, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 25, "visited_units": 27}, "download_queue": {"due": 39, "pending": 42, "retries": 3, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 3}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-13T23:11:20+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T23:11:18+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789341078_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789341078_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45712 | partial | 2026-09-13T13:58:38+00:00ended 2026-09-13T14:00:51+00:00 | 133.0s | 0 PDF 57 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata{"automation_cycle_id": 250902, "canonical_name": "Journal of Law and Policy", "child_pid": 1306897, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 61, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 7, "visited_units": 7}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 0}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-13T14:00:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T13:58:38+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789307918_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789307918_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #44857 | protected | 2026-08-14T09:09:36+00:00ended 2026-08-14T09:17:36+00:00 | 479.7s | 0 PDF 54 skipped 6 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/context/jlp/article/1687/viewcontent/
Run metadata{"automation_cycle_id": 155361, "canonical_name": "Journal of Law and Policy", "child_pid": 3473274, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-08-14T09:17:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T09:09:36+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1786698576_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786698576_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #44153 | success | 2026-07-14T23:18:07+00:00ended 2026-07-14T23:18:09+00:00 | 1.9s | 1 PDF 0 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 44679, "canonical_name": "Journal of Law and Policy", "child_pid": 3459159, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T23:18:07+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T23:18:07+00:00", "run_kind": "manual", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784071087_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784071087_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 30} |
stdout stderr |
| #44142 | protected | 2026-07-14T23:09:29+00:00ended 2026-07-14T23:12:46+00:00 | 197.2s | 0 PDF 0 skipped 3 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/context/jlp/article/1686/viewcontent/
Run metadata{"automation_cycle_id": 44656, "canonical_name": "Journal of Law and Policy", "child_pid": 3442364, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T23:12:29+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T23:09:29+00:00", "run_kind": "manual", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784070569_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784070569_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 5, "waf_blocked": true} |
stdout stderr |
| #43890 | protected | 2026-07-14T18:54:48+00:00ended 2026-07-14T18:56:41+00:00 | 113.0s | 0 PDF 214 skipped 1 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1686&context=jlp&download=1
Run metadata{"automation_cycle_id": 43988, "canonical_name": "Journal of Law and Policy", "child_pid": 3033279, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T18:56:18+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:54:48+00:00", "run_kind": "scheduled", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784055288_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784055288_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 15, "waf_blocked": true} |
stdout stderr |
| #41082 | partial | 2026-07-13T03:03:13+00:00ended 2026-07-13T03:05:19+00:00 | 125.0s | 8 PDF 206 skipped 1 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1686&context=jlp&download=1
Run metadata{"automation_cycle_id": 37919, "canonical_name": "Journal of Law and Policy", "child_pid": 3457097, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-13T03:05:13+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-13T03:03:13+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783911793_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783911793_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #31580 | timeout | 2026-07-04T08:50:38+00:00ended 2026-07-04T09:35:38+00:00 | 2700.0s | 0 PDF 0 skipped 0 errors |
timeout: Timeout after 45 minutes
Run metadata{"automation_cycle_id": 28177, "canonical_name": "Journal of Law and Policy", "child_pid": 3667495, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T09:35:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "metrics_source": "inferred_unique_files", "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T08:50:38+00:00", "returncode": null, "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783155038_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783155038_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #31568 | timeout | 2026-07-04T06:26:25+00:00ended 2026-07-04T08:50:35+00:00 | -s | 0 PDF 0 skipped 0 errors |
orchestrator_reaper: Marked stale running run as timeout (age=6275s; started=2026-07-04T06:26:25+00:00; heartbeat=2026-07-04T07:06:00+00:00)
Run metadata{"automation_cycle_id": 28173, "canonical_name": "Journal of Law and Policy", "child_pid": 3541284, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T07:06:00+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T06:26:25+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783146385_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783146385_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #31551 | timeout | 2026-07-04T03:45:31+00:00ended 2026-07-04T05:27:09+00:00 | -s | 0 PDF 0 skipped 0 errors |
orchestrator_reaper: Marked stale running run as timeout (age=3411s; started=2026-07-04T03:45:31+00:00; heartbeat=2026-07-04T04:30:18+00:00)
Run metadata{"automation_cycle_id": 28168, "canonical_name": "Journal of Law and Policy", "child_pid": 3416574, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T04:30:18+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T03:45:31+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783136731_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783136731_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #31533 | timeout | 2026-07-04T00:28:20+00:00ended 2026-07-04T02:06:10+00:00 | -s | 0 PDF 0 skipped 0 errors |
orchestrator_reaper: Marked stale running run as timeout (age=3170s; started=2026-07-04T00:28:20+00:00; heartbeat=2026-07-04T01:13:20+00:00)
Run metadata{"automation_cycle_id": 28161, "canonical_name": "Journal of Law and Policy", "child_pid": 3238557, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T01:13:20+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T00:28:20+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783124900_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783124900_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #31090 | timeout | 2026-07-02T13:33:40+00:00ended 2026-07-02T14:18:40+00:00 | 2700.0s | 0 PDF 0 skipped 0 errors |
timeout: Timeout after 45 minutes
Run metadata{"automation_cycle_id": 28083, "canonical_name": "Journal of Law and Policy", "child_pid": 542311, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-02T14:18:40+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "metrics_source": "inferred_unique_files", "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T13:33:40+00:00", "returncode": null, "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1782999220_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1782999220_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #4479 | no new content | 2026-06-01T17:30:13+00:00ended 2026-06-01T17:31:00+00:00 | 47.2s | 0 PDF 218 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 1532, "canonical_name": "Journal of Law and Policy", "child_pid": 86300, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-06-01T17:30:43+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T17:30:13+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780335013_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780335013_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3800 | no new content | 2026-05-01T21:01:06+00:00ended 2026-05-01T21:02:03+00:00 | 56.7s | 0 PDF 218 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 620, "canonical_name": "Journal of Law and Policy", "child_pid": 1040601, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-05-01T21:01:36+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T21:01:06+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777669266_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777669266_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #2977 | partial | 2026-03-09T03:20:06+00:00ended 2026-03-09T03:27:29+00:00 | 442.5s | 10 PDF 206 skipped 2 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1559&context=jlp&download=1
Run metadata{"canonical_name": "Journal of Law and Policy", "child_pid": 3216855, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-03-09T03:27:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T03:20:06+00:00", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773026406_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773026406_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #1147 | no new content | 2026-02-07T00:42:16+00:00ended 2026-02-07T00:42:22+00:00 | 5.9s | 0 PDF 20 skipped 0 errors |
No reported error
Run metadata{"canonical_name": "Journal of Law and Policy", "child_pid": 523359, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-02-07T00:42:16+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-07T00:42:16+00:00", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770424936_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770424936_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 30} |
stdout stderr |