Est. MMXXV · lrscraper The Law Review Reporter Live

A continuous record of the open collection of American legal scholarship

Vol. II Thursday, September 24, 2026 № 267

Scraper implementation

journal_of_law_and_policy_scraper

Journal of Law and Policy · mapped to registry #330

Implementation identity
scrapers/journal_of_law_and_policy_scraper.py
scriptbepressCLI entrypoint
partial
Latest status
partial
Run #46234
Latest runtime
105.5s
2026-09-20T23:12:51+00:00
Latest PDFs
0
41 duplicates skipped
Uploads pending
0
Queue clear or unavailable
Run history
17
Returned by current limit

Definition

Registry metadata for this implementation

scraper id
journal_of_law_and_policy_scraper
canonical name
Journal of Law and Policy
institution code
-
platform
bepress
base class
script
class name
-
module path
scrapers.journal_of_law_and_policy_scraper
file path
scrapers/journal_of_law_and_policy_scraper.py
has cli entrypoint
true
is abstract
false
updated at
2026-09-23 23:32:46

Operational mapping

Law review ownership and publication state

Registry health
DEGRADED
Last uploaded
2026-07-14 23:55:30
Registry sync
uabox:Law_Review_Project/journal_of_law_and_policy_20260714_235505.zip
Latest error
ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry

Run history

Runs associated with law review #330; diagnostics expand in place.

17 returned · show 200
Run Status Started Runtime Result Error / diagnostics Logs
#46234 partial 2026-09-20T23:12:51+00:00ended 2026-09-20T23:14:37+00:00 105.5s 0 PDF 41 skipped 3 errors digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata
{"automation_cycle_id": 265127, "canonical_name": "Journal of Law and Policy", "child_pid": 430663, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 25, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 21, "visited_units": 43}, "discovery_problem": "BROKEN_NETWORK: Digital Commons request failed (NoneType; OSError: curl transport exit 28): https://brooklynworks.brooklaw.edu/jlp/vol19/iss1/", "download_queue": {"due": 233, "pending": 236, "retries": 3, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 3}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-20T23:14:21+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T23:12:51+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789945971_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789945971_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
#45963 partial 2026-09-13T23:11:18+00:00ended 2026-09-13T23:11:42+00:00 21.7s 0 PDF 188 skipped 3 errors digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata
{"automation_cycle_id": 251676, "canonical_name": "Journal of Law and Policy", "child_pid": 2193236, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 41, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 25, "visited_units": 27}, "download_queue": {"due": 39, "pending": 42, "retries": 3, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 3}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-13T23:11:20+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T23:11:18+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789341078_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789341078_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
#45712 partial 2026-09-13T13:58:38+00:00ended 2026-09-13T14:00:51+00:00 133.0s 0 PDF 57 skipped 0 errors partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata
{"automation_cycle_id": 250902, "canonical_name": "Journal of Law and Policy", "child_pid": 1306897, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 68, "mode": "balanced", "remaining_units": 61, "scope": "https://brooklynworks.brooklaw.edu/jlp/", "selected_units": 25, "visited_this_run": 7, "visited_units": 7}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "JournalOfLawAndPolicyScraper:Journal of Law and Policy", "waiting": 0}, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-09-13T14:00:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T13:58:38+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789307918_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789307918_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#44857 protected 2026-08-14T09:09:36+00:00ended 2026-08-14T09:17:36+00:00 479.7s 0 PDF 54 skipped 6 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/context/jlp/article/1687/viewcontent/
Run metadata
{"automation_cycle_id": 155361, "canonical_name": "Journal of Law and Policy", "child_pid": 3473274, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-08-14T09:17:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T09:09:36+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1786698576_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786698576_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
#44153 success 2026-07-14T23:18:07+00:00ended 2026-07-14T23:18:09+00:00 1.9s 1 PDF 0 skipped 0 errors No reported error
Run metadata
{"automation_cycle_id": 44679, "canonical_name": "Journal of Law and Policy", "child_pid": 3459159, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T23:18:07+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T23:18:07+00:00", "run_kind": "manual", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784071087_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784071087_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 30}
#44142 protected 2026-07-14T23:09:29+00:00ended 2026-07-14T23:12:46+00:00 197.2s 0 PDF 0 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/context/jlp/article/1686/viewcontent/
Run metadata
{"automation_cycle_id": 44656, "canonical_name": "Journal of Law and Policy", "child_pid": 3442364, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T23:12:29+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T23:09:29+00:00", "run_kind": "manual", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784070569_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784070569_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 5, "waf_blocked": true}
#43890 protected 2026-07-14T18:54:48+00:00ended 2026-07-14T18:56:41+00:00 113.0s 0 PDF 214 skipped 1 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1686&context=jlp&download=1
Run metadata
{"automation_cycle_id": 43988, "canonical_name": "Journal of Law and Policy", "child_pid": 3033279, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-14T18:56:18+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:54:48+00:00", "run_kind": "scheduled", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784055288_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784055288_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 15, "waf_blocked": true}
#41082 partial 2026-07-13T03:03:13+00:00ended 2026-07-13T03:05:19+00:00 125.0s 8 PDF 206 skipped 1 errors digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1686&context=jlp&download=1
Run metadata
{"automation_cycle_id": 37919, "canonical_name": "Journal of Law and Policy", "child_pid": 3457097, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-13T03:05:13+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-13T03:03:13+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783911793_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783911793_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
#31580 timeout 2026-07-04T08:50:38+00:00ended 2026-07-04T09:35:38+00:00 2700.0s 0 PDF 0 skipped 0 errors timeout: Timeout after 45 minutes
Run metadata
{"automation_cycle_id": 28177, "canonical_name": "Journal of Law and Policy", "child_pid": 3667495, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T09:35:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "metrics_source": "inferred_unique_files", "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T08:50:38+00:00", "returncode": null, "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783155038_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783155038_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#31568 timeout 2026-07-04T06:26:25+00:00ended 2026-07-04T08:50:35+00:00 -s 0 PDF 0 skipped 0 errors orchestrator_reaper: Marked stale running run as timeout (age=6275s; started=2026-07-04T06:26:25+00:00; heartbeat=2026-07-04T07:06:00+00:00)
Run metadata
{"automation_cycle_id": 28173, "canonical_name": "Journal of Law and Policy", "child_pid": 3541284, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T07:06:00+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T06:26:25+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783146385_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783146385_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#31551 timeout 2026-07-04T03:45:31+00:00ended 2026-07-04T05:27:09+00:00 -s 0 PDF 0 skipped 0 errors orchestrator_reaper: Marked stale running run as timeout (age=3411s; started=2026-07-04T03:45:31+00:00; heartbeat=2026-07-04T04:30:18+00:00)
Run metadata
{"automation_cycle_id": 28168, "canonical_name": "Journal of Law and Policy", "child_pid": 3416574, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T04:30:18+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T03:45:31+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783136731_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783136731_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#31533 timeout 2026-07-04T00:28:20+00:00ended 2026-07-04T02:06:10+00:00 -s 0 PDF 0 skipped 0 errors orchestrator_reaper: Marked stale running run as timeout (age=3170s; started=2026-07-04T00:28:20+00:00; heartbeat=2026-07-04T01:13:20+00:00)
Run metadata
{"automation_cycle_id": 28161, "canonical_name": "Journal of Law and Policy", "child_pid": 3238557, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-04T01:13:20+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-04T00:28:20+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783124900_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783124900_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#31090 timeout 2026-07-02T13:33:40+00:00ended 2026-07-02T14:18:40+00:00 2700.0s 0 PDF 0 skipped 0 errors timeout: Timeout after 45 minutes
Run metadata
{"automation_cycle_id": 28083, "canonical_name": "Journal of Law and Policy", "child_pid": 542311, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-07-02T14:18:40+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "metrics_source": "inferred_unique_files", "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T13:33:40+00:00", "returncode": null, "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1782999220_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1782999220_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#4479 no new content 2026-06-01T17:30:13+00:00ended 2026-06-01T17:31:00+00:00 47.2s 0 PDF 218 skipped 0 errors No reported error
Run metadata
{"automation_cycle_id": 1532, "canonical_name": "Journal of Law and Policy", "child_pid": 86300, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-06-01T17:30:43+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T17:30:13+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780335013_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780335013_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#3800 no new content 2026-05-01T21:01:06+00:00ended 2026-05-01T21:02:03+00:00 56.7s 0 PDF 218 skipped 0 errors No reported error
Run metadata
{"automation_cycle_id": 620, "canonical_name": "Journal of Law and Policy", "child_pid": 1040601, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-05-01T21:01:36+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T21:01:06+00:00", "run_kind": "scheduled_active", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777669266_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777669266_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45}
#2977 partial 2026-03-09T03:20:06+00:00ended 2026-03-09T03:27:29+00:00 442.5s 10 PDF 206 skipped 2 errors digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://brooklynworks.brooklaw.edu/cgi/viewcontent.cgi?article=1559&context=jlp&download=1
Run metadata
{"canonical_name": "Journal of Law and Policy", "child_pid": 3216855, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-03-09T03:27:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T03:20:06+00:00", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773026406_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773026406_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
#1147 no new content 2026-02-07T00:42:16+00:00ended 2026-02-07T00:42:22+00:00 5.9s 0 PDF 20 skipped 0 errors No reported error
Run metadata
{"canonical_name": "Journal of Law and Policy", "child_pid": 523359, "file_path": "scrapers/journal_of_law_and_policy_scraper.py", "heartbeat_at": "2026-02-07T00:42:16+00:00", "heartbeat_source": "orchestrator", "law_review_id": 330, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-07T00:42:16+00:00", "scraper_id": "journal_of_law_and_policy_scraper", "script_path": "scrapers/journal_of_law_and_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770424936_journal_of_law_and_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770424936_journal_of_law_and_policy_scraper.out.log", "timeout_minutes": 30}