Latest status
partial
Scraper implementation
cornell_law_public_policy_scraper
Cornell Journal of Law and Public Policy · mapped to registry #159
Implementation identity
scrapers/cornell_law_public_policy_scraper.py
partial
Latest runtime
89.3s
Latest PDFs
0
Uploads pending
0
Run history
11
Definition
Registry metadata for this implementation
scraper id
cornell_law_public_policy_scraper
canonical name
Cornell Journal of Law and Public Policy
institution code
-
platform
bepress
base class
script
class name
-
module path
scrapers.cornell_law_public_policy_scraper
file path
scrapers/cornell_law_public_policy_scraper.py
has cli entrypoint
true
is abstract
false
updated at
2026-09-22 23:32:37
Operational mapping
Law review ownership and publication state
Law review
Registry health
DEGRADED
Last uploaded
2026-05-01 22:49:58
Registry sync
uabox:Law_Review_Project/cornell_journal_of_law_and_public_policy_20260501_224944.zip
Latest error
ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run history
Runs associated with law review #159; diagnostics expand in place.
| Run | Status | Started | Runtime | Result | Error / diagnostics | Logs |
|---|---|---|---|---|---|---|
| #46107 | partial | 2026-09-20T20:52:53+00:00ended 2026-09-20T20:54:22+00:00 | 89.3s | 0 PDF 100 skipped 3 errors |
digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata{"automation_cycle_id": 264924, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 201827, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 80, "mode": "balanced", "remaining_units": 45, "scope": "https://scholarship.law.cornell.edu/cjlpp/", "selected_units": 25, "visited_this_run": 25, "visited_units": 35}, "download_queue": {"due": 72, "pending": 75, "retries": 3, "scope": "CornellJournalOfLawAndPublicPolicyScraper:Cornell Journal of Law and Public Policy", "waiting": 3}, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-09-20T20:53:53+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T20:52:53+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789937573_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789937573_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45786 | partial | 2026-09-13T16:57:38+00:00ended 2026-09-13T16:59:43+00:00 | 125.2s | 0 PDF 44 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata{"automation_cycle_id": 251166, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 1590813, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 80, "mode": "balanced", "remaining_units": 65, "scope": "https://scholarship.law.cornell.edu/cjlpp/", "selected_units": 25, "visited_this_run": 6, "visited_units": 15}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "CornellJournalOfLawAndPublicPolicyScraper:Cornell Journal of Law and Public Policy", "waiting": 0}, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-09-13T16:59:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T16:57:38+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789318658_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789318658_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #45398 | partial | 2026-09-13T05:55:17+00:00ended 2026-09-13T05:57:20+00:00 | 122.7s | 0 PDF 102 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata{"automation_cycle_id": 250202, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 541616, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 80, "mode": "balanced", "remaining_units": 66, "scope": "https://scholarship.law.cornell.edu/cjlpp/", "selected_units": 25, "visited_this_run": 14, "visited_units": 14}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "CornellJournalOfLawAndPublicPolicyScraper:Cornell Journal of Law and Public Policy", "waiting": 0}, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-09-13T05:57:17+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T05:55:17+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789278917_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789278917_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #44564 | protected | 2026-08-14T01:07:11+00:00ended 2026-08-14T01:11:27+00:00 | 255.7s | 0 PDF 26 skipped 3 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/context/cjlpp/article/1504/viewcontent/
Run metadata{"automation_cycle_id": 154030, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 2683234, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-08-14T01:11:11+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T01:07:11+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1786669631_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786669631_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #43798 | no new content | 2026-07-14T18:42:41+00:00ended 2026-07-14T18:42:45+00:00 | 3.5s | 0 PDF 170 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 43988, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 2990528, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-07-14T18:42:41+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:42:41+00:00", "run_kind": "scheduled", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784054561_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784054561_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 15} |
stdout stderr |
| #31037 | no new content | 2026-07-02T05:36:43+00:00ended 2026-07-02T05:36:46+00:00 | 3.0s | 0 PDF 170 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 28069, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 4032435, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-07-02T05:36:43+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T05:36:43+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1782970603_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1782970603_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #4428 | no new content | 2026-06-01T16:55:07+00:00ended 2026-06-01T16:55:10+00:00 | 2.8s | 0 PDF 170 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 1526, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 69107, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-06-01T16:55:07+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T16:55:07+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3754 | success | 2026-05-01T20:30:26+00:00ended 2026-05-01T20:30:43+00:00 | 16.6s | 6 PDF 164 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 615, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 1016746, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-05-01T20:30:26+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T20:30:26+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #2931 | partial | 2026-03-09T02:01:50+00:00ended 2026-03-09T02:14:12+00:00 | 741.2s | 154 PDF 10 skipped 6 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1531&context=cjlpp&download=1
Run metadata{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 3168126, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-03-09T02:13:50+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T02:01:50+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #1080 | success | 2026-02-06T23:33:47+00:00ended 2026-02-06T23:33:59+00:00 | 12.5s | 10 PDF 0 skipped 0 errors |
No reported error
Run metadata{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 403014, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T23:33:47+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T23:33:47+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 30} |
stdout stderr |
| #1046 | failed | 2026-02-06T22:30:41+00:00ended 2026-02-06T22:30:50+00:00 | 9.2s | 0 PDF 0 skipped 3 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1533&context=cjlpp
Run metadata{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 293286, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T22:30:41+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T22:30:41+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 12, "waf_blocked": true} |
stdout stderr |