cornell_law_public_policy_scraper

Cornell Journal of Law and Public Policy
Latest Status
no_new_content #4428
Latest Metrics
d=0  |  skip=170  |  err=0
t=2.8s
Implementation
script
bepress
Law Review
Uploads Pending
0
Last Upload
2026-05-01 22:49:58
uabox:Law_Review_Project/cornell_journal_of_law_and_public_policy_20260501_224944.zip

Definition

scraper_id
cornell_law_public_policy_scraper
canonical_name
Cornell Journal of Law and Public Policy
institution_code
-
platform
bepress
base_class
script
class_name
-
module_path
scrapers.cornell_law_public_policy_scraper
file_path
scrapers/cornell_law_public_policy_scraper.py
has_cli_entrypoint
true
is_abstract
false
discovered_at
2026-03-30 20:11:12
updated_at
2026-06-17 03:31:27

Run History

Showing 5 runs (law_review_id=159) — use ?limit=200 for more.
Run Status Start End Runtime Metrics Error / Details Logs
#4428 no_new_content 2026-06-01T16:55:07+00:00 2026-06-01T16:55:10+00:00 2.8s d=0  |  skip=170  |  err=0
discovered=170  |  processed=170
-
extra_json
{"automation_cycle_id": 1526, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 69107, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-06-01T16:55:07+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T16:55:07+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45}
stdout | stderr
#3754 success 2026-05-01T20:30:26+00:00 2026-05-01T20:30:43+00:00 16.6s d=6  |  skip=164  |  err=0
discovered=170  |  processed=170
-
extra_json
{"automation_cycle_id": 615, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 1016746, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-05-01T20:30:26+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T20:30:26+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45}
stdout | stderr
#2931 partial 2026-03-09T02:01:50+00:00 2026-03-09T02:14:12+00:00 741.2s d=154  |  skip=10  |  err=6
discovered=170  |  processed=170
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1531&context=cjlpp&download=1
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 3168126, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-03-09T02:13:50+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T02:01:50+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
stdout | stderr
#1080 success 2026-02-06T23:33:47+00:00 2026-02-06T23:33:59+00:00 12.5s d=10  |  skip=0  |  err=0
discovered=10  |  processed=10
-
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 403014, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T23:33:47+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T23:33:47+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 30}
stdout | stderr
#1046 failed 2026-02-06T22:30:41+00:00 2026-02-06T22:30:50+00:00 9.2s d=0  |  skip=0  |  err=3
discovered=25  |  processed=25
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1533&context=cjlpp
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 293286, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T22:30:41+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T22:30:41+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 12, "waf_blocked": true}
stdout | stderr

Runs (scraper_name = cornell_law_public_policy_scraper)

These are runs recorded explicitly under this scraper_id.
Run Status Start End Runtime Metrics Error / Details Logs
#4428 no_new_content 2026-06-01T16:55:07+00:00 2026-06-01T16:55:10+00:00 2.8s d=0  |  skip=170  |  err=0
discovered=170  |  processed=170
-
extra_json
{"automation_cycle_id": 1526, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 69107, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-06-01T16:55:07+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T16:55:07+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780332907_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45}
stdout | stderr
#3754 success 2026-05-01T20:30:26+00:00 2026-05-01T20:30:43+00:00 16.6s d=6  |  skip=164  |  err=0
discovered=170  |  processed=170
-
extra_json
{"automation_cycle_id": 615, "canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 1016746, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-05-01T20:30:26+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T20:30:26+00:00", "run_kind": "scheduled_active", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777667426_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45}
stdout | stderr
#2931 partial 2026-03-09T02:01:50+00:00 2026-03-09T02:14:12+00:00 741.2s d=154  |  skip=10  |  err=6
discovered=170  |  processed=170
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1531&context=cjlpp&download=1
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 3168126, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-03-09T02:13:50+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T02:01:50+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773021710_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
stdout | stderr
#1080 success 2026-02-06T23:33:47+00:00 2026-02-06T23:33:59+00:00 12.5s d=10  |  skip=0  |  err=0
discovered=10  |  processed=10
-
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 403014, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T23:33:47+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T23:33:47+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770420827_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 30}
stdout | stderr
#1046 failed 2026-02-06T22:30:41+00:00 2026-02-06T22:30:50+00:00 9.2s d=0  |  skip=0  |  err=3
discovered=25  |  processed=25
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.cornell.edu/cgi/viewcontent.cgi?article=1533&context=cjlpp
extra_json
{"canonical_name": "Cornell Journal of Law and Public Policy", "child_pid": 293286, "file_path": "scrapers/cornell_law_public_policy_scraper.py", "heartbeat_at": "2026-02-06T22:30:41+00:00", "heartbeat_source": "orchestrator", "law_review_id": 159, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T22:30:41+00:00", "scraper_id": "cornell_law_public_policy_scraper", "script_path": "scrapers/cornell_law_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770417041_cornell_law_public_policy_scraper.out.log", "timeout_minutes": 12, "waf_blocked": true}
stdout | stderr