Latest status
partial
Scraper implementation
nyu_legislation_public_policy_scraper
New York University Journal of Legislation and Public Policy · mapped to registry #157
Implementation identity
scrapers/nyu_legislation_public_policy_scraper.py
partial
Latest runtime
345.5s
Latest PDFs
1
Uploads pending
0
Run history
10
Definition
Registry metadata for this implementation
scraper id
nyu_legislation_public_policy_scraper
canonical name
New York University Journal of Legislation and Public Policy
institution code
-
platform
wordpress
base class
script
class name
-
module path
scrapers.nyu_legislation_public_policy_scraper
file path
scrapers/nyu_legislation_public_policy_scraper.py
has cli entrypoint
true
is abstract
false
updated at
2026-09-22 23:32:37
Operational mapping
Law review ownership and publication state
Registry health
DEGRADED
Last uploaded
2026-09-20 22:34:15
Registry sync
uabox:Law_Review_Project/new_york_university_journal_of_legislation_and_public_policy_20260920_223401.zip
Latest error
HTTP 404 for https://nyujlpp.org/wp-content/uploads/2012/10/Brittain-Direct-Democracy-by-the-Majority-Can-Jeopardize-the-Civil-Rights-of-Minority-or-Other-Powerless-Groups.pdf
Run history
Runs associated with law review #157; diagnostics expand in place.
| Run | Status | Started | Runtime | Result | Error / diagnostics | Logs |
|---|---|---|---|---|---|---|
| #46165 | partial | 2026-09-20T22:04:54+00:00ended 2026-09-20T22:10:42+00:00 | 345.5s | 1 PDF 537 skipped 64 errors |
partial_download_errors: HTTP 404 for https://nyujlpp.org/wp-content/uploads/2012/10/Brittain-Direct-Democracy-by-the-Majority-Can-Jeopardize-the-Civil-Rights-of-Minority-or-Other-Powerless-Groups.pdf
Run metadata{"automation_cycle_id": 265038, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 321822, "discovery_coverage": {"discovery_complete": true, "known_units": 295, "pages": {"capped": true, "discovery_complete": true, "known_units": 291, "mode": "balanced", "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#pages", "selected_units": 250, "visited_this_run": 250, "visited_units": 291}, "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml", "sitemaps": {"capped": false, "discovery_complete": true, "known_units": 4, "mode": "balanced", "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#maps", "selected_units": 4, "visited_this_run": 4, "visited_units": 4}, "visited_units": 295, "waiting_for_retry": 0, "wordpress_api": null}, "download_queue": {"due": 0, "pending": 64, "retries": 64, "scope": "NyuLegislationPublicPolicyScraper:New York University Journal of Legislation and Public Policy", "waiting": 64}, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-09-20T22:10:27+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "missing_accounting_version": 2, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T22:04:54+00:00", "permanently_missing_count": 64, "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789941894_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789941894_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #45874 | partial | 2026-09-13T20:53:59+00:00ended 2026-09-13T20:55:48+00:00 | 108.9s | 97 PDF 441 skipped 0 errors |
partial_download_errors: 64 discovered PDFs remain queued (64 waiting for retry)
Run metadata{"automation_cycle_id": 251482, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 1974451, "discovery_coverage": {"discovery_complete": true, "known_units": 295, "pages": {"capped": true, "discovery_complete": true, "known_units": 291, "mode": "balanced", "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#pages", "selected_units": 250, "visited_this_run": 250, "visited_units": 291}, "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml", "sitemaps": {"capped": false, "discovery_complete": true, "known_units": 4, "mode": "balanced", "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#maps", "selected_units": 4, "visited_this_run": 4, "visited_units": 4}, "visited_units": 295, "waiting_for_retry": 0, "wordpress_api": null}, "download_queue": {"due": 0, "pending": 64, "retries": 64, "scope": "NyuLegislationPublicPolicyScraper:New York University Journal of Legislation and Public Policy", "waiting": 64}, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-09-13T20:55:29+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T20:53:59+00:00", "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789332839_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789332839_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #45553 | partial | 2026-09-13T09:34:58+00:00ended 2026-09-13T09:50:02+00:00 | 904.3s | 0 PDF 458 skipped 64 errors |
partial_discovery: BROKEN_NETWORK: Unable to fetch https://nyujlpp.org/symposia/past-symposia/fall-2015-symposium-it-is-so-ordered/ (OSError: curl transport exit 28)
Run metadata{"automation_cycle_id": 250528, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 899814, "discovery_coverage": {"discovery_complete": false, "known_units": 295, "pages": {"capped": true, "discovery_complete": false, "known_units": 291, "mode": "balanced", "remaining_units": 45, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#pages", "selected_units": 250, "visited_this_run": 246, "visited_units": 246}, "remaining_units": 45, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml", "sitemaps": {"capped": false, "discovery_complete": true, "known_units": 4, "mode": "balanced", "remaining_units": 0, "scope": "NyuLegislationPublicPolicyScraper:https://nyujlpp.org/wp-sitemap.xml#maps", "selected_units": 4, "visited_this_run": 0, "visited_units": 4}, "visited_units": 250, "waiting_for_retry": 4, "wordpress_api": null}, "discovery_problem": "BROKEN_NETWORK: Unable to fetch https://nyujlpp.org/symposia/past-symposia/fall-2015-symposium-it-is-so-ordered/ (OSError: curl transport exit 28)", "download_queue": {"due": 0, "pending": 64, "retries": 64, "scope": "NyuLegislationPublicPolicyScraper:New York University Journal of Legislation and Public Policy", "waiting": 64}, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-09-13T09:49:58+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "missing_accounting_version": 2, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T09:34:58+00:00", "permanently_missing_count": 64, "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1789292098_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789292098_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #44712 | partial | 2026-08-14T04:50:53+00:00ended 2026-08-14T04:52:03+00:00 | 70.0s | 0 PDF 488 skipped 64 errors |
partial_download_errors: 64 source links returned HTTP 404/410
Run metadata{"automation_cycle_id": 154655, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 3044058, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-08-14T04:51:53+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T04:50:53+00:00", "permanently_missing_count": 64, "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1786683053_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786683053_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45, "missing_accounting_version": 2, "missing_accounting_reconciled": true} |
stdout stderr |
| #43958 | success | 2026-07-14T19:02:03+00:00ended 2026-07-14T19:07:33+00:00 | 330.5s | 196 PDF 356 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 43988, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 3055121, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-07-14T19:07:33+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T19:02:03+00:00", "permanently_missing_count": 64, "run_kind": "scheduled", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1784055723_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784055723_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 15} |
stdout stderr |
| #31182 | partial | 2026-07-02T21:00:21+00:00ended 2026-07-02T21:17:13+00:00 | 999.8s | 6 PDF 289 skipped 5 errors |
partial_download_errors: HTTP 404 for https://nyujlpp.org/wp-content/uploads/2016/06/Coleman-Dangerous-Tongues-Storytelling-in-Congressional-Testimony-and-an-Evidence-Based-Solution-19nyujlpp291.pdf
Run metadata{"automation_cycle_id": 28099, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 1124961, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-07-02T21:17:03+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T21:00:21+00:00", "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1783026021_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783026021_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #4571 | failed | 2026-06-01T18:35:09+00:00ended 2026-06-01T18:35:53+00:00 | 44.3s | 0 PDF 295 skipped 5 errors |
download_failed_all: HTTP 404 for https://nyujlpp.org/wp-content/uploads/2016/06/Coleman-Dangerous-Tongues-Storytelling-in-Congressional-Testimony-and-an-Evidence-Based-Solution-19nyujlpp291.pdf
Run metadata{"automation_cycle_id": 1542, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 116678, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-06-01T18:35:39+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T18:35:09+00:00", "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1780338909_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780338909_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3897 | failed | 2026-05-01T21:39:40+00:00ended 2026-05-01T21:40:26+00:00 | 45.8s | 0 PDF 295 skipped 5 errors |
download_failed_all: HTTP 404 for https://nyujlpp.org/wp-content/uploads/2016/06/Coleman-Dangerous-Tongues-Storytelling-in-Congressional-Testimony-and-an-Evidence-Based-Solution-19nyujlpp291.pdf
Run metadata{"automation_cycle_id": 630, "canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 1081540, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-05-01T21:40:10+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T21:39:40+00:00", "run_kind": "scheduled_active", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1777671580_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777671580_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3079 | partial | 2026-03-09T07:46:29+00:00ended 2026-03-09T07:51:58+00:00 | 328.5s | 233 PDF 62 skipped 5 errors |
partial_download_errors: HTTP 404 for https://nyujlpp.org/wp-content/uploads/2016/06/Coleman-Dangerous-Tongues-Storytelling-in-Congressional-Testimony-and-an-Evidence-Based-Solution-19nyujlpp291.pdf
Run metadata{"canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 3486275, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-03-09T07:51:29+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T07:46:29+00:00", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1773042389_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773042389_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #1292 | success | 2026-02-07T05:24:14+00:00ended 2026-02-07T05:24:42+00:00 | 28.1s | 5 PDF 0 skipped 0 errors |
No reported error
Run metadata{"canonical_name": "New York University Journal of Legislation and Public Policy", "child_pid": 1054232, "file_path": "scrapers/nyu_legislation_public_policy_scraper.py", "heartbeat_at": "2026-02-07T05:24:14+00:00", "heartbeat_source": "orchestrator", "law_review_id": 157, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-07T05:24:14+00:00", "scraper_id": "nyu_legislation_public_policy_scraper", "script_path": "scrapers/nyu_legislation_public_policy_scraper.py", "stderr_path": "logs/orchestrator_runs/1770441854_nyu_legislation_public_policy_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770441854_nyu_legislation_public_policy_scraper.out.log", "timeout_minutes": 30} |
stdout stderr |