Latest status
partial
A continuous record of the open collection of American legal scholarship
Scraper implementation
The Sustainable Development Law and Policy Brief · mapped to registry #800
Registry metadata for this implementation
Law review ownership and publication state
Runs associated with law review #800; diagnostics expand in place.
| Run | Status | Started | Runtime | Result | Error / diagnostics | Logs |
|---|---|---|---|---|---|---|
| #46179 | partial | 2026-09-20T22:16:36+00:00ended 2026-09-20T22:17:32+00:00 | 56.2s | 0 PDF 30 skipped 3 errors |
digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata{"automation_cycle_id": 265047, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 341313, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 59, "mode": "balanced", "remaining_units": 13, "scope": "https://digitalcommons.wcl.american.edu/sdlp/", "selected_units": 25, "visited_this_run": 24, "visited_units": 46}, "download_queue": {"due": 341, "pending": 344, "retries": 6, "scope": "SustainableDevelopmentLawAndPolicyBriefScraper:The Sustainable Development Law and Policy Brief", "waiting": 3}, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-09-20T22:17:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T22:16:36+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1789942596_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789942596_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45887 | partial | 2026-09-13T21:50:09+00:00ended 2026-09-13T22:04:52+00:00 | 883.3s | 0 PDF 186 skipped 6 errors |
digital_commons_waf_partial: HTTP 403 for https://digitalcommons.wcl.american.edu/context/sdlp/article/1530/viewcontent/ (fallback UA)
Run metadata{"automation_cycle_id": 251527, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 2061527, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 59, "mode": "balanced", "remaining_units": 32, "scope": "https://digitalcommons.wcl.american.edu/sdlp/", "selected_units": 25, "visited_this_run": 25, "visited_units": 27}, "download_queue": {"due": 17, "pending": 23, "retries": 6, "scope": "SustainableDevelopmentLawAndPolicyBriefScraper:The Sustainable Development Law and Policy Brief", "waiting": 6}, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-09-13T22:04:39+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T21:50:09+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1789336209_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789336209_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45579 | partial | 2026-09-13T10:15:15+00:00ended 2026-09-13T10:17:21+00:00 | 126.2s | 0 PDF 44 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata{"automation_cycle_id": 250585, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 960625, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 59, "mode": "balanced", "remaining_units": 52, "scope": "https://digitalcommons.wcl.american.edu/sdlp/", "selected_units": 25, "visited_this_run": 7, "visited_units": 7}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "SustainableDevelopmentLawAndPolicyBriefScraper:The Sustainable Development Law and Policy Brief", "waiting": 0}, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-09-13T10:17:15+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T10:15:15+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1789294515_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789294515_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #44736 | protected | 2026-08-14T05:35:04+00:00ended 2026-08-14T05:39:00+00:00 | 235.8s | 0 PDF 4 skipped 3 errors |
digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://digitalcommons.wcl.american.edu/context/sdlp/article/1725/viewcontent/
Run metadata{"automation_cycle_id": 154778, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 3120523, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-08-14T05:38:34+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T05:35:04+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1786685704_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786685704_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #44002 | no new content | 2026-07-14T19:09:44+00:00ended 2026-07-14T19:09:48+00:00 | 4.1s | 0 PDF 200 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 43988, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 3071341, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-07-14T19:09:44+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T19:09:44+00:00", "run_kind": "scheduled", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1784056184_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784056184_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 15} |
stdout stderr |
| #31128 | no new content | 2026-07-02T16:54:26+00:00ended 2026-07-02T16:55:25+00:00 | 58.6s | 0 PDF 200 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 28089, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 807963, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-07-02T16:55:26+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T16:54:26+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1783011266_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783011266_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #4519 | no new content | 2026-06-01T17:51:04+00:00ended 2026-06-01T17:51:09+00:00 | 4.2s | 0 PDF 200 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 1536, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 93991, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-06-01T17:51:04+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T17:51:04+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1780336264_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780336264_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3842 | success | 2026-05-01T21:18:58+00:00ended 2026-05-01T21:19:21+00:00 | 23.2s | 8 PDF 192 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 624, "canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 1054059, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-05-01T21:18:58+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T21:18:58+00:00", "run_kind": "scheduled_active", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1777670338_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777670338_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3018 | partial | 2026-03-09T05:02:13+00:00ended 2026-03-09T05:20:21+00:00 | 1087.3s | 187 PDF 5 skipped 8 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://digitalcommons.wcl.american.edu/cgi/viewcontent.cgi?article=1720&context=sdlp&download=1
Run metadata{"canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 3317153, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-03-09T05:20:14+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T05:02:13+00:00", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1773032533_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773032533_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #1200 | success | 2026-02-07T02:11:38+00:00ended 2026-02-07T02:11:40+00:00 | 2.5s | 1 PDF 4 skipped 0 errors |
No reported error
Run metadata{"canonical_name": "The Sustainable Development Law and Policy Brief", "child_pid": 685482, "file_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "heartbeat_at": "2026-02-07T02:11:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 800, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-07T02:11:38+00:00", "scraper_id": "sustainable_development_law_and_policy_brief_scraper", "script_path": "scrapers/sustainable_development_law_and_policy_brief_scraper.py", "stderr_path": "logs/orchestrator_runs/1770430298_sustainable_development_law_and_policy_brief_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770430298_sustainable_development_law_and_policy_brief_scraper.out.log", "timeout_minutes": 12} |
stdout stderr |