Latest status
partial
Scraper implementation
duke_law_technology_review_scraper
Duke Law & Technology Review [online] · mapped to registry #119
Implementation identity
scrapers/duke_law_technology_review_scraper.py
partial
Latest runtime
104.0s
Latest PDFs
0
Uploads pending
0
Run history
10
Definition
Registry metadata for this implementation
scraper id
duke_law_technology_review_scraper
canonical name
Duke Law & Technology Review [online]
institution code
-
platform
bepress
base class
script
class name
-
module path
scrapers.duke_law_technology_review_scraper
file path
scrapers/duke_law_technology_review_scraper.py
has cli entrypoint
true
is abstract
false
updated at
2026-09-22 23:32:37
Operational mapping
Law review ownership and publication state
Law review
Registry health
DEGRADED
Last uploaded
2026-09-12 13:34:57
Registry sync
uabox:Law_Review_Project/duke_law_and_technology_review_[online]_20260912_132152.zip
Latest error
ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run history
Runs associated with law review #119; diagnostics expand in place.
| Run | Status | Started | Runtime | Result | Error / diagnostics | Logs |
|---|---|---|---|---|---|---|
| #46112 | partial | 2026-09-20T20:56:26+00:00ended 2026-09-20T20:58:11+00:00 | 104.0s | 0 PDF 216 skipped 3 errors |
digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata{"automation_cycle_id": 264932, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 208238, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 27, "mode": "balanced", "remaining_units": 2, "scope": "https://scholarship.law.duke.edu/dltr/", "selected_units": 25, "visited_this_run": 22, "visited_units": 25}, "discovery_problem": "BROKEN_NETWORK: Digital Commons request failed (NoneType; OSError: curl transport exit 28): https://scholarship.law.duke.edu/dltr/vol12/iss1/", "download_queue": {"due": 34, "pending": 37, "retries": 3, "scope": "DukeLawTechnologyReviewScraper:Duke Law & Technology Review [online]", "waiting": 3}, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-09-20T20:57:57+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T20:56:26+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1789937786_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789937786_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #45792 | partial | 2026-09-13T17:05:32+00:00ended 2026-09-13T17:07:44+00:00 | 131.8s | 0 PDF 34 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons request failed (NoneType; OSError: curl transport exit 28): https://scholarship.law.duke.edu/dltr/vol23/iss1/
Run metadata{"automation_cycle_id": 251166, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 1602700, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 27, "mode": "balanced", "remaining_units": 14, "scope": "https://scholarship.law.duke.edu/dltr/", "selected_units": 25, "visited_this_run": 5, "visited_units": 13}, "discovery_problem": "BROKEN_NETWORK: Digital Commons request failed (NoneType; OSError: curl transport exit 28): https://scholarship.law.duke.edu/dltr/vol23/iss1/", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "DukeLawTechnologyReviewScraper:Duke Law & Technology Review [online]", "waiting": 0}, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-09-13T17:07:32+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T17:05:32+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1789319132_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789319132_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #45415 | partial | 2026-09-13T06:19:10+00:00ended 2026-09-13T06:21:32+00:00 | 141.8s | 0 PDF 104 skipped 0 errors |
partial_discovery: BROKEN_NETWORK: Digital Commons archive discovery reached its time budget
Run metadata{"automation_cycle_id": 250251, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 582563, "discovery_coverage": {"capped": true, "discovery_complete": false, "known_units": 27, "mode": "balanced", "remaining_units": 15, "scope": "https://scholarship.law.duke.edu/dltr/", "selected_units": 25, "visited_this_run": 12, "visited_units": 12}, "discovery_problem": "BROKEN_NETWORK: Digital Commons archive discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "DukeLawTechnologyReviewScraper:Duke Law & Technology Review [online]", "waiting": 0}, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-09-13T06:21:10+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T06:19:10+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1789280350_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1789280350_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #44575 | partial | 2026-08-14T01:21:19+00:00ended 2026-08-14T01:29:15+00:00 | 476.1s | 1 PDF 53 skipped 5 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.duke.edu/context/dltr/article/1401/viewcontent/
Run metadata{"automation_cycle_id": 154069, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 2708121, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-08-14T01:28:49+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T01:21:19+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1786670479_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1786670479_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #43813 | no new content | 2026-07-14T18:43:30+00:00ended 2026-07-14T18:43:40+00:00 | 10.2s | 0 PDF 287 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 43988, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 2993665, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-07-14T18:43:30+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:43:30+00:00", "run_kind": "scheduled", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1784054610_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1784054610_duke_law_technology_review_scraper.out.log", "timeout_minutes": 15} |
stdout stderr |
| #31199 | no new content | 2026-07-02T21:33:16+00:00ended 2026-07-02T21:37:40+00:00 | 263.6s | 0 PDF 287 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 28101, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 1169515, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-07-02T21:37:16+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-02T21:33:16+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1783027996_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1783027996_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #4590 | no new content | 2026-06-01T18:42:11+00:00ended 2026-06-01T18:42:19+00:00 | 7.6s | 0 PDF 287 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 1544, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 122742, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-06-01T18:42:11+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T18:42:11+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1780339331_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780339331_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3913 | success | 2026-05-01T21:46:22+00:00ended 2026-05-01T21:46:55+00:00 | 33.6s | 13 PDF 274 skipped 0 errors |
No reported error
Run metadata{"automation_cycle_id": 632, "canonical_name": "Duke Law & Technology Review [online]", "child_pid": 1089147, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-05-01T21:46:52+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T21:46:22+00:00", "run_kind": "scheduled_active", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1777671982_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777671982_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45} |
stdout stderr |
| #3089 | partial | 2026-03-09T08:15:05+00:00ended 2026-03-09T08:36:36+00:00 | 1290.0s | 255 PDF 19 skipped 7 errors |
digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://scholarship.law.duke.edu/cgi/viewcontent.cgi?article=1355&context=dltr&download=1
Run metadata{"canonical_name": "Duke Law & Technology Review [online]", "child_pid": 3514562, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-03-09T08:36:06+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-09T08:15:05+00:00", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1773044105_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1773044105_duke_law_technology_review_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true} |
stdout stderr |
| #1307 | no new content | 2026-02-07T06:08:55+00:00ended 2026-02-07T06:08:57+00:00 | 1.9s | 0 PDF 5 skipped 0 errors |
No reported error
Run metadata{"canonical_name": "Duke Law & Technology Review [online]", "child_pid": 1140269, "file_path": "scrapers/duke_law_technology_review_scraper.py", "heartbeat_at": "2026-02-07T06:08:55+00:00", "heartbeat_source": "orchestrator", "law_review_id": 119, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-07T06:08:55+00:00", "scraper_id": "duke_law_technology_review_scraper", "script_path": "scrapers/duke_law_technology_review_scraper.py", "stderr_path": "logs/orchestrator_runs/1770444535_duke_law_technology_review_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770444535_duke_law_technology_review_scraper.out.log", "timeout_minutes": 8} |
stdout stderr |