LRScraper - Scraper Detail

Latest Status

success #4393

Latest Metrics

d=11 | skip=290 | err=0

t=77.5s

Implementation

script

bepress

Law Review

South Dakota Law Review

id=388

Uploads Pending

0

Last Upload

2026-06-01 19:39:12

uabox:Law_Review_Project/south_dakota_law_review_20260601_193855.zip

Definition

scraper_id

southdakota_scraper

canonical_name

South Dakota Law Review

institution_code

-

platform

bepress

base_class

script

class_name

-

module_path

scrapers.southdakota_scraper

file_path

scrapers/southdakota_scraper.py

has_cli_entrypoint

true

is_abstract

false

discovered_at

2026-03-30 20:11:12

updated_at

2026-06-17 05:09:53

Run History

Showing 4 runs (law_review_id=388) — use ?limit=200 for more.

Run	Status	Start	End	Runtime	Metrics	Error / Details	Logs
#4393	success	2026-06-01T16:38:31+00:00	2026-06-01T16:39:49+00:00	77.5s	d=11 \| skip=290 \| err=0 discovered=301 \| processed=301	- extra_json {"automation_cycle_id": 1522, "canonical_name": "South Dakota Law Review", "child_pid": 63241, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-06-01T16:39:31+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T16:38:31+00:00", "run_kind": "scheduled_active", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1780331911_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780331911_southdakota_scraper.out.log", "timeout_minutes": 45}	stdout \| stderr
#3709	no_new_content	2026-05-01T19:59:15+00:00	2026-05-01T20:00:23+00:00	67.4s	d=0 \| skip=307 \| err=0 discovered=307 \| processed=307	- extra_json {"automation_cycle_id": 610, "canonical_name": "South Dakota Law Review", "child_pid": 993729, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-05-01T20:00:15+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T19:59:15+00:00", "run_kind": "scheduled_active", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1777665555_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777665555_southdakota_scraper.out.log", "timeout_minutes": 45}	stdout \| stderr
#2865	partial	2026-03-08T19:30:54+00:00	2026-03-08T19:35:48+00:00	293.9s	d=19 \| skip=287 \| err=1 discovered=307 \| processed=307	digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://red.library.usd.edu/cgi/viewcontent.cgi?article=1119&context=sdlrev&download=1 extra_json {"canonical_name": "South Dakota Law Review", "child_pid": 2940845, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-03-08T19:35:24+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-08T19:30:54+00:00", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1772998254_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1772998254_southdakota_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}	stdout \| stderr
#976	success	2026-02-06T19:24:09+00:00	2026-02-06T19:24:23+00:00	13.7s	d=2 \| skip=23 \| err=0 discovered=25 \| processed=25	- extra_json {"canonical_name": "South Dakota Law Review", "child_pid": 4130769, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-02-06T19:24:09+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T19:24:09+00:00", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1770405849_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770405849_southdakota_scraper.out.log", "timeout_minutes": 25}	stdout \| stderr

Runs (scraper_name = southdakota_scraper)

These are runs recorded explicitly under this scraper_id.

Run	Status	Start	End	Runtime	Metrics	Error / Details	Logs
#4393	success	2026-06-01T16:38:31+00:00	2026-06-01T16:39:49+00:00	77.5s	d=11 \| skip=290 \| err=0 discovered=301 \| processed=301	- extra_json {"automation_cycle_id": 1522, "canonical_name": "South Dakota Law Review", "child_pid": 63241, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-06-01T16:39:31+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T16:38:31+00:00", "run_kind": "scheduled_active", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1780331911_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1780331911_southdakota_scraper.out.log", "timeout_minutes": 45}	stdout \| stderr
#3709	no_new_content	2026-05-01T19:59:15+00:00	2026-05-01T20:00:23+00:00	67.4s	d=0 \| skip=307 \| err=0 discovered=307 \| processed=307	- extra_json {"automation_cycle_id": 610, "canonical_name": "South Dakota Law Review", "child_pid": 993729, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-05-01T20:00:15+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T19:59:15+00:00", "run_kind": "scheduled_active", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1777665555_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1777665555_southdakota_scraper.out.log", "timeout_minutes": 45}	stdout \| stderr
#2865	partial	2026-03-08T19:30:54+00:00	2026-03-08T19:35:48+00:00	293.9s	d=19 \| skip=287 \| err=1 discovered=307 \| processed=307	digital_commons_waf_partial: Digital Commons WAF Block (HTTP 403) for https://red.library.usd.edu/cgi/viewcontent.cgi?article=1119&context=sdlrev&download=1 extra_json {"canonical_name": "South Dakota Law Review", "child_pid": 2940845, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-03-08T19:35:24+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-08T19:30:54+00:00", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1772998254_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1772998254_southdakota_scraper.out.log", "timeout_minutes": 45, "waf_blocked": true}	stdout \| stderr
#976	success	2026-02-06T19:24:09+00:00	2026-02-06T19:24:23+00:00	13.7s	d=2 \| skip=23 \| err=0 discovered=25 \| processed=25	- extra_json {"canonical_name": "South Dakota Law Review", "child_pid": 4130769, "file_path": "scrapers/southdakota_scraper.py", "heartbeat_at": "2026-02-06T19:24:09+00:00", "heartbeat_source": "orchestrator", "law_review_id": 388, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T19:24:09+00:00", "scraper_id": "southdakota_scraper", "script_path": "scrapers/southdakota_scraper.py", "stderr_path": "logs/orchestrator_runs/1770405849_southdakota_scraper.err.log", "stdout_path": "logs/orchestrator_runs/1770405849_southdakota_scraper.out.log", "timeout_minutes": 25}	stdout \| stderr