Est. MMXXV · lrscraper The Law Review Reporter Live

A continuous record of the open collection of American legal scholarship

Vol. II Wednesday, September 23, 2026 № 266

Scraper implementation

IndianaScraper

Indiana Law Journal · mapped to registry #23

Detail APIBack to catalogLaw review
Implementation identity
scrapers/indiana_scraper.py
LightBaseScraperoai_pmhCLI entrypoint
partial
Latest status
partial
Run #46245
Latest runtime
48.5s
2026-09-20T23:21:50+00:00
Latest PDFs
0
59 duplicates skipped
Uploads pending
0
Queue clear or unavailable
Run history
19
Returned by current limit

Definition

Registry metadata for this implementation

scraper id
IndianaScraper
canonical name
Indiana Law Journal
institution code
-
platform
oai_pmh
base class
LightBaseScraper
class name
IndianaScraper
module path
scrapers.indiana_scraper
file path
scrapers/indiana_scraper.py
has cli entrypoint
true
is abstract
false
updated at
2026-09-23 17:32:44

Operational mapping

Law review ownership and publication state

Law review
Indiana Law Journal
Registry health
DEGRADED
Last uploaded
-
Registry sync
-
Latest error
ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry

Run history

Runs associated with law review #23; diagnostics expand in place.

19 returned · show 200
Run Status Started Runtime Result Error / diagnostics Logs
#46245 partial 2026-09-20T23:21:50+00:00ended 2026-09-20T23:22:38+00:00 48.5s 0 PDF 59 skipped 3 errors digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata
{"automation_cycle_id": 265139, "canonical_name": "Indiana Law Journal", "child_pid": 444747, "discovery_coverage": {"discovery_complete": false, "has_more": true, "known_units": null, "last_completed_at": null, "mode": "pagination", "records_examined": 900, "remaining_units": null, "scope": "https://www.repository.law.indiana.edu/do/oai/#indiana-ilj", "total_records_reported": "4904", "unit_type": "pages", "visited_units": 9}, "download_queue": {"due": 717, "pending": 720, "retries": 3, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 3}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-20T23:22:20+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-20T23:21:50+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789946510_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789946510_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#45979 partial 2026-09-13T23:19:31+00:00ended 2026-09-13T23:20:30+00:00 58.6s 0 PDF 59 skipped 3 errors digital_commons_waf_partial: ACCESS_RESTRICTED: Explicit access challenge (HTTP 403); retained for later retry
Run metadata
{"automation_cycle_id": 251689, "canonical_name": "Indiana Law Journal", "child_pid": 2209375, "discovery_coverage": {"discovery_complete": false, "has_more": true, "known_units": null, "last_completed_at": null, "mode": "pagination", "records_examined": 600, "remaining_units": null, "scope": "https://www.repository.law.indiana.edu/do/oai/#indiana-ilj", "total_records_reported": "4904", "unit_type": "pages", "visited_units": 6}, "download_queue": {"due": 417, "pending": 420, "retries": 3, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 3}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-13T23:20:01+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T23:19:31+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789341571_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789341571_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#45794 partial 2026-09-13T17:29:37+00:00ended 2026-09-13T17:31:37+00:00 120.0s 0 PDF 120 skipped 1 errors digital_commons_waf_partial: ACCESS_RESTRICTED: PDF access challenge persisted until the download time budget expired: https://www.repository.law.indiana.edu/context/ilj/article/1208/viewcontent/21_83IndLJ537_2008_.pdf
Run metadata
{"automation_cycle_id": 251209, "canonical_name": "Indiana Law Journal", "child_pid": 1641613, "cutoff": true, "cutoff_elapsed_seconds": 120, "cutoff_max_runtime_seconds": 120, "cutoff_reason": "max_runtime_seconds", "discovery_coverage": {"discovery_complete": false, "has_more": true, "known_units": null, "last_completed_at": null, "mode": "pagination", "records_examined": 300, "remaining_units": null, "scope": "https://www.repository.law.indiana.edu/do/oai/#indiana-ilj", "total_records_reported": "4904", "unit_type": "pages", "visited_units": 3}, "download_queue": {"due": 78, "pending": 79, "retries": 1, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 1}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-13T17:31:37+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T17:29:37+00:00", "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789320577_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789320577_IndianaScraper.out.log", "timeout_minutes": 3, "waf_blocked": true}
 stdout stderr
#45782 partial 2026-09-13T16:49:56+00:00ended 2026-09-13T16:51:58+00:00 121.9s 0 PDF 100 skipped 0 errors partial_discovery: BROKEN_NETWORK: Indiana OAI discovery reached its time budget
Run metadata
{"automation_cycle_id": 251149, "canonical_name": "Indiana Law Journal", "child_pid": 1579155, "discovery_coverage": {"discovery_complete": false, "has_more": true, "known_units": null, "last_completed_at": null, "mode": "pagination", "records_examined": 100, "remaining_units": null, "scope": "https://www.repository.law.indiana.edu/do/oai/#indiana-ilj", "total_records_reported": "4904", "unit_type": "pages", "visited_units": 1}, "discovery_problem": "BROKEN_NETWORK: Indiana OAI discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 0}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-13T16:51:56+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T16:49:56+00:00", "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789318196_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789318196_IndianaScraper.out.log", "timeout_minutes": 3}
 stdout stderr
#45774 partial 2026-09-13T16:36:02+00:00ended 2026-09-13T16:38:18+00:00 135.1s 0 PDF 100 skipped 0 errors partial_discovery: BROKEN_NETWORK: Indiana OAI discovery reached its time budget
Run metadata
{"automation_cycle_id": 251127, "canonical_name": "Indiana Law Journal", "child_pid": 1556386, "discovery_coverage": {"discovery_complete": false, "has_more": true, "known_units": null, "last_completed_at": null, "mode": "pagination", "records_examined": 100, "remaining_units": null, "scope": "https://www.repository.law.indiana.edu/do/oai/#indiana-ilj", "total_records_reported": "4904", "unit_type": "pages", "visited_units": 1}, "discovery_problem": "BROKEN_NETWORK: Indiana OAI discovery reached its time budget", "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 0}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-13T16:38:02+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T16:36:02+00:00", "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789317362_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789317362_IndianaScraper.out.log", "timeout_minutes": 5}
 stdout stderr
#45710 no items 2026-09-13T13:58:38+00:00ended 2026-09-13T13:59:38+00:00 60.3s 0 PDF 0 skipped 0 errors no_items_reason: BROKEN_LOGIC: discover_urls returned 0 items (base_url=https://www.repository.law.indiana.edu/); scraper did not set `_no_items_reason`
Run metadata
{"automation_cycle_id": 250902, "canonical_name": "Indiana Law Journal", "child_pid": 1306895, "download_queue": {"due": 0, "pending": 0, "retries": 0, "scope": "IndianaScraper:Indiana Law Journal", "waiting": 0}, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-09-13T13:59:38+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-09-13T13:58:38+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1789307918_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1789307918_IndianaScraper.out.log", "timeout_minutes": 45}
 stdout stderr
#44853 protected 2026-08-14T09:04:58+00:00ended 2026-08-14T09:13:00+00:00 481.3s 0 PDF 220 skipped 5 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1208/viewcontent/21_83IndLJ537_2008_.pdf
Run metadata
{"automation_cycle_id": 155361, "canonical_name": "Indiana Law Journal", "child_pid": 3458640, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-08-14T09:12:59+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-08-14T09:04:58+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1786698298_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1786698298_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#44133 partial 2026-07-14T23:07:41+00:00ended 2026-07-14T23:12:08+00:00 267.0s 0 PDF 207 skipped 0 errors No reported error
Run metadata
{"automation_cycle_id": 44656, "canonical_name": "Indiana Law Journal", "child_pid": 3435527, "cutoff": true, "cutoff_elapsed_seconds": 266, "cutoff_max_runtime_seconds": 240, "cutoff_reason": "max_runtime_seconds", "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-07-14T23:11:41+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T23:07:41+00:00", "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1784070461_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1784070461_IndianaScraper.out.log", "timeout_minutes": 5}
 stdout stderr
#44081 protected 2026-07-14T19:28:29+00:00ended 2026-07-14T19:31:54+00:00 205.6s 0 PDF 207 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1208/viewcontent/21_83IndLJ537_2008_.pdf
Run metadata
{"automation_cycle_id": 44200, "canonical_name": "Indiana Law Journal", "child_pid": 3113519, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-07-14T19:31:29+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T19:28:29+00:00", "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1784057309_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1784057309_IndianaScraper.out.log", "timeout_minutes": 15, "waf_blocked": true}
 stdout stderr
#43787 failed 2026-07-14T18:41:41+00:00ended 2026-07-14T18:43:27+00:00 106.4s 0 PDF 0 skipped 0 errors process_exit_-11: Process exited with code -11
Run metadata
{"automation_cycle_id": 44060, "canonical_name": "Indiana Law Journal", "child_pid": 2986135, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-07-14T18:43:11+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "metrics_source": "inferred_unique_files", "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:41:41+00:00", "returncode": -11, "run_kind": "manual", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1784054501_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1784054501_IndianaScraper.out.log", "timeout_minutes": 15}
 stdout stderr
#43501 protected 2026-07-14T18:09:13+00:00ended 2026-07-14T18:10:28+00:00 74.8s 0 PDF 187 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1188/viewcontent/19_64IndLJ391_1988_1989_.pdf
Run metadata
{"automation_cycle_id": 43988, "canonical_name": "Indiana Law Journal", "child_pid": 2910692, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-07-14T18:10:13+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-14T18:09:13+00:00", "run_kind": "scheduled", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1784052553_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1784052553_IndianaScraper.out.log", "timeout_minutes": 15, "waf_blocked": true}
 stdout stderr
#30928 partial 2026-07-01T17:47:13+00:00ended 2026-07-01T18:31:14+00:00 2640.8s 0 PDF 187 skipped 0 errors No reported error
Run metadata
{"automation_cycle_id": 28047, "canonical_name": "Indiana Law Journal", "child_pid": 3130855, "cutoff": true, "cutoff_elapsed_seconds": 2640, "cutoff_max_runtime_seconds": 2640, "cutoff_reason": "max_runtime_seconds", "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-07-01T18:31:04+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-07-01T17:47:13+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1782928033_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1782928033_IndianaScraper.out.log", "timeout_minutes": 45}
 stdout stderr
#4316 protected 2026-06-01T15:48:21+00:00ended 2026-06-01T15:49:36+00:00 75.0s 0 PDF 107 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1111/viewcontent/21_84IndLJ713_2009_.pdf
Run metadata
{"automation_cycle_id": 1514, "canonical_name": "Indiana Law Journal", "child_pid": 44461, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-06-01T15:49:21+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-06-01T15:48:21+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1780328901_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1780328901_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#3640 protected 2026-05-01T18:50:40+00:00ended 2026-05-01T18:52:35+00:00 114.8s 0 PDF 86 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1089/viewcontent/09_84IndLJ331_2009_.pdf
Run metadata
{"automation_cycle_id": 602, "canonical_name": "Indiana Law Journal", "child_pid": 936460, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-05-01T18:52:10+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-05-01T18:50:40+00:00", "run_kind": "scheduled_active", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1777661440_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1777661440_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#2784 no new content 2026-03-08T17:09:05+00:00ended 2026-03-08T17:09:58+00:00 53.2s 0 PDF 5 skipped 0 errors No reported error
Run metadata
{"canonical_name": "Indiana Law Journal"}
 -
#2700 protected 2026-03-08T05:10:33+00:00ended 2026-03-08T05:11:38+00:00 64.4s 0 PDF 53 skipped 3 errors digital_commons_waf_block: Digital Commons WAF Block (HTTP 403) for https://www.repository.law.indiana.edu/context/ilj/article/1053/viewcontent/28_85IndLJ955_2010_.pdf
Run metadata
{"canonical_name": "Indiana Law Journal", "child_pid": 2440278, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-03-08T05:11:33+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-03-08T05:10:33+00:00", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1772946633_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1772946633_IndianaScraper.out.log", "timeout_minutes": 45, "waf_blocked": true}
 stdout stderr
#608 no new content 2026-02-06T04:17:17+00:00ended 2026-02-06T04:17:29+00:00 12.6s 0 PDF 30 skipped 0 errors No reported error
Run metadata
{"canonical_name": "Indiana Law Journal", "child_pid": 2423819, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-02-06T04:17:17+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T04:17:17+00:00", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1770351437_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1770351437_IndianaScraper.out.log", "timeout_minutes": 15}
 stdout stderr
#607 failed 2026-02-06T04:14:13+00:00ended 2026-02-06T04:15:35+00:00 81.6s 0 PDF 0 skipped 60 errors download_failed_all: HTTP 202 for https://www.repository.law.indiana.edu/context/ilj/article/1097/viewcontent/09_1IndLJ18_1926_version2.pdf
Run metadata
{"canonical_name": "Indiana Law Journal", "child_pid": 2418406, "file_path": "scrapers/indiana_scraper.py", "heartbeat_at": "2026-02-06T04:15:13+00:00", "heartbeat_source": "orchestrator", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-02-06T04:14:13+00:00", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1770351253_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1770351253_IndianaScraper.out.log", "timeout_minutes": 15}
 stdout stderr
#227 failed 2026-01-19T03:29:26+00:00ended 2026-01-19T03:41:01+00:00 694.9s 0 PDF 0 skipped 758 errors inferred_failed: Legacy run: failed (downloaded=0, duplicates=0, errors=758, discovered=758)
Run metadata
{"canonical_name": "Indiana Law Journal", "file_path": "scrapers/indiana_scraper.py", "law_review_id": 23, "orchestrator": "lrscraper", "orchestrator_started_at": "2026-01-19T03:29:26+00:00", "scraper_id": "IndianaScraper", "script_path": "scrapers/indiana_scraper.py", "stderr_path": "logs/orchestrator_runs/1768793366_IndianaScraper.err.log", "stdout_path": "logs/orchestrator_runs/1768793366_IndianaScraper.out.log", "timeout_minutes": 45}
 stdout stderr