[UNT Dallas College of Law Review: On The Cusp] MOVED: Sitemap publisher page returned HTTP 404: https://onthecusp.untdallas.edu/index-1-1.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/index-1-1.php [UNT Dallas College of Law Review: On The Cusp] MOVED: Sitemap publisher page returned HTTP 404: https://onthecusp.untdallas.edu/zz-index.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/zz-index.php [UNT Dallas College of Law Review: On The Cusp] MOVED: Sitemap publisher page returned HTTP 404: https://onthecusp.untdallas.edu/test.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/test.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/submit-article.php (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/submit-article.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/index-1-1.txt (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/index-1-1.txt [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/search/index.php (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/search/index.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/index-1.php (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/index-1.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_LOGIC: Empty or oversized sitemap response: https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.captcha.html [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.captcha.html [UNT Dallas College of Law Review: On The Cusp] ACCESS_RESTRICTED: Sitemap publisher page returned HTTP 403: https://onthecusp.untdallas.edu/.htaccess [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/.htaccess [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.ldp-forms-connector.php (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.ldp-forms-connector.php [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/images/lady_justice_-_otc_header-1000px.png (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/images/lady_justice_-_otc_header-1000px.png /home/arbel/sites/lrscraper/sitemap_pdf_scraper_base.py:346: XMLParsedAsHTMLWarning: It looks like you're using an HTML parser to parse an XML document. Assuming this really is an XML document, what you're doing might work, but you should know that using an XML parser will be more reliable. To parse this document as XML, make sure you have the Python package 'lxml' installed, and pass the keyword argument `features="xml"` into the BeautifulSoup constructor. If you want or need to use an HTML parser on this document, you can make this warning go away by filtering it. To do that, run this code before calling the BeautifulSoup constructor: from bs4 import XMLParsedAsHTMLWarning import warnings warnings.filterwarnings("ignore", category=XMLParsedAsHTMLWarning) soup = BeautifulSoup(html, "html.parser") [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.ldp-forms.html (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/_resources/ldp/forms/ldp-forms.ldp-forms.html [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/_resources/ou/editor/styles.txt (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/_resources/ou/editor/styles.txt [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/_resources/php/_mchost-v4.4/index-v4.4.html (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/_resources/php/_mchost-v4.4/index-v4.4.html [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch https://onthecusp.untdallas.edu/404.php (OSError: curl transport exit 28) [UNT Dallas College of Law Review: On The Cusp] BROKEN_NETWORK: Unable to fetch sitemap page: https://onthecusp.untdallas.edu/404.php