Metadata-Version: 2.1
Name: scrapy-wayback-middleware
Version: 0.0.1
Summary: Scrapy middleware for submitting URLs to the Internet Archive Wayback Machine
Home-page: https://github.com/City-Bureau/scrapy-wayback-middleware
Author: Pat Sier
Author-email: pat@citybureau.org
License: MIT
Description: # Scrapy Wayback Middleware
        
        Middleware for submitting all scraped response URLs to the [Internet Archive Wayback Machine](https://archive.org/web/) for archival.
        
        ## Installation
        
        ```bash
        pip install scrapy-wayback-middleware
        ```
        
        ## Setup
        
        Add `scrapy_wayback_middleware.WaybackMiddleware` to your project's `SPIDER_MIDDLEWARES` settings.
        
        ### Configuration
        
        To configure custom behavior for certain methods, subclass `WaybackMiddleware` and override the `get_item_urls` method to pull additional links to archive from individual items or `handle_wayback` to change how responses from the Wayback Machine are handled.
        
Platform: UNKNOWN
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Framework :: Scrapy
Requires-Python: >=3.5,<4.0
Description-Content-Type: text/markdown
