Metadata-Version: 2.1
Name: scrapydweb
Version: 1.0.0rc1
Summary: Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization
Home-page: https://github.com/my8100/scrapydweb
Author: my8100
Author-email: my8100@gmail.com
License: GNU General Public License v3.0
Description: ScrapydWeb: Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization
        ==========================
        [![PyPI - scrapydweb Version](https://img.shields.io/pypi/v/scrapydweb.svg)](https://pypi.org/project/scrapydweb/)
        [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/scrapydweb.svg)](https://pypi.org/project/scrapydweb/)
        [![Coverage Status](https://coveralls.io/repos/github/my8100/scrapydweb/badge.svg?branch=master)](https://coveralls.io/github/my8100/scrapydweb?branch=master)
        [![GitHub license](https://img.shields.io/github/license/my8100/scrapydweb.svg)](https://github.com/my8100/scrapydweb/blob/master/LICENSE)
        [![Twitter](https://img.shields.io/twitter/url/https/github.com/my8100/scrapydweb.svg?style=social)](https://twitter.com/intent/tweet?text=ScrapydWeb:%20Full-featured%20web%20UI%20for%20Scrapyd%20cluster%20management,%20Scrapy%20log%20analysis%20%26%20visualization%20%23python%20%20%23scrapy%20%23scrapyd%20%23webscraping%20%23scrapydweb%20@my8100_%20&url=https%3A%2F%2Fgithub.com%2Fmy8100%2Fscrapydweb)
        
        Features
        ---------------
        - Scrapyd Cluster Management
          - Group, filter and select any numbers of nodes
          - **Execute command on multinodes with one click**
        
        - **Scrapy Log Analysis**
          - Stats collection
          - Progress visualization
          - Logs categorization
        
        - All Scrapyd API Supported
          - Deploy project, Run Spider, Stop job
          - List projects/versions/spiders/running_jobs
          - Delete version/project
        
        - Enhancements
          - **Basic auth** for web UI
          - HTML caching for the Log and Stats page
          - **Auto eggify** your projects
          - **Email notice** with multi-triggers provided
        
        
        Devolopers
        ---------------
        - [my8100](https://github.com/my8100)
        - [simplety](https://github.com/simplety) (Front-End)
        
        
        Installation
        ------------
        To install ScrapydWeb, simply use pip:
        
        ```
        pip install scrapydweb
        ```
        
        
        Start Up
        ------------
        1. Run `scrapydweb -h` to get help,
        then a config file named **scrapydweb_settings_vN.py** (N for a number) would be copied to current working directory,
        in which you can custom settings.
        2. Run `scrapydweb`
        3. Visit [http://127.0.0.1:5000](http://127.0.0.1:5000) **(It's recommended to use Google Chrome to get better experience.)**
        
        
        Settings
        ---------------
        [default_settings.py](https://github.com/my8100/scrapydweb/blob/master/scrapydweb/default_settings.py)
        
        
        Screenshots
        ------------
        - Overview
        ![overview](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/overview.png)
        
        - Dashboard
        ![dashboard](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/dashboard.png)
        
        - Log Analysis
          - stats collection
        ![log_stats](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_stats.png)
        
          - progress visualization
        ![log_charts](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_charts.png)
        
          - logs categorization
        ![log_logs](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/log_logs.png)
        
        - Deploy Project
        ![deploy](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/deploy.png)
        
        - Run Spider
        ![run](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/run.png)
        
        - Manage Projects
        ![manage](https://raw.githubusercontent.com/my8100/scrapydweb/master/screenshots/manage.png)
        
Platform: UNKNOWN
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Requires-Python: >=2.7, !=3.0.*, !=3.1.*, !=3.2.*, !=3.3.*, !=3.4.*, !=3.5.*
Description-Content-Type: text/markdown
