Metadata-Version: 2.1
Name: SoDo
Version: 1.0.0
Summary: Redis-based  scheduler and Message queue Spider for Scrapy,  Provide more flexible and practical ways for Scrapy
Home-page: https://github.com/ycvbcvfu/sodo
Author: ryan
Author-email: legotime@qq.com
Maintainer: ryan
License: MIT License
Platform: UNKNOWN
Requires-Dist: Scrapy
Requires-Dist: kafka
Requires-Dist: redis

# SoDo 

## Overview

Redis-based  scheduler and Message queue Spider for Scrapy,  Provide more flexible and practical ways for Scrapy.

For more information :

## Requirements

- Python 3
- Scrapy >=1.6


## Features

- Distributed 

> Redis-based  scheduler

- Hooks feature

> new  feature for Scrapy projects

- Flexible parameter configuration

> Kafka , Redis client parameter set by yourself.

- Filter interface 

> Built-in BloomFiler and OriginalFilter  




## Installation

```python
pip install -U sodo
``` 


## Contribution guidelines

If you want to contribute to `SoDo`, please see [CONTRIBUTING Doc](https://github.com/ycvbcvfu/SoDo/blob/master/CONTRIBUTING.md)


## For more information

- [HelloWorld Tutorial](https://github.com/ycvbcvfu/SoDo/blob/master/examples/helloworld)










