Metadata-Version: 2.1
Name: ruia
Version: 0.8.4
Summary: Async Python 3.6+ web scraping micro-framework based on asyncio.
Home-page: https://python-ruia.org/
Author: Howie Hu
Author-email: xiaozizayang@gmail.com
License: MIT
Project-URL: Documentation, https://docs.python-ruia.org/
Project-URL: Source, https://github.com/howie6879/ruia
Description: <p align="center"><img src="https://raw.githubusercontent.com/howie6879/ruia/master/docs/images/logo.png" width='120px' height='120px' alt="Ruia logo" >
        </p>
        <h1 align="center">Ruia</h1>
        <p align="center">🕸️ Async Python 3.6+ web scraping micro-framework based on asyncio.</p>
        <p align="center"><strong>⚡ Write less, run faster.</strong></p>
        
        <p align="center">
        <a href="https://travis-ci.org/howie6879/ruia"><img src="https://travis-ci.org/howie6879/ruia.svg?branch=master" alt="travis"></a>
        <a href="https://travis-ci.org/howie6879/ruia"><img src="https://codecov.io/gh/howie6879/ruia/branch/master/graph/badge.svg" alt="codecov"></a>
        <a href="https://pypi.org/project/ruia"><img src="https://img.shields.io/pypi/pyversions/ruia.svg" alt="PyPI - Python Version"></a>
        <a href="https://pypi.org/project/ruia/"><img src="https://img.shields.io/pypi/v/ruia.svg" alt="PyPI"></a>
        <a href="https://pepy.tech/project/ruia"><img src="https://pepy.tech/badge/ruia/month" alt="Downloads"></a>
        <a href="https://gitter.im/howie6879_ruia/community?utm_source=badge&utm_medium=badge&utm_campaign=pr-badge"><img src="https://badges.gitter.im/howie6879_ruia/community.svg" alt="gitter"></a>
        </p>
        
        
        ![](https://raw.githubusercontent.com/howie6879/ruia/master/docs/images/ruia_demo.png)
        
        ## Overview
        
        Ruia is an async web scraping micro-framework, written with `asyncio` and `aiohttp`, 
        aims to make crawling url as convenient as possible.
        
        **Write less, run faster**:
        
        -   Documentation: [中文文档][doc_cn] |[documentation][doc_en]
        -   Organization: [python-ruia][Organization]
        -   Plugin: [awesome-ruia](https://github.com/python-ruia/awesome-ruia)(Any contributions you make are **greatly appreciated**!)
        
        ## Features
        
        -   **Easy**: Declarative programming
        -   **Fast**: Powered by asyncio
        -   **Extensible**: Middlewares and plugins
        -   **Powerful**: JavaScript support
        
        ## Installation
        
        ``` shell
        # For Linux & Mac
        pip install -U ruia[uvloop]
        
        # For Windows
        pip install -U ruia
        
        # New features
        pip install git+https://github.com/howie6879/ruia
        ```
        
        ## Tutorials
        
        1.  [Overview](https://docs.python-ruia.org/en/tutorials/overview.html)
        2.  [Installation](https://docs.python-ruia.org/en/tutorials/installation.html)
        3.  [Define Data Items](https://docs.python-ruia.org/en/tutorials/item.html)
        4.  [Spider Control](https://docs.python-ruia.org/en/tutorials/spider.html)
        5.  [Request & Response](https://docs.python-ruia.org/en/tutorials/request.html)
        6.  [Customize Middleware](https://docs.python-ruia.org/en/tutorials/middleware.html)
        7.  [Write a Plugins](https://docs.python-ruia.org/en/tutorials/plugins.html)
        
        
        ## TODO
        
        - [x] Cache for debug, to decreasing request limitation, [ruia-cache](https://github.com/python-ruia/ruia-cache)
        - [x] Provide an easy way to debug the script, [ruia-shell](https://github.com/python-ruia/ruia-shell)
        - [ ] Distributed crawling/scraping
        
        ## Contribution
        
        Ruia is still under developing, feel free to open issues and pull requests:
        
        -   Report or fix bugs
        -   Require or publish plugins
        -   Write or fix documentation
        -   Add test cases
        
        <!-- To get src for img: https://api.github.com/users/username -->
        <a href="https://github.com/howie6879"><img src="https://avatars.githubusercontent.com/u/17047388?s=60&v=4" title="howie6879" width="50" height="50"></a>
        <a href="https://github.com/panhaoyu"><img src="https://avatars.githubusercontent.com/u/23495987?s=60&v=4" title="panhaoyut" width="50" height="50"></a>
        <a href="https://github.com/mirzazulfan"><img src="https://avatars.githubusercontent.com/u/36124339?s=64&v=4" title="mirzazulfan" width="50" height="50"></a>
        <a href="https://github.com/abmyii"><img src="https://avatars.githubusercontent.com/u/52673001?s=60&v=4" title="abmyii" width="50" height="50"></a>
        <a href="https://github.com/maxzheng"><img src="https://avatars.githubusercontent.com/u/9684260?s=60&v=4" title="maxzheng" width="50" height="50"></a>
        <a href="https://github.com/ruter"><img src="https://avatars.githubusercontent.com/u/8568876?s=60&v=4" title="ruter" width="50" height="50"></a>
        <a href="https://github.com/duolaAOA"><img src="https://avatars.githubusercontent.com/u/26339233?s=60&v=4" title="duolaAOA" width="50" height="50"></a>
        <a href="https://github.com/fengdongfa1995"><img src="https://avatars.githubusercontent.com/u/20141092?s=60&v=4" title="fengdongfa1995" width="50" height="50"></a>
        <a href="https://github.com/daijiangtian"><img src="https://avatars.githubusercontent.com/u/18069191?s=60&v=4" title="daijiangtian" width="50" height="50"></a>
        <a href="https://github.com/scott-stoltzman-consulting"><img src="https://avatars.githubusercontent.com/u/66376167?s=60&v=4" title="consulting" width="50" height="50"></a>
        <a href="https://github.com/Leezj9671"><img src="https://avatars.githubusercontent.com/u/11917826?s=60&v=4" title="Leezj9671" width="50" height="50"></a>
        
        !!!Notice: We use [black](https://github.com/psf/black) to format the code.
        
        ## Thanks
        
        -   [aiohttp](https://github.com/aio-libs/aiohttp/)
        -   [demiurge](https://github.com/matiasb/demiurge)
        
        [doc_cn]: https://www.howie6879.cn/ruia/
        [doc_en]: https://docs.python-ruia.org/
        [Awesome]: https://github.com/python-ruia/awesome-ruia
        [Organization]: https://github.com/python-ruia
        
Platform: UNKNOWN
Classifier: Framework :: AsyncIO
Classifier: Intended Audience :: Developers
Classifier: Development Status :: 4 - Beta
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: POSIX :: Linux
Classifier: Operating System :: MacOS :: MacOS X
Classifier: Operating System :: POSIX :: BSD
Classifier: Operating System :: Microsoft :: Windows
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Topic :: Internet :: WWW/HTTP
Classifier: Topic :: Software Development :: Libraries :: Application Frameworks
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Provides-Extra: uvloop
