Metadata-Version: 2.1
Name: mucri
Version: 0.0.8
Summary: Quickly fetch multiple pages
Home-page: https://github.com/meain/mucri
Author: Abin Simon
Author-email: abinsimon10@gmail.com
License: UNKNOWN
Description: # Mucri
        
        Quickly fetch a lot of pages/apis using python `asyncio`.
        
        
        ## Installation
        
        > Only python 3.6+
        
        ```sh
        pip isntall mucri
        ```
        
        ## Usage
        
        `fetch_pages` takes two args:
        
        `links` : list of links to be fetched (example below)
        `concurrency`: how many requests to be send at a time (default 20)
        
        ```python
        from mucri import fetch_pages
        
        # links can be a single string or a dict with specific instructions
        links = [
            "http://meain.github.io",  # Can be just a url
            { "url": "http://somelink" }, # or a dict with url key
            { # for more complex stuff
                "url": "http://fakelink",
                "action": "get", # get | post
                "data": {},
                "headers": {},
                "resp_type": "text", # text | json | image
            }
        ]
        
        results = fetch_pages(links) # fetches all of them asynchronously
        ```
        
Keywords: asyncio,scraper,aiohttp
Platform: UNKNOWN
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Topic :: Software Development :: Libraries
Classifier: Topic :: Utilities
Classifier: Environment :: Console
Classifier: Intended Audience :: End Users/Desktop
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Classifier: Operating System :: POSIX
Classifier: Natural Language :: English
Description-Content-Type: text/markdown
