Metadata-Version: 2.1
Name: hcf-backend
Version: 0.2.4
Summary: ScrapyCloud HubStorage frontier backend for Frontera
Home-page: https://github.com/scrapinghub/hcf-backend
Maintainer: Scrapinghub
License: BSD
Platform: UNKNOWN
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: BSD License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Requires-Dist: frontera (==0.7.1)
Requires-Dist: humanize (==0.5.1)
Requires-Dist: requests (>=2.18.4)
Requires-Dist: retrying (>=1.3.3)
Requires-Dist: scrapinghub (>=2.0.0)

HCF (HubStorage Frontier) Backend for Frontera
==============================================

When used with scrapy, use it with Scrapy Scheduler provided by `scrapy-frontera <https://github.com/scrapinghub/scrapy-frontera>`_. Scrapy scheduler provided
by `Frontera <https://github.com/scrapinghub/frontera>`_ *is not* supported

See usage instructions at module and class docstrings at `backend.py <https://github.com/scrapinghub/hcf-backend/blob/master/hcf_backend/backend.py>`_.

Package also installs a convenient command line tool for hubstorage frontier handling and manipulation:
`hcfpal.py <https://github.com/scrapinghub/hcf-backend/blob/master/bin/hcfpal.py>`_. It supports dumping, count, deletion, moving, listing, etc.

Another tool provided is `hcfmanager.py <https://github.com/scrapinghub/hcf-backend/blob/master/bin/hcfmanager.py>`_. It facilitates the scheduling of
consumer spider jobs.


