kibitzr.fetcher package

Submodules

kibitzr.fetcher.browser module

kibitzr.fetcher.simple module

class kibitzr.fetcher.simple.SessionFetcher(conf)

Bases: object

EXCEPTED = (<class 'requests.exceptions.HTTPError'>, <class 'requests.exceptions.ConnectionError'>, <class 'requests.exceptions.Timeout'>)

RETRIABLE_EXCEPTIONS = ((<class 'requests.exceptions.HTTPError'>, 5), (<class 'requests.exceptions.ConnectionError'>, 15), (<class 'requests.exceptions.Timeout'>, <function SessionFetcher.<lambda>>))

fetch()

sleep_on_exception(exc, retry)

kibitzr.fetcher.simple.requests_fetcher(conf)

Module contents

kibitzr.fetcher.cleanup_fetchers()

kibitzr.fetcher.persistent_firefox()