Crawley’s Documentation

Crawley is a pythonic Scraping / Crawling Framework intended to make easy the way you extract data from web pages into structured storages such as databases.

Features

  • High Speed WebCrawler built on Eventlet.
  • Supports databases engines like Postgre, Mysql, Oracle, Sqlite.
  • Command line tools.
  • Extract data using your favourite tool. XPath or Pyquery (A Jquery-like library for python).
  • Cookie Handlers.
  • Very easy to use (see the example).

Table Of Contents

Next topic

Pypi Example

This Page