rattail.etl Module

rattail.etl - ETL helper library

Since ETL is assumed to be a console-based affair (at least for now), this library is focused on abstracting code which is typically required when creating a custom Rattail command for performing the ETL.

class rattail.etl.EntityPuller(system)

Represents an entity-specific “controller”. The interface defined by this class should determine how to obtain the relevant external data (from an already-established connection), and how to map the data to Rattail objects.

prepare_to_pull(session)

This does nothing by default, but may be overridden if you wish to e.g. pre-cache some values prior to entering the main pull loop.

class rattail.etl.SystemPuller

Represents a system-specific “controller” for the ETL process as a whole. The interface defined by this class should determine how to “connect” to the external data source, and how to delegate entity-specific chores to various other classes (which will derive from rattail.etl.EntityPuller).

progress_factory

The progress_factory to pass when calling a rattail.etl.EntityPuller instance.

Previous topic

rattail.enum Module

Next topic

rattail.exc Module

This Page