ketl.etl package

Submodules

ketl.etl.Pipeline module

class ketl.etl.Pipeline.ETLPipeline(extractors: Optional[List[ketl.extractor.Extractor.BaseExtractor]] = None, transformers: Optional[List[ketl.transformer.Transformer.BaseTransformer]] = None, loaders: Optional[List[ketl.loader.Loader.BaseLoader]] = None, fanout: Optional[Dict[Union[ketl.extractor.Extractor.BaseExtractor, ketl.transformer.Transformer.BaseTransformer, ketl.loader.Loader.BaseLoader], Union[List[ketl.transformer.Transformer.BaseTransformer], List[ketl.loader.Loader.BaseLoader]]]] = None)[source]

Bases: object

execute()[source]: Run the pipeline. Fires the extractors, then feeds the results into the transformers. :return: None

exception ketl.etl.Pipeline.InvalidPipelineError[source]: Bases: Exception

Module contents