Big Data Patterns | Compound Patterns | Big Data Pipeline

Big Data Patterns, Mechanisms > Compound Patterns > Big Data Pipeline

Home > Compound Patterns > Big Data Pipeline

Big Data Pipeline (Buhler, Erl, Khattak)

The Big Data pipeline compound pattern generally comprises multiple stages whose objectives are to divide complex processing operations into down into modular steps for easier understanding and debugging and to be amenable to future data processing requirements.

Required (Core)

Poly Source
Poly Storage
Big Data Processing Environment
Poly Sink
Automated Dataset Execution

This pattern is covered in BDSCP Module 10: Fundamental Big Data Architecture.

For more information regarding the Big Data Science Certified Professional (BDSCP) curriculum,
visit www.arcitura.com/bdscp.