Big Data Transformation

--

Version 1.0
Created date 22-05-2016

Data Size Reduction

How can the size of the data be reduced to enable more cost effective storage and increased data movement mobility when faced with very large amounts of data?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data Size Reduction

Relational Sink

How can large amounts of processed data be ported from a Big Data platform directly to a relational database?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Relational Sink

Streaming Access Storage*

--

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Streaming Access Storage*

Automated Data Sharding

How can very large amounts of data be stored without degrading the access performance of the underlying storage technology?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Automated Data Sharding

Poly Source*

The Poly Source compound pattern represents a part of a Big Data platform capable of ingesting high-volume and high-velocity data from a range of structured, unstructured and semi-structured data sources.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Poly Source*

High Volume Tabular Storage

How can large amounts of non-relational data be stored in a table-like form where each record may consist of a very large number of fields or related groups of fields?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of High Volume Tabular Storage

High Volume Hierarchical Storage

How can large amounts of non-relational data that conforms to a nested structure be stored in a scalable manner so that the data retains its internal structure and sub-sections of a data unit can be accessed?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of High Volume Hierarchical Storage

Big Data Transformation*

Data transformation represents a solution environment where the Big Data platform is exclusively used for transforming large amounts of data obtained from a variety of sources.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Big Data Transformation*

Automated Dataset Execution

How can the execution of a number of data processing activities starting from data ingress to egress be automated?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Automated Dataset Execution

Complex Logic Decomposition

How can complex processing tasks be carried out in a manageable fashion when using contemporary processing techniques?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Complex Logic Decomposition

Automated Data Replication and Reconstruction

How can large amounts of data be stored in a fault tolerant manner such that the data remains available in the face of hardware failures?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Automated Data Replication and Reconstruction

Large Scale Batch Processing

How can very large amounts of data be processed with maximum throughput?

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Large Scale Batch Processing