Big Data Mechanisms in Big Data Blueprint

Plot of the described mechanisms on the Big Data Blueprint

Version 1.0
Created date 25-05-2016

Data governance

Data governance activities and application functions layers for maintaining qualities of the datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data governance

Data security

Application functions and activities for securing datasets and storage functionalities

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data security

Data management

--

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data management

Data utilisation

Usage of the processed data in work processes in the consumer organisation

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data utilisation

Data visualisation

Visualisation of the data or information for interpretation by analists and users

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data visualisation

Data analysis

Analysing the cleaned, aggregated and filtered datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data analysis

Data storage

Storage of primary and temporary datasets for usage in higher layers of the architecture

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data storage

Data processing

Processing activities for filtering, cleaning and transformation of datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data processing

Data acquisition

Selecting data sources on information content and data qualities

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data acquisition

Data sources

Not part of a data architecture but the input of the architecture, it is the raw material of a data pipe and therefore an essential part

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data sources

Compression Engine

Big data sets can be voluminous so compressing has advantages for storage and/or processing

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Compression Engine

Processing Engine

Processing of data for transformation, cleaning and filtering of data

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Processing Engine

Security Manager

Administration and registration of security concepts in a Big Data environment.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Security Manager

Serialization Engine

Serialization and deserialization of proprietary datasets to standardized stored datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Serialization Engine

Productivity Portal

Portal functionality to give users and administrator access to the other logical functionalities in a Big Data environment.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Productivity Portal

Data Transfer Engine

Transformation and transfer functionality from data sources to storage, processing and usage.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data Transfer Engine

Analytics Engine

Functionality for analysing the transformed and standardized data in a data analytics tool.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Analytics Engine

Coordination Engine

Coordination of automated tasks for example in batch processes and mapreduce.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Coordination Engine

Visualization Engine

Visualisation of query and analytics results to data scientists and end users.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Visualization Engine

Workflow Engine

Functionality to design workflows to automatically perform transformations and cleaning of datasets.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Workflow Engine

Cluster Manager

Management of clusters in a distributed or cloud based infrastructure

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Cluster Manager

Query Engine

Retrieval and querying function on the transformed and standardized datasets

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Query Engine

Resource Manager

Management function for the various resources in a Big Data environment

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Resource Manager

Storage Device

Storage function of big data sets.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Storage Device

Data Governance Manager

Register function for the governance of data sets in relation to consumers, business owners and qualities.

Author Bert
Alias --
Stereotypes ApplicationFunction
Details of Data Governance Manager