###################################################
Logical Data Model
###################################################

.. meta::
   :description: Logical Data Model
   :keywords: Logical data model dimensions

Introduction
-------------------------------------------

The Data Quality Framework implementation contains 7 conceptual modules:


* :ref:`The Users, Roles and Responsibilites<logic-users>`

* :ref:`The Datasets elements<logic-datasets>`

* :ref:`The Profiling elements<logic-profiling>`

* :ref:`The DQ Controls elements<logic-controls>`

* :ref:`The DQ Control Results elements<logic-results>`

* :ref:`The Reports elements<logic-reports>`

* :ref:`The remediations elements<logic-remediations>`

--------------------------------------------------------------------------------------------------------------------




.. _logic-users:

The Users, Roles and Responsibilites
---------------------------------------------
Managing users, roles and responsibilities is a fundamental aspect to ensure the proper functioning of the Data Quality Framework. This module defines the specific roles of users and their responsibilities in data quality management.

.. --------------------------
.. Users > User section
.. --------------------------

.. _logic-usr_user:

* 'usr_user' table

**Fact/Dimension table:** The 'usr_user' table is a 'Dimension table'

**Editable:** The users can be updated by a Data Engineer.

:ref:`→ 'User' in Conceptual model<concept-users-user>`

.. image:: /_static/img/dqe-logical-usr_user.png
   :alt: Logical Data Model - usr_user
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-usr_user.png
   :alt: Physical Data Model - usr_user
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. --------------------------
.. Users > Role section
.. --------------------------

.. _logic-usr_role:

* 'usr_role' table

**Fact/Dimension table:** The 'usr_role' table is a 'Dimension table'

**Editable:** The roles can be updated by a Data Engineer.

:ref:`→ 'Role' in Conceptual model<concept-users-role>`

.. image:: /_static/img/dqe-logical-usr_role.png
   :alt: Logical Data Model - usr_role
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-usr_role.png
   :alt: Physical Data Model - usr_role
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. --------------------------------
.. Users > Responsability section
.. --------------------------------

.. _logic-usr_responsibility:

* 'usr_responsibility' table

**Fact/Dimension table:** N/A

**Editable:** The responsibilities can be updated by a Data Engineer.

:ref:`→ 'Responsibility' in Conceptual model<concept-users-responsibility>`

.. image:: /_static/img/dqe-logical-usr_responsibility.png
   :alt: Logical Data Model - usr_responsibility
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-usr_responsibility.png
   :alt: Physical Data Model - usr_responsibility
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>

-------------------------------------------------------------------------------------------------

.. _logic-datasets:

The Datasets elements
-------------------------------

As part of the Data Quality Framework implementation, dataset elements are a central module that helps structure and organize data to facilitate data management, analysis, and quality control. This module includes different types of tables and dataset elements that are essential to ensure data consistency, completeness, and integrity.

.. ------------------------------
.. Datasets > Database section
.. ------------------------------

.. _logic-datasets-database:

* 'in_database' table


**Fact/Dimension table:** The 'in_database' table is a 'dimension table'

**Editable:** The databases can be updated by a Data Engineer.

:ref:`→ 'Database' in Conceptual model<concept-datasets-database>`


.. image:: /_static/img/dqe-logical-in_database.png
   :alt: Logical Data Model - in_database
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-in_database.png
   :alt: Physical Data Model - in_database
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>



.. ------------------------------
.. Datasets > Table section
.. ------------------------------

.. _logic-datasets-table:

* 'in_table' table


**Fact/Dimension table:** The 'in_table' table is a 'dimension table'

**Editable:** The table's description can be updated by a Data Engineer.

The mandatory 'type' attribute can take the values 'TABLE' or 'VIEW'


:ref:`→ 'Table' in Conceptual model<concept-datasets-table>`

.. image:: /_static/img/dqe-logical-in_table.png
   :alt: Logical Data Model - in_table
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-in_table.png
   :alt: Physical Data Model - in_table
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ------------------------------
.. Datasets > Table column
.. ------------------------------

.. _logic-datasets-column:

* 'in_column' table


**Fact/Dimension table:** The 'in_column' table is a 'dimension table'

**Editable:** The column's description can be updated by a Data Engineer.


:ref:`→ 'Column' in Conceptual model<concept-datasets-column>`

.. image:: /_static/img/dqe-logical-in_column.png
   :alt: Logical Data Model - in_column
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-in_column.png
   :alt: Physical Data Model - in_column
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


--------------------------------------------------------------------------------------------------------

.. _logic-profiling:

The Profiling elements
-------------------------------
Profiling elements play a fundamental role in assessing and improving data quality within the Data Quality Framework. This module is designed to analyze data in depth, identifying trends, anomalies, and deviations from expectations. Data profiling provides a clear overview of the current state of the data, facilitating the implementation of appropriate controls.


-------------------------------------------------------------------------------------------------------

.. _logic-controls:

The DQ Controls elements
-------------------------------


.. --------------------------------------------
.. Controls > Data Quality Dimension section
.. --------------------------------------------

.. _logic-controls-dimension:

* 'dq_dimension' table

**Data Quality Dimensions** are measurement attributes of data, which you can individually assess, interpret, and improve. The aggregated scores of multiple dimensions represent data quality in your specific context and indicate the fitness of data for use.

**Fact/Dimension table:** The 'dq_dimension' table is a 'Dimension table'

**Editable:** The dimensions can't be updated by a Data Engineer.

:ref:`→ 'Data Quality Dimension' in Conceptual model<concept-controls-dimension>`

.. image:: /_static/img/dqe-logical-dq_dimension.png
   :alt: Logical Data Model - dq_dimension
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-dq_dimension.png
   :alt: Physical Data Model - dq_dimension
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ----------------------------------------------
.. Controls > Data Quality Control Type section
.. ----------------------------------------------

.. _logic-controls-controltype:

* 'dq_controltype' table

**Fact/Dimension table:** The 'dq_controltype' table is a 'Dimension table'

**Editable:** The control types can't be updated by a Data Engineer.


:ref:`→ 'Data Quality Control Type' in Conceptual model<concept-controls-controltype>`

.. image:: /_static/img/dqe-logical-dq_controltype.png
   :alt: Logical Data Model - dq_controltype
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-dq_controltype.png
   :alt: Physical Data Model - dq_controltype
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ----------------------------------------------
.. Controls > Data Quality Controls section
.. ----------------------------------------------

.. _logic-controls-control:

* 'dq_control' table

**Fact/Dimension table:** The 'dq_controltype' table is a 'dimension table'

**Editable:** The controls can be updated by a Data Engineer.

:ref:`→ 'Data Quality Control' in Conceptual model<concept-controls-control>`


.. image:: /_static/img/dqe-logical-dq_control.png
   :alt: Logical Data Model - dq_control
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-dq_control.png
   :alt: Physical Data Model - dq_control
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ----------------------------------------------
.. Controls > Data Quality Controls Set section
.. ----------------------------------------------

.. _logic-controls-controlset:

* 'dq_controlset' table

**Fact/Dimension table:** The 'dq_controltype' table is a 'Dimension table'

**Editable:** The control sets can be updated by a Data Engineer.

:ref:`→ 'Data Quality Control Set' in Conceptual model<concept-controls-controlset>`


.. image:: /_static/img/dqe-logical-dq_controlset.png
   :alt: Logical Data Model - dq_controlset
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-dq_controlset.png
   :alt: Physical Data Model - dq_controlset
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>

-----------------------------------------------------------------------------------------------------

.. _logic-results:

The DQ Control Results elements
-------------------------------
Data Quality Control Results (DQ Control Results) elements are essential to measure the effectiveness of the quality controls implemented and to ensure continuous process improvement. This module collects, analyzes and presents the results of the various data quality checks performed on the datasets.

.. ----------------------------------------------
.. Results > Resultset section
.. ----------------------------------------------

.. _logic-results-resultset:

* 'res_resultset' table

**Fact/Dimension table:** The 'res_resultset' table is a 'Fact table'

**Editable:** res_resultset table can't be updated by a Data Engineer.


:ref:`→ 'Data Quality Control Results Set' in Conceptual model<concept-results-resultset>`

.. image:: /_static/img/dqe-logical-res_resultset.png
   :alt: Logical Data Model - res_resultset
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-res_resultset.png
   :alt: Physical Data Model - res_resultset
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ----------------------------------------------
.. Results > Result section
.. ----------------------------------------------

.. _logic-results-result:

* 'res_result' table

**Fact/Dimension table:** The 'res_result' table is a 'Fact table'

**Editable:** res_result table can't be updated by a Data Engineer.


:ref:`→ 'Data Quality Control Result' in Conceptual model<concept-results-result>`

.. image:: /_static/img/dqe-logical-res_result.png
   :alt: Logical Data Model - res_result
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-res_result.png
   :alt: Physical Data Model - res_result
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>


.. ----------------------------------------------
.. Results > Error section
.. ----------------------------------------------

.. _logic-results-error:

* 'res_error' table

**Fact/Dimension table:** The 'res_result' table is a 'Fact table'

**Editable:** res_result table can't be updated by a Data Engineer.


:ref:`→ 'Data Quality Control Result Error' in Conceptual model<concept-results-error>`

.. image:: /_static/img/dqe-logical-res_error.png
   :alt: Logical Data Model - res_error
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-res_error.png
   :alt: Physical Data Model - res_error
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>

--------------------------------------------------------------------------------------------------------------

.. _logic-reports:

The Reports elements
-------------------------------
Report elements play a crucial role in visualizing and interpreting data related to data quality. This module allows you to generate detailed and customized reports that provide an overview of quality control results, data system performance, and remediation actions.

* 'viz_threshold' table

* 'viz_color' table

-------------------------------------------------------------------------------------------------------------------


.. _logic-remediations:

The remediation elements
---------------------------------------------
Remediation elements are essential in the Data Quality Framework because they define the corrective actions to be taken when data quality issues are identified. This module is designed to ensure that anomalies, errors, and deviations from quality standards are quickly and effectively corrected.

.. ----------------------------------------
.. Remediation > Criticity Level section
.. ----------------------------------------

.. _logic-remediation-criticity:

* 'rm_criticity' table


**Fact/Dimension table:** The 'rm_criticity' table is a 'dimension table'

**Editable:** The controls can't be updated by a Data Engineer.

:ref:`→ 'Data Quality Criticity Level' in Conceptual model<concept-remediation-criticity>`


.. image:: /_static/img/dqe-logical-rm_criticity.png
   :alt: Logical Data Model - rm_criticity
   :align: center

.. raw:: html

   <embed><br/><br/></embed>

.. image:: /_static/img/dqe-physical-rm_criticity.png
   :alt: Physical Data Model - rm_criticity
   :align: center

.. raw:: html
   
   <embed><br/><br/></embed>



* 'rm_resolution' table