Data Processing

Overview

You can extract meaningful insights and ensure the effective utilization of data with Data Catalog processing. The significant stages in the processing of data are:

1. Metadata Ingest

2. Data Profiling (for structured data) and Data Discovery (for unstructured data)

3. Data Identification for structured data, including delimited files

4. Usage Statistics for the Microsoft SQL and Oracle databases

5. PII Detection

Processing the data

---

1. Log into Data Catalog:

https://pdc.pentaho.labpdc.pentaho.lab

Username: [email protected]

Password: Welcome123!

1. Click: Management in the left navigation menu.

Process the Data

1. Select 'Data Canvas' from the left menu option.

2. Click the checkbox to select all the schemas.

Process the schemas

For optimal performance, keep your selection within a practical limit. Processing a very large number of tables, i.e. 100,000, can drastically reduce speed. The default settings on the Configure Data Profiling page generally fulfill most needs and are recommended.

1. Click 'Process'.

Data Processing

---