Canvas & Collections

Data Canvas & Collections

Before we start processing the data, let's cover the main features of the Data Canvas - the main viewer for displaying various aspects of the data.

Log into Data Catalog:

https://pdc.pentaho.labpdc.pentaho.lab

Username: [email protected]

Password: Welcome123!

For enhanced security, it is strongly recommended that users avoid saving their login details directly in web browsers. Browsers may inadvertently autofill these credentials in unrelated fields, posing a security risk.

Best Practice

• Disable Autofill: To mitigate potential risks, users should disable the autofill functionality for login credentials in their browser settings. This preventive measure ensures that sensitive information is not unintentionally exposed or misused.

Data Canvas

Use the Data Canvas page to explore and investigate your data.

Highlight the connection: mssql:adventureworks2022.
Click on the Details tab:

As we know the adventureworks2022 database has 5 schemas:

HumanResources: Employee data, departments, payroll
Sales: Orders, customers, territories, sales staff
Production: Products, inventory, manufacturing
Purchasing: Vendors, purchase orders, procurement
Person: Contact information, addresses, demographics

To View schema details: highlight a schema and click on View:

We've only ingested the schema metadata, so the Details are limited until we process the data.

At this stage we have only completed Stage 1: Metadata Ingestion.

In addition, you can enter a search term in the Search field to search for resources such as folders, schemas, tables, files, or fields within the navigation pane.

Collections

A Collection is a way to logically group data assets, such as schemas, tables, and files, so that you can work with them more efficiently. Whether you are analyzing similar datasets or combining diverse data sources, Collections allow you to organize and manage your data entities based on structure or business use case.

Key Characteristics

Collections are designed for business users, not database administrators. They can pull tables from multiple database schemas and present them with business-friendly names and descriptions. Different user roles see different Collections based on their needs - sales teams see sales data, HR sees employee data.

Data Catalog supports two types of Collections:

Dataset: A Dataset is a group of homogeneous data assets, such as tables or files that share the same schema.
Data Collection: A Data Collection is a group of heterogeneous data assets, such as files, tables, or schemas, with different structures.

How is this different?

Instead of writing complex SQL joins across multiple schemas, users browse pre-organized Collections and drag-and-drop the data they need. The system automatically handles the technical complexity behind the scenes.

Business Benefits

Collections enable self-service analytics by making data accessible to business users without technical expertise. They ensure consistent data definitions across teams, improve data governance, and dramatically reduce the time from question to insight. Teams can focus on analysis rather than data preparation.

Customer Analytics Collection

A Customer Analytics Collection might include:

Person.Person - Basic personal information
Person.Address - Customer addresses
Sales.Customer - Customer business data
Sales.SalesOrderHeader - Purchase history summary

Business Value: This gives marketing teams everything they need to analyze customer behavior without understanding table relationships.

Select Collections & Create a New Category.

Select: Create Category & Create.

Repeat to Create a Group - Customer Analytics

Select: Data Canvas
Expand Person & Sales schemas & select:

Schema

Table

Person

Person.Person

Person.Address

Sales

Sales.Customer

Sales.SalesOrderHeader

Click: 'Add to Cart'

Save as Collection.

Select: Customer - Parent Group & Create.

Remember to select: Collection - the tables span several schemas.

View the Details of your Collection.

Click on: Actions.

Once the data has been curated, it can be published as a Data Product.

In practice, Collection creation is typically a collaborative effort:

Business Stewards define the business logic and organize Collections around business processes and analytical needs
Data Stewards handle the technical curation and ensure data quality within Collections
Administrators provide the system setup, user permissions, and governance framework
Business Users provide requirements and feedback on Collection usefulness

Customer 360

A Customer 360 Collection might include:

Tables Included:

Person.Person - Basic personal information
Sales.Customer - Customer business data
Person.Address - Customer addresses
Person.EmailAddress - Contact information
Person.PersonPhone - Phone numbers
Sales.CustomerAddress - Address relationships
Sales.SalesOrderHeader - Purchase history summary
Sales.SalesTerritory - Geographic context

Business Value: This gives marketing teams everything they need to analyze customer behavior without understanding table relationships.

Financial Performance

For finance teams analyzing revenue, costs, and profitability:

Tables Included:

Sales.SalesOrderHeader - Order totals and dates
Sales.SalesOrderDetail - Line item details
Production.Product - Product costs and pricing
Sales.SalesTerritory - Regional performance
Sales.SalesPerson - Salesperson commissions
Purchasing.PurchaseOrderHeader - Cost data
Production.TransactionHistory - Inventory costs

Business Value: Finance can analyze profit margins, sales trends, and cost analysis across products and regions.

Supply Chain & Inventory

For operations teams managing inventory and procurement:

Tables Included:

Production.Product - Product specifications
Production.ProductInventory - Current stock levels
Purchasing.PurchaseOrderHeader - Purchase orders
Purchasing.PurchaseOrderDetail - Purchase details
Purchasing.Vendor - Supplier information
Production.Location - Warehouse locations
Production.TransactionHistory - Inventory movements
Production.WorkOrder - Manufacturing orders

Business Value: Operations teams can monitor stock levels, supplier performance, and production scheduling.

Data Product

A Data Product is the published, production-ready version of a Collection or Dataset in Pentaho Data Catalog. It transforms working data assets into verified, discoverable resources available for broader organizational use through a formal publishing process.

From Collections to Data Product

Collections start as working drafts where data stewards organize related tables and add metadata. Once enriched with quality scores, sensitivity tags, business terms, and trust ratings, they can be published as Data Products. This publishing changes their lifecycle state and makes them globally searchable.

Customer Analytics Collection

The Customer Analytics Collection containing tables:

Person.Person - Basic personal information
Person.Address - Customer addresses
Sales.Customer - Customer business data
Sales.SalesOrderHeader - Purchase history summary

would undergo enrichment - receiving a 75% quality score, PII sensitivity tagging, high trust ratings, and business term mapping. Once these standards are met, it becomes the "Customer Analytics Data Product."

Publishing Criteria

Organizations typically set minimum thresholds like 60% data quality, assigned sensitivity levels, and acceptable trust scores. However, Collections can still be published even if they don't meet all criteria, giving organizations flexibility in their governance approach.

Key Benefits

Published Data Products become globally searchable, carry verified status indicating business readiness, and include enhanced metadata for filtering and discovery. This ensures only validated, well-documented data becomes widely available while maintaining proper access controls based on sensitivity levels.

Business Impact

The publishing process creates clear distinction between work-in-progress Collections and trusted business assets. This helps users identify reliable data for decision-making while ensuring sensitive information like customer PII is properly governed and protected.

PreviousPermissions & Scope NextData Processing

Last updated 6 days ago

Was this helpful?

Data Canvas & Collections

Security Advisory: Handling Login Credentials

Data Canvas

Collections

Customer Analytics Collection

Customer 360

Financial Performance

Supply Chain & Inventory

Data Product