Timeliness and Conformity Rules

Timeliness & Conformity Rules

In this series of detailed workshops we're going to:

• Understand the business value and ROI of implementing business rules

• Master the 7 Data Quality Dimensions in PDC

• Create and configure business rules with detailed step-by-step guidance

• Implement rule actions (Status, Tags, Webhooks) and understand their purpose

• Organize rules using rule groups for operational efficiency

• Monitor and interpret rule execution results for continuous improvement

x

---

Accessing your Catalog

To get started using the Data Catalog, log in using the address and credentials provided by your Data Catalog service user or administrator.

To access your catalog, please follow these steps:

1. Open Google Chrome web browser.

2. Navigate to:

https://pdc.pentaho.labpdc.pentaho.lab

1. Enter following email and password, then click Sign In.

Username: [email protected] (mapped to Business Steward role)

Password: Welcome123!

---

x

x

Recent Order Activity

Recent Order Activity

Scenario: Monitor that orders are being processed within expected timeframes.

Business Rule Configuration:

Rule Name: Order_Processing_Timeliness
Description: Ensures orders are shipped within 7 days of order date
Data Quality Dimension: Timeliness
Schedule: Daily
Target: Sales.SalesOrderHeader

SQL Query:

SELECT 
    COUNT(*) AS total_count,
    SUM(CASE 
        WHEN Status = 5  -- Shipped
        AND DATEDIFF(day, OrderDate, ShipDate) <= 7
        THEN 1 
        WHEN Status < 5  -- Not yet shipped
        AND DATEDIFF(day, OrderDate, GETDATE()) <= 7
        THEN 1 
        ELSE 0 
    END) AS scopeCount,
    SUM(CASE 
        WHEN Status = 5 
        AND DATEDIFF(day, OrderDate, ShipDate) > 7
        THEN 1 
        WHEN Status < 5 
        AND DATEDIFF(day, OrderDate, GETDATE()) > 7
        THEN 1 
        ELSE 0 
    END) AS nonCompliant
FROM Sales.SalesOrderHeader
WHERE OrderDate >= DATEADD(month, -1, GETDATE())  -- Last month's orders

---

x

Phone Numbers

Incomplete Product Information

Scenario: Enforce standard phone number format across all records.

Business Rule Configuration:

Rule Name: Phone_Number_Format_Conformity
Description: Validates phone numbers follow standard format pattern
Data Quality Dimension: Conformity
Schedule: Weekly
Target: Person.PersonPhone

SQL Query:

SELECT 
    COUNT(*) AS total_count,
    SUM(CASE 
        WHEN PhoneNumber LIKE '[0-9][0-9][0-9]-[0-9][0-9][0-9]-[0-9][0-9][0-9][0-9]'
        OR PhoneNumber LIKE '([0-9][0-9][0-9]) [0-9][0-9][0-9]-[0-9][0-9][0-9][0-9]'
        THEN 1 ELSE 0 
    END) AS scopeCount,
    SUM(CASE 
        WHEN PhoneNumber NOT LIKE '[0-9][0-9][0-9]-[0-9][0-9][0-9]-[0-9][0-9][0-9][0-9]'
        AND PhoneNumber NOT LIKE '([0-9][0-9][0-9]) [0-9][0-9][0-9]-[0-9][0-9][0-9][0-9]'
        THEN 1 ELSE 0 
    END) AS nonCompliant
FROM Person.PersonPhone

---

x

x

x

First Tab

x

Second Tab

x