Create a Data Quality Rule Occurrence using bulk import Template in CDGC

Introduction:

Data Quality Rule Occurrence is a critical component in maintaining the integrity and reliability of data within an organization. In the context of the Cloud Data Governance Center (CDGC), implementing data quality rules ensures that the data being used for analytics and decision-making is accurate, complete, and consistent. Bulk import functionality allows organizations to efficiently manage large volumes of data, streamlining the process of applying data quality rules across extensive datasets. This feature not only enhances operational efficiency but also facilitates the monitoring and reporting of data quality metrics. By leveraging bulk import capabilities, users can establish standardized data quality rules that can be automatically applied to new data as it enters the system, thereby reducing manual oversight and potential errors.

There are two ways to create the Data Quality Rule occurrence ,One way is to create with the help of Business Rules and the another way is to create using the import assets in CDGC.

If we have the business requirement is to create the 25 Data Quality Rule occurrence in CDGC at the time we can prefer the import asset template to import and create the 25 Data Quality Rule occurrence in CDGC.

Below are the steps to create the Data Quality Rule Occurrence using bulk import in CDGC.

1.Download the import template for the Data Quality Rule Occurrence from the Data Governance and Catalog.

Data Governance and Catalog -> New -> Import Assets -> Download Import Template

2.In the import template choose the Data Quality Rule Occurrence and click on Download option.

3. Template has been downloaded in our Local.

4.Open the Template and navigate the Data Quality Rule Occurrence tab and fill in the values of the DQ rule occurrence. The fields marked in red are mandatory, and those values must be entered to create a DQ rule occurrence.

5.Fill in the values of Name, Description, Criticality, Dimension, Lifecycle, Measuring Method, Target, Technical Rule Reference, Threshold, Primary Data Element, Operation etc.

We can take the Primary Data Element values from Catalog source and click the corresponding column, check the Attributes tab under reference id is the value of Primary Data Element.  The Secondary Data Element field can take more than one input, each input is separated by a semicolon(;)

To get the Technical Rule Reference values navigate the Data Quality Service and open the rule specification, we can see the rule reference id in URL.

6.Save the template.Now go to the CDGC service and upload the template file

Data Governance and Catalog -> New -> Import Assets -> Import Assets -> Import

7.Click the import files in CDGC service and upload the saved template file.

8.Template file has been uploaded and click the Start import option to run a job.

9.Once job is completed,the Data Quality Rule Occurrence will be created as expected.

10.Validate the imported Data Quality Rule Occurrence in CDGC services.

Conclusion:

In conclusion, the implementation of Data Quality Rule Occurrence through bulk import in the Cloud Data Governance Center is vital for organizations seeking to enhance their data integrity and reliability. By automating the application of data quality rules to large datasets, organizations can ensure consistency, accuracy, and completeness of their data. This not only streamlines data management processes but also fosters a culture of data-driven decision-making. Ultimately, leveraging these capabilities in CDGC enables organizations to maintain high data standards, thereby driving greater confidence in their analytics and operational strategies.

Please reach out to us for your Informatica solution needs. We are an Informatica Platinum Partner with extensive experience with Informatica implementations and data integration.