- July 19, 2023
- Posted by: Sriramvel M
- Categories: Autonomous Datawarehouse Cloud, Data Integration, Informatica
Objective:
The objective of this blog is to help people understand how and by what means we can develop an architecture in IDMC for the successful table load from Oracle On-Prem to Oracle Autonomous Data Warehouse. In this blog post, we will guide you through the step-by-step process on how this process works with screenshots and instructions for better understanding.
Why Autonomous Data Warehouse?
ADW has a wide range of benefits including the following,
- Utilize benefits of cloud-based Data Warehouse.
- Improved performance, Advanced Analytics and Scalability.
- Helps to make better-informed decisions and drive business growth.
Background (mention the privileges needed)
There are some prerequisites before entering this process, which is as follows,
- Privilege to access Administrator environment of IDMC.
- Creation of connections for both Oracle On-Prem and Oracle ADW Cloud.
- A cloud Data Integration Service (DIS) should be up and running in the background for the successful completion of data integration tasks in cloud environment.
For the above-mentioned prerequisites, references have been given at the end of this blog.
Step 1:
Configure the Oracle On-Premises and Oracle ADW connections in IDMC:
- Launch Informatica Data Management Console (IDMC) and navigate to the Administrator tool.
- Set up the connection details for the Oracle On-Premises database as a source connection.
- Configure the connection details for the Oracle ADW instance as a target connection.
- Raise a request and get the necessary details like username, password, host name, schema, port, service name, trust store key and password under which table should be created from Database Administrator who is responsible for the ADW maintenance.
Step 2:
Create a new project in IDMC:
- Create a new project in IDMC to organize your data integration tasks and mappings.
- Specify the project name, description, and other relevant details.
Step 3:
Design the mapping in IDMC:
- Navigate to the Developer tool within IDMC and open the project you created.
- Create a new mapping within the project.
- Drag and drop the source and target connections onto the mapping canvas and select appropriate connections for the destinations.
- Connect the source and target connections using the appropriate transformation objects.
- Apply any necessary transformations, such as filtering, aggregating, or joining, to the data flow.
Step 4:
Validate and test the mapping:
- Validate the mapping to ensure there are no design or connectivity errors.
- Run a test session to verify the data extraction from the Oracle On-Premises database and loading into the Oracle ADW.
Step 5:
Schedule and execute the mapping in IDMC:
- Return to the Administrator tool in IDMC.
- Set up a schedule for the mapping to run at specified intervals or as per your data refresh requirements.
- Execute the mapping either manually or as per the scheduled time.
Step 6:
Monitor and manage the data integration process:
- Utilize the monitoring capabilities of IDMC to track the progress and status of your data integration tasks.
- Monitor any errors or issues that may arise during the data loading process.
- Use IDMC’s logging and reporting features to analyse and troubleshoot any data integration failures.
Conclusion:
By following these steps, you can successfully load data from an Oracle On-Premises database to Oracle Autonomous Data Warehouse using Informatica DI mapping in Informatica Data Management Console (IDMC). IDMC provides a comprehensive platform for managing, scheduling, and monitoring your data integration tasks, ensuring smooth and efficient data loading processes.
References:
Refer the below link to know more about creating connections in IDMC-CDI and DIS services.