In the previous blog, I explained the details about Oracle Fusion Data Extraction Tool and how it differs from BI Cloud Connector (BICC). We also learned about initial configurations to be performed to enable the Data Extraction tool in your Fusion environment.
Out of the box, Data Extraction tool offers the default storage options such as Universal Content Management (UCM) and Oracle Managed Storage. These two options do not need any explicit configurations and we can use them straight out of the box.
But when it comes to using OCI Object Storage buckets as external storage, it requires a number of configurations to be performed.
In this blog, we are going to understand the step by step process to use the out-of-box storage options like UCM and Oracle Managed Storage, and also to enable customer-managed Storage option, incorporate the Object Storage configurations in OCI and finally connect the Object Storage bucket to the Data Extraction tool.
First, let's take a look at the out-of-box storage options.
Universal Content Management (UCM)
Oracle has mentioned that the support for UCM is provided for compatibility with existing processes, similar to BICC and extract generation using UCM may take longer compared to Oracle Managed Storage. Let's see how to use this storage option.
- Navigate to Tools -> Data Extraction
- Go to Extract Schedules
- Select the desired extract definition to be run
- Under Storage section, select Universal Content Management
- Click Create
- We can monitor the run from Extract Schedules section
- Once completed, navigate to the Extract Jobs tab and note down the Request Id of the job.
- Navigate to the content server of your environment (usually by following your Pod URL followed by /cs)
- Go to Search and search for Title Substring <Job Id copied from above steps>
- Download and open the Manifest (.MF) file
- The Manifest file should list the actual names of the data files generated by our data extract.
- I would normally copy the first number from the file name (usually relates to an internal ESS Job Id). 9835117 in my case.
- Navigate back to the Search and this time search for Title Substring <the copied number> (9835117 in this case).
- With this, you should be able to see the actual data files generated on UCM. You can download, inspect and use them in further processes based on your use-cases.
Oracle Managed Storage
Oracle Managed Storage is the default and recommended option by Oracle. With this, the extract output is written directly to the internal managed storage. Oracle Managed Storage allows you to download the extracted data directly from the application. Let's see how to use this storage option.
- Navigate to Tools -> Data Extraction
- Go to Extract Schedules
- Click Create
- We can monitor the run from Extract Schedules section
- Once completed, navigate to Extract Jobs section and click on the download icon under Actions
- This will bring up a pop-up showing all the data files generated by our Data Extract
- You can download, inspect and use the data files in further processes based on your use-cases.
OCI Object Storage
This is a 3-step process:
- Fusion: Enabling the opt-in feature for customer managed storage
- OCI: Configurations pertaining to the object storage bucket and related policies
- Fusion: Creating a Storage connection to connect to the above bucket
So, let's dive in.
Step 1: Enabling the opt-in feature for customer-managed storage
In order to perform the Storge configurations from within the Data Extraction tool, we first need to activate that feature.- Navigate to Setup and Maintenance
- Switch to 'Manufacturing and Supply Chain Materials Management'
- Click 'Change Feature Opt In'
- Locate the feature 'Redwood: Schedule Data Extracts to Customer Storage Using a Redwood Page
- Let's verify if we are able to see the "Extract Storage" setting in the Data Extraction tool.
- Navigate to Tools -> Data Extraction
- At this stage, we should be able to see Extract Storage tab. This means we've successfully enabled the this feature. We'll come back to this in Step-3.
Step 2: OCI configurations for the object storage bucket and related policies
Let's switch the gears to OCI. We need do configurations related to the bucket and related policies so that it can be accessed by Fusion Data Extraction tool.- Login to your OCI console
- Navigate to Storage -> Buckets
- Create the desired bucket you wish to use in Data Extraction tool storage configurations. Data extraction tool will send the data files over to this bucket.
I've created a bucket named data_extraction_bucket
- Make a note of the bucket name.
- Navigate to Compartments and note down the OCID of your compartment in which the bucket resides.
- Navigate to Identity & Security -> Policies
- Create a new policy, give a relevant name and description.
- We need to create two policy statements in below format:
Statement 1:
Statement 2:
Step 3: Creating a Storage connection in Fusion Data Extraction tool
Let's switch back to Fusion.- Navigate to Tools -> Data Extraction.
- Go to Extract Storage tab
- Click + to create a new storage connection
- Enter Name, Display Name, the actual bucket name and compartment OCID obtained from above steps and lastly a preferred prefix for the data files that will be created on object storage (I'm using test_ as a prefix in my example).
- Click Create. This will validate all the details and complete our object storage connection in the data extraction tool.
Encryption:
Optionally, we can enable the encryption at the source. In order to
There are two options:
1. Customer Managed Keys:
If we wish to use customer managed keys for encryption, we would be expected to have the Keys stored in OCI Vault. We would use the Vault and Secret details in the Data Extraction tool confiuration.
In addition to this, we need to configure the required IAM policy to allow Object Storage to access the encryption key in OCI:
2. Oracle Managed Keys:
If we are using Oracle Managed keys, then we need to mention the key in the config.
Now our Object Storage connection is ready for use.
- Let's navigate to Extract Schedules
- Create a new schedule
- Under Storage options, select OCI Object Storage as Storage, Customer Managed Storage in the second option and select our 'ObjectStorageConnection' for Customer Managed Storage.
- Once we run the Data Extract and it completes, we should be able to see the data file(s) generated in the Object Storage Bucket.
With this, we've covered all the storage configurations available in the Fusion Data Extraction tool. Their usage really depends on requirements of the downstream data integration use-cases.
The Oracle-managed storage or UCM might be sufficient for the customers with a small number of data integrations.
The customer-managed OCI Object Storage might be the right fit for businesses with a larger number of integrations or complex downstream systems.








