Importing a Folder, Task, Data Flow, or Pipeline

Import a folder, task, data flow, or pipeline to a project or folder in Data Integration.

When importing, you have the option to exclude importing data assets that already exist in the target. If you exclude existing data assets in an import request, Data Integration performs the following actions:

  • If source objects have references to data assets that are already present in the target, Data Integration does not import those data assets or touch the existing data assets in the target.

  • If source objects have references to data assets that are not present in the target, Data Integration imports those data assets to the target. This ensures that objects such as data flows load correctly in the target after importing for the first time. In subsequent imports to the same target, this ensures that only new source data assets are imported to the target.

Before importing a folder, see Considerations When Using Export and Import for information about objects that have references to objects across folders in a project.

To import a folder, task, data flow, or pipeline, specify the exported object's zip file and its Object Storage location. Ensure that you have the relevant permissions and IAM policies as described in Required Setup and Policies.

Note

  • To import a whole project and its contents, see Importing a Project.

  • To import a task, data flow, or pipeline into an existing folder, navigate to the Folders list where the folder is listed in the project. Then click the Actions menu (Actions menu) of the folder and select Import.

    1. Navigate to the workspace in which you want to import a folder, task, data flow, or pipeline.

      For the steps to access a workspace, see Accessing a Workspace.

    2. On the workspace home page, click Projects.
    3. On the Projects list, perform any one of the following actions:
      • To import objects into a project, click the Actions menu (Actions menu) of the project that you want to import to and select Import.
      • To import a folder or objects into an existing folder, click the name of the project. Then follow these steps:
        1. On the project details page, click Folders.
        2. (Optional) Click the name of the folder.
        3. On the Folders list, perform one of the following actions:
          • To import a folder, click Create folder and select Import.
          • To import a task, data flow, or pipeline into an existing folder, click the Actions menu (Actions menu) of the folder that you want to import to and select Import.
    4. In the import panel that appears, enter the following details:
      • Tenancy OCID: Enter the Oracle Cloud ID of the tenancy that has the exported zip file that you want to import.

        The namespace is a system-generated value based on the tenancy OCID that you enter.

      • OCI region: Select the region in the tenancy.
      • Compartment: Select the compartment with the Object Storage bucket that contains the exported zip file.
      • Bucket: Select the bucket.
      • File name: Enter the file name of the exported object's zip file.

        Depending on the object type that you're importing, the file name must end with:

        • .folder.zip for a folder

        • .task.zip for a task

        • .dataflow.zip for a data flow

        • .pipeline.zip for a pipeline

    5. Select the action to perform if the exported zip file (source) contains objects with the same name as the objects in the target.

      During an import request, Data Integration uses the identifier values of source and target objects to match objects, and performs the import using the conflict resolution option that you specify.

      • Retain: Retains the objects that exist in the target.

        Source objects (including dependencies) with the same names are not imported to the target.

      • Replace: Replaces the target objects with the source objects.

      • Duplicate: Duplicates the source objects in the target by using the source object names with the strings that you provide for a prefix, suffix, or both.

        • String for prefix: The string is added to the beginning of the source name, for example, string_sourceName
        • String for suffix: The string is added to the end of the source name, for example, sourceName_string

        If you don't add either a prefix or a suffix, a prefix of the following format is added to the beginning of the imported object name in the target: IMPORTPREFIX_1234555

    6. Select the Exclude existing data assets checkbox if you don't want to import data assets that are already present in the target.

      When the checkbox is selected, Data Integration imports to the target only those source data assets that are not present in the target. Data assets that are already present in the target are not imported.

    7. Click Import.

      A notification message appears with a View import requests link. Click the link to monitor the request status on the Export/Import requests page. See Monitoring Export and Import Requests.

  • Use the oci data-integration import-request create command and required parameters to import the object:

    oci data-integration import-request create [OPTIONS]

    For a complete list of flags and variable options for CLI commands, see the Command Line Reference.

  • Run the CreateImportRequest operation with the appropriate request details to import the object.