Understanding Limitations

Here are some limitations of logical data entities.

• If an Object Storage bucket contains archived files, then you must select the Include unrecognized option to create a logical data entity with only the archived files.
• If you select the Incremental harvest option while harvesting data assets with associated filename patterns, the following changes in your Object Storage are reflected in your data catalog:
  • When new files are added to your Object Storage bucket that match any existing logical data entity, they are added to the logical data entity.
  • When new files are added to your Object Storage bucket that derive new logical data entities, the new logical data entities are created and the files are added to the new logical data entity.
  Note
  
  Incremental harvest for logical data entities doesn't track the changes made to your filename pattern expressions, or the filename patterns associated with the data asset. You must perform a full harvest to be in sync with all the updates.