Modeling with Hub Central

Overview

A typicalData Hub data flow involves the following operations:
  1. Load/Ingest your raw data intoMarkLogic Server.
  2. Create an entity model to standardize your data fields.
  3. Map the fields in your raw data to the fields of the entity model.
  4. (Optional) Match and merge duplicates.

Theentity model is a core component of data integration inMarkLogic Data Hub. It defines the standard structures (entity types) that would be populated with values from your raw data, so that your data components can be accessed uniformly regardless of the format and structure of the source.

Note: You must create one or more entity types before you can define the mappings between your source data and the curated data.

The entity type is comprised ofentity properties, which can be of any of the following types:

  • A basic data type, includinginteger,string,dateTime,boolean, and other less common string, number, and date types (underMore string types,More number types, andMore date types).
  • Astructured type, which is comprised of its own properties, which can also be of other structured types. Use a structured type if the values of its properties will change for every entity instance. For example, the propertyFullName of the entityEmployee could be a structured type, because each employee would have a different full name.

    The depth of nested structured types is not limited.

  • Arelationship type, which links to an entity of the selected type. Use a relationship type if the properties of the target entity must be the same for all entities that point to it. For example, the entityOrder could point to the entityProduct as a relationship type, because the SKU and product description will be the same for all customer orders.

Hub Central - expanded Customer entity type with structured types all the way down

Learn more:Entities

Security

You must be assigned the following security roles:

  • To view, create, edit, or delete an entity model:Hub Central Modeler

Or any role that inherits the required role. SeeUsers and Roles.

Modeling Process

To integrate your data,

  1. To create an entity type, seeCreate an Entity Type.
  2. Use the entity type tocurate your data.

Managing Entity Types


Hub Central - Entity Type list

To edit an entity type, seeEdit Entity Type.

To manage the properties of an entity type, seeManage Entity Properties.

To publish changes,

  • Go to theModel area of Hub Central.
    Learn how.
    1. Go to your Hub Central endpoint.
      Note: Disregard this step if you are working from an on-prem environment. See Step 1b.
    2. In the icon bar, click theModel icon ().
      Hub Central - icon bar - Model

  • To publish all your changes to all entity types, clickPublish.

To delete an entity type,

  1. Go to theModel area of Hub Central.
    Learn how.
    1. Go to your Hub Central endpoint.
      Note: Disregard this step if you are working from an on-prem environment. See Step 1b.
    2. In the icon bar, click theModel icon ().
      Hub Central - icon bar - Model

  2. In the list, clickthe Delete icon () for the entity type to delete.
Important:

If an entity type has already been used to map or match and merge data, then modifying or deleting it might trigger a reindexing of all your curated data and might affect the results of mapping and mastering processes that are occurring concurrently.

MarkLogic recommends scheduling a time to modify or delete used entity types when the impact would be minimal.