Wyn Enterprise User Guide

Wyn Enterprise: Incremental Data Load

An incremental data load performs a partial update of the data source by adding new or modified data to the cached model. This is suitable in scenarios where only one or more tables in the database change often, and the rest of the data remains unmodified. By default, when you reload the data in a cached model, the data is fully extracted from the data source, which consumes a lot of time and resources.

However, with incremental data load, the amount of time required for refreshing the data gets significantly reduced. In a cached model, the data can be incrementally updated manually or through scheduled tasks.

Also, note that before using the incremental update on a cached model, you should configure the incremental update attribute for the selected entity. In this article, you will learn how to set the incremental update for an entity in a cached model.

To Configure Incremental Update Entity

To perform incremental data loading in a cached model, you must configure the incremental update entity that refreshes based on the chosen attribute. Since a cached model consists of multiple entities, they can be updated based on different attributes.

  1. In the data model designer, select the entity for which you want to load the data incrementally.
    Select entity
  2. Go to the Properties tab and set the Incremental Attribute property to any of the existing attribute. The entity updates according to the selected attribute.
    Set Incremental Attribute Property
  3. Navigate to the Incremental Update Entity tab to view all the incremental update entities in the current model along with their attribute name.
    Incremental Update Entity Tab in the Designer

To Delete Incremental Update Entity

Follow the basic steps to delete the incremental update entity from a cached data model.

  1. Navigate to the Incremental Update Entity tab in the model designer.
  2. Click the Delete icon next to the incremental update entity you want to delete.
    Delete Incremental Update Entity

Limitations

  1. A custom SQL entity does not support incremental updates.
  2. An entity can refresh based on one chosen attribute.
  3. The incremental attribute property does not support attributes of bool and GUID data type.
  4. An entity can only set one incremental update attribute.