An incremental data load performs a partial update of the data source by adding new or modified data to the cached model. This is suitable in scenarios where only one or more tables in the database change often, and the rest of the data remains unmodified. By default, when you reload the data in a cached model, the data is fully extracted from the data source, which consumes a lot of time and resources.
However, with incremental data load, the amount of time required for refreshing the data gets significantly reduced. In a cached model, the data can be incrementally updated manually or through scheduled tasks.
Also, note that before using the incremental update on a cached model, you should configure the incremental update attribute for the selected entity. In this article, you will learn how to set the incremental update for an entity in a cached model.
To perform incremental data loading in a cached model, you must configure the incremental update entity that refreshes based on the chosen attribute. Since a cached model consists of multiple entities, they can be updated based on different attributes.
Follow the basic steps to delete the incremental update entity from a cached data model.