...
| Info |
|---|
Indexing can be slow if you frequently run Spark scripts with instructions to index summarized data. Sometimes, there can be situations where it is instructed to repeatedly process the same dataset within a small time frame (e.g., Spark scripts scheduled to run every two minutes with indexing). In these situations, the same data is indexed over and over again. To reduce the system overhead by minimizing the unnecessary reindexing, it is recommended to use incremental processing. |
Related Links
- Configuring Data Persistence - For an introduction about persisting data (both records and index data) in WSO2 DAS.
- Configuring Indexes - For detailed information about indexing in WSO2 DAS.