Data Caching / Diagnostics

Data Caching / Diagnostics

In some systems with extremely slow APIs, Universal Migrator has the ability to cache data to an intermediary cache folder.
The purpose of this cache folder is to allow you to quickly catch back up if your backup is paused, stopped, or otherwise interrupted.

When a cache folder is used, before Universal Migrator talks to an API, it will first check to see if the data exists in the cache folder.  If it does, it will quickly fetch the data from the cache instead of requesting it from the API.  If it doesn't, then it will pull the data from the API and cache it.

In the event that there is an error pulling data (ie. the internet disconnects), nothing from the failed requests will be saved to the cache.  After the pull is complete, just do a brand new pull (with the same cache folder but a brand new database) and anything that was missed the first time will be retrieved.

When using a cache folder, it is important to remember a few things:
1.  If previously-retrieved data is changed in the live system, stale data will be returned.  For this reason, whenever you are using a cache folder, you should make sure your client explicitly knows they should not add/change anything in the source system after you start the backup.
2.  If new data is added, it may not be returned because the response to "What's in the system?" is cached.

    • Related Articles

    • Merging Data into an Existing Application

      This is a highly technical process Experience with SQL queries is necessary to perform Join Migrations. Sometimes you may have customers who have data that needs to be restored into an existing system that is already set up and active. This type of a ...

    • 03.01 - Scoping Topics: What Data Migrates?

      What Data Migrates? The UniversalMigrator.com website is intentionally developed so that you can confidently convey what will and will not migrate. The easiest way to convey this to your client is, while on a Teams meeting, ask them to share their ...

    • 03.11 - Scoping Topics: Can you merge / clean up data?

      Data Sanitation Projects Suck Data sanitation projects tend to take a large number of hours and often results in unsatisfied customers. As a general rule, you should inform the prospect that you provide transportation - not sanitation - services for ...

    • 01 - Undo for selected platforms: Deleting Imported Data

      This article will walk you through deleting data from a system. This functionality is only available for select platforms and should be used with EXTREME CAUTION. Due to the inherent risk involved in deleting data from a customer's system we have put ...

    • 03.05 - Scoping Topics: What order does data migrate?

      When Universal Migrator transfers data, it moves it in layers. This allows the firm to start using the new system as quickly as possible. The very first things that migrate are contact and matter names. When the names are migrated, they initially do ...