EDG Backup and Restore

There are 2 options for backup and restore in EDG. The first is the built-in backup and restore utility in EDG. The second is a manual process. The same steps and options to backup EDG are also applicable for Explorer.

EDG Backup and Restore Utility

The backup and restore utility is available for Administrators of EDG to take backups of the collections in the workspace and restore from a backup if needed. Restores should be reserved for disaster recovery purposes. Please test this utility in a development environment to get familiar with the process. Note, this is memory intensive. If your server is low on memory, the restore could fail. We recommend manually running garbage collection prior to a restore through the memory management page. This feature should not replace any existing backup strategy you have for your organization, only supplement and enhance it.

Important details prior to using this feature:

  • Backups can be downloaded to local machine of user or stored in AWS S3 bucket. They are also stored in Tomcat\webapps\edg\config\restore folder upon doing a restore. This is in case of rollback.

  • If you are doing frequent restores, please clear this folder out periodically to save disk space.

  • Everything in the workspace will be backed up/restored besides EDG system files and configurations.

  • During the restore process, if there are any TDB databases (including new collections you have created) in the system that do not exist in the backup you are restoring, they will be cleared. Any other files in custom projects will remain, regardless of if they were in the backup or not.

  • This feature is only available for TDB backed data, not RDBMS.

  • Data Platform backup and restore is available but requires manual intervention for restore. See steps below.

  • Once a restore is in progress do not navigate away from the page or shutdown the server. It may take time to do the restore, so please let it finish. If you get an error then you may have to restart Tomcat.

Utility Backup

Simply follow the instructions on the backup and restore page from Server Administration for TDB or Data Platform. Or use a Post call to edg/tbl/backupProjects via API.

curl –location –request POST ‘http://server/edg/tbl/backupProjects’ \ 2–header ‘Authorization: Basic xxxxxxxxxxxxxxxx’

Utility Restore

TDB Restore steps

Simply follow the instructions on the backup and restore page from Server Administration.

or Post call to /edg/tbl/restoreProjects via API.

Example:

curl –location -F “file=@backup-project-17143359091279321948-.zip” -F “skipBackupPreRestart=false&skipBackupPostRestart=false” –header “Authorization: Basic XXXXXXXXXXXX” -X POST https://server/edg/tbl/restoreProjects

Data Platform Restore steps

  • Shutdown EDG nodes and Data Platform

  • Download the backup locally, and unzip

  • Take dp-server.zip from the backup

  • Copy it to the DP server file system

  • Unzip it

  • Move the data in the unzipped folder to whatever you used for –base, if necessary

  • Re-zip the rest of the backup (minus dp-server.zip) for use on each EDG node

For each EDG node:

  • Ensure Data Platform is offline

  • Ensure tomcat is shut down on all EDG nodes.

  • Place the rest of the backup(from step 7 above) in this location in the Tomcat EDG directory ~/WEB-INF/restore/ for the primary EDG node. Create this directory if it doesn’t exist.

  • In the workspace for this primary EDG node, delete the Zone folder and _Data folders

  • Start Tomcat on the primary EDG node

  • Once Tomcat has fully started on the primary EDG node, start Data Platform.

  • Test to ensure the data looks correct and is syncing to the Data Platform.

  • Once verified, in the remainder of the EDG nodes workspaces, move the workspace outside of the directory so that EDG will create a new one.

  • Start each EDG node and let it sync.

Manual Backup

TDB

  • Stop your EDG server, because the backup must occur offline.

  • Backup your entire workspace, by performing a tar or zip operation on it. This will also backup the TDB databases with it.

  • Start EDG backup once all of the above steps have been completed.

  • Data Platform

  • Stop your EDG servers, because the backup must occur offline.

  • Backup your entire workspace, by performing a tar or zip operation on it.

  • Backup your Data Platform database.

  • Store these two files together offline.

  • Start EDG backup once all of the above steps have been completed.

RDBMS

  • Backup your entire workspace, by server snapshot or other.

  • Backup your configured database. See your RDBMS manufacturer’s website for more information. NOTE: Be sure to backup the correct database/schema, as configured for your EDG server.

  • Store these two files together offline.

Manual Restore

TDB

  • Stop EDG server.

  • Locate and delete (or move out of the directory) your current EDG workspace.

  • Replace the existing EDG workspace with your backed-up copy.

  • Start EDG server.

Data Platform

  • Stop EDG server.

  • Stop DP server.

  • Locate and delete (or move out of the directory) your current EDG workspace.

  • Replace the existing EDG workspace with your backed-up copy.

  • Replace your Data Platform database with your backed-up copy.

  • Start DP server.

  • Start EDG server.

RDBMS

  • Stop EDG server.

  • Locate and delete (or move out of the directory) your current EDG workspace.

  • Replace the existing EDG workspace with your backed-up copy.

  • Restore your database from the backup. See your DBA for this step

  • Start EDG server.