Overview
Extreme scale due to large manifest files can cause issues such as slow loading of file restore options, file restores that take a long time to complete, restores that time out, and problems with synchronization. This article describes what a file manifest is, what causes extreme scale, and what you do to resolve these issues.
About large manifests
A manifest file is a binary file that stores the file paths in the archive. A history data file is a binary file that stores the version information of all backed up files. During the restore process, CrashPlan checks the manifest file to identify the path to use when restoring a file. CrashPlan also checks the history data file to confirm that the file exists and fetches the file for you.
Causes of extreme scale
Backup archives can reach extreme scale due to large manifest files as a result of:
- Backing up file versions at a high frequency
- Retaining more file versions than necessary
- Backing up system or application files (like app data, temp data, system files, and so on) that the CrashPlan app is not designed to back up. For more information, see What should you back up with CrashPlan?.
Recommended solution
You can manage the size of the manifest file and the history data file by updating your file selection, updating frequency and version settings, and changing the Remove deleted files setting. See CrashPlan console settings (CrashPlan) for full details on how to optimize your settings.
Step 1: Change the file selection
Update files and folders in your file selection:
- Open the CrashPlan app.
- Go to Manage files.
- Uncheck the box next to:
- Windows: C:
- Mac: / or Macintosh HD
Do not Save until file selection is complete
After you have deselected your main drive, you must select all the files and folders you want backed up before you save your changes. Deselected files are no longer included in the backup file selection and are permanently deleted from the backup archive the next time daily maintenance runs. Files that have been permanently deleted can't be restored. - Verify any external drives you want backed up are selected.
- Navigate to the files and folders you want backed up. User files are typically stored in a User directory or Home folder.
- Select the check box next to the files and folders you want backed up.
- Click Save.
For detailed instructions, see Change the file selection (CrashPlan).
Step 2: Update frequency and versions settings
Updating the frequency and version settings for your backups can help reduce the size of your manifest file and the history data file, resolving issues with file restores and synchronization.
You can update frequency and version settings from the CrashPlan app or from the CrashPlan console. When adjusting these settings:
- Decrease the number of file versions that are backed up.
- Change the Remove deleted files setting to 90 days.
Step 3: Start archive maintenance
To reduce the size of your backup archive, manually start archive maintenance:
- Sign in to the CrashPlan console.
- Select Administration > Environment > Devices from the menu.
- On the Active tab, select the device for which you want to start archive maintenance.
- From the device details, select the Archive Options icon
. - Select Maintain Archive.
A message informs you that running archive maintenance may cause the archive to become unavailable for restore or backup until maintenance finishes. - Click OK.
Your job is added to the queue.
Next steps
- You can confirm the issue is resolved when you can navigate the restore files options (from the CrashPlan app or the CrashPlan console) without experiencing any slowness. From a technical standpoint, the HDF (History Data File) and FMF (File Manifest File) should optimally each be less than 500mb.
- For more information about how to configure your environment for optimal performance, see CrashPlan console settings (CrashPlan).