Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
140 changes: 77 additions & 63 deletions content/disaster-recovery.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,111 +15,125 @@ section: software-troubleshooting
tableOfContents: true
---

This article covers ways to extract and save your data in the event of an OS failure, update failure, or similar situation. If you are having issues reaching your login screen, this [article](/articles/login-loop-pop) may be helpful instead.
This guide helps users recover data and restore system functionality after _OS failure, update issues, bootloader errors, or hardware problems._
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
This guide helps users recover data and restore system functionality after _OS failure, update issues, bootloader errors, or hardware problems._
This guide helps users recover data and restore system functionality after _OS failure, update issues, bootloader errors, or hardware problems.


## If you can't boot your installed OS

If you are not able to boot into your installed OS, then we will want to boot from a live disk. If you have Pop!\_OS installed we can use the Pop!\_OS Recovery Partition.
* Pop!_OS
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Pop!_OS
# Pop!\_OS

* Use Recovery Partition: Hold **Spacebar** or press **ESC** at boot menu. Select **Pop!_OS Recovery**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Use Recovery Partition: Hold **Spacebar** or press **ESC** at boot menu. Select **Pop!_OS Recovery**
Use Recovery Partition:
1. Hold <kbd>Spacebar</kbd>or press <kbd>ESC</kbd> at boot menu. Select **Pop!\_OS Recovery**

* **If Recovery is missing:** Create a Live USB from this [link](https://pop.system76.com/).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* **If Recovery is missing:** Create a Live USB from this [link](https://pop.system76.com/).
_If Recovery is missing_: Download Pop!\_OS and create a Live USB from this [link](https://pop.system76.com/).

* Ubuntu
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Ubuntu
# Ubuntu

* **Use Live USB:** Download Ubuntu ISO from this [link](https://ubuntu.com/download) and flash using Rufus or Startup Disk Creator.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* **Use Live USB:** Download Ubuntu ISO from this [link](https://ubuntu.com/download) and flash using Rufus or Startup Disk Creator.
Use Live USB:
1. Download Ubuntu ISO from this [link](https://ubuntu.com/download) and create a live [USB](https://support.system76.com/articles/live-disk) using Rufus or Startup Disk Creator.

* Boot from USB and select **Try Ubuntu**.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Boot from USB and select **Try Ubuntu**.
2. Boot from USB and select **Try Ubuntu**.


### Creating the live disk (Bootable OS)
### Connect to Internet

We can use this [article](/articles/live-disk) to create a live disk of Ubuntu if you aren't using Pop. For more information about accessing Recovery see [here](/articles/pop-recovery). For Ubuntu, refer to this [article](/articles/bootloader).
* Use the **top-right system menu** to connect to Wi-Fi or ethernet.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Use the **top-right system menu** to connect to Wi-Fi or ethernet.
1. Use the **top-right system menu** to connect to Wi-Fi or ethernet.

* A stable connection is recommended for installing backuo tools or uploading data.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* A stable connection is recommended for installing backuo tools or uploading data.
_A stable connection is recommended for installing backup tools or uploading data._


We do not need to chroot into the installed OS to back up data, only mount the OS drive. Once this is done, we can install the software used for the backup process: <u>Deja Dup</u> (see below).
### Mounting the Installed OS
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### Mounting the Installed OS
### Mount the Installed OS Drive


### Connect to the Internet
* If Disk is Encrypted:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* If Disk is Encrypted:
# If Disk is Encrypted:
1. Open a terminal by pressing <kbd>Super</kbd> + <kbd>T</kbd> and type the following commands:


![Top Left Menu](/images/disaster-recovery/Dialog.png)

Use the top-right menu (as shown above) to connect to your Wi-Fi once booted into the live disk.
```bash
sudo cryptsetup luksOpen /dev/sdX ubuntu-root sudo mount /dev/mapper/ubuntu-root /mnt
```

### Mount the installed OS
* If Disk is not Encrypted:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* If Disk is not Encrypted:
# If Disk is not Encrypted:

* Open **Files** > **Other Locations** and locate your system drive.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Open **Files** > **Other Locations** and locate your system drive.
1. Open **Files** > **Other Locations** and locate your system drive.


Once connected to the Internet, open <u>Firefox</u> and access the [bootloader](/articles/bootloader) article.
Then copy and paste the encryption commands (if the OS is encrypted) and the mount commands.
## Backup Tools
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Backup Tools
### Install Backup Software
# Deja Dup
_ Supports local, remote, and cloud backups and has ability to schedule automatic backups._
1. Open **Pop! Shop** if using Pop!\_OS
2. Search for **Deja Dup** in Pop! Shop and download the application. If using Ubuntu, open the **Backups** application, which is also Deja Dup.
# Rsync
_Command line utility that reserves file permissions and supports resumable transfers_
1. Install rsync if not already installed.
```bash
sudo apt install rsync
Recommend replacing lines 45-63 with the above text for clarity and step by step format


> **NOTE:** If you own System76 hardware and/or have a System76 Account, this will also allow you to access Support Tickets, copy/paste commands from those tickets or upload log files, etc.
Deja Dup

## Software
* Available via **Pop!_Shop** or **Ubuntu Software Center**.
* Supports local, remote, and cloud backups.
* Can be scheduled for automatic backups.

Once the drive is mounted, we can install software to back up files.
### Installing Deja Dup

### Deja Dup
* Appears as **Backups** in the Activities menu.

[Déjà Dup](https://wiki.gnome.org/Apps/DejaDup) is a popular, straightforward backup option. It can be used to back up user data locally, remotely, or to a cloud server. It can also be set up to run automatically on a regular basis.
```bash
sudo apt install deja-dup
```

### Rsync
### Rsync (CLI)

[rsync](https://www.digitalocean.com/community/tutorials/how-to-use-rsync-to-sync-local-and-remote-directories) is a popular command-line tool to copy data while keeping the permissions. It is useful if the system is powering down or if you want a command-line tool to copy the files.
* Preserves file permissions and supports resumable transfers

```bash
rsync -avxP \
/path/to/directory/to/backup \
/path/to/directory/for/storing/backup
```
_Note:_ Upload speeds can vary depending on your internet provider, cloud service, or physical location and may even be subject to throttling. For faster and more reliable file transfer, it's recommended to use a wired Ethernet connection whenever possible.

> **NOTE:** Depending on your ISP/Cloud Provider or physical location. Upload speeds may vary or even be throttled. If possible, connect via Ethernet for a faster, more stable connection when transferring files.

#### Installation

To install <u>Deja Dup</u>, search for it in the <u>Pop!\_Shop</u>, <u>Ubuntu Software</u> or run this command:

```bash
sudo apt install deja-dup
```

Once Deja Dup is installed, it will be labeled as "Backups" in the Activities overview.

#### Selecting Data to Backup

With Deja Dup (Backups) open, you can select the folders you wish to save or ignore using the pages listed on the left. By default, Deja Dup will backup your entire home directory, which includes your Documents, Pictures, Music, and Videos folders. It ignores your Downloads folder and any items in the Trash. Use the plus (+) and minus (-) buttons as needed to modify both categories.

![Selecting data to backup in Deja-Dup](/images/backup/deja_selection.png)

#### Choosing a Backup Location

On the **Storage location** page, you can configure the location where your backup will be stored.
### Current backup Tools
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### Current backup Tools
### Additional backup Tool Options


![Selecting a backup location in Deja-Dup](/images/backup/deja_location.png)
While **Deja Dup** remains a top choice for casual desktop users due to its simplicity and built-in GNOME intergration, several other tools offer more flexibility, performance, or control depending on audience.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
While **Deja Dup** remains a top choice for casual desktop users due to its simplicity and built-in GNOME intergration, several other tools offer more flexibility, performance, or control depending on audience.


## Hardware
* **Deja Dup** -- encrypted backups with cloud support (Google Drive, Nextcloud)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* **Deja Dup** -- encrypted backups with cloud support (Google Drive, Nextcloud)

* Timeshift -- ideal for system snapshots and rollback (especially on Ubuntu/Pop!_OS)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Timeshift -- ideal for system snapshots and rollback (especially on Ubuntu/Pop!_OS)
**Timeshift** -- ideal for system snapshots and rollback

* Duplicati -- web-based interface, encrypted backups, supports cloud storage
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Duplicati -- web-based interface, encrypted backups, supports cloud storage
**Duplicati** -- web-based interface, encrypted backups, supports cloud storage


An external or internal drive can be used as a local backup location.
### CLI & Power user Tools
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### CLI & Power user Tools
## Command Line Tools


### External
* BorgBackup -- deduplication, compression, encryption; great for data recovery
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* BorgBackup -- deduplication, compression, encryption; great for data recovery
**BorgBackup** -- deduplication, compression, encryption; great for data recovery

* Restic -- fast, secure, cross-platform; supports many backends (SFTP, AWS, etc.)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Restic -- fast, secure, cross-platform; supports many backends (SFTP, AWS, etc.)
**Restic** -- fast, secure, cross-platform; supports many backends (SFTP, AWS, etc.)

* **Rsync** -- highly customizable; ideal for scripted or incremental backups
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* **Rsync** -- highly customizable; ideal for scripted or incremental backups
**Rsync** -- highly customizable; ideal for scripted or incremental backups


The specs below offer an idea on what to look for when purchasing external storage:
### Enterprise-grade Solutions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
### Enterprise-grade Solutions
## Enterprise-grade Solutions


- USB 3.0/2.0
- Match your OS drive size or larger. If you have a 1TB drive, purchase a 1TB drive or a 2TB+ drive, if you want to store multiple backups.
* Amanda/Zamanda -- centralized backup management, tape support
* Veeam Agent for Linux -- commercial-grade, agent-based backups with recovery tools

### Internal
## Selecting Data to Back Up
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Selecting Data to Back Up
### Select Data to Back Up


If your system included a second drive beside the OS drive, we have this [article](/articles/extra-drive/) that goes over setting up the drive to auto-mount once the OS is either repaired or reinstalled.
If we have the installed OS mounted in the live disk open the <u>Files</u> application then go to ***Other Locations*** to access the secondary drive. Unless you've changed the name of your drive, System76 systems ship with secondary drives labelled "Extra Drive" or "Extra Drive #."
* By default, Deja Dup backs up the **Home** directory.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* By default, Deja Dup backs up the **Home** directory.
By default, Deja Dup backs up the **Home** directory. This excludes **Downloads** and **Trash**.

* Excludes **Downloads** and **Trash**.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Excludes **Downloads** and **Trash**.

* Use + and -- to customize included/excluded folders.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Use + and -- to customize included/excluded folders.
Use (+) and (-) to customize included/excluded folders.


#### Restoring Your Data
## Choosing a Backup Location
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
## Choosing a Backup Location
### Choose a Backup Location


Once we have our data backed up we can reinstall the OS. This [article](/articles/install-pop) goes over the usual install process whether you're intalling from Recovery or a Live Disk:
External Drive
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
External Drive
## External Drive


Now that we reinstalled the OS we can start restoring our data. To restore your data with Deja Dup, select the **Overview** page, then click the **Restore...** button. This will allow you to select the location containing the Deja Dup backup folder, and will copy the data from the most recent backup to its original location.
* Use USB 3.0 or 2.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Use USB 3.0 or 2.0
Use USB 3.0 or 2.0 hard drive that matches the capacity of your current operating system drive.

* Match or exceed the size of you OS drive.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Match or exceed the size of you OS drive.


![Restoring data in Deja-Dup](/images/backup/deja_overview.png)
Internal Drive
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Internal Drive
## Internal Drive


## If the System Doesn't Power On
* Open **Files** > **Other Locations**
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Open **Files** > **Other Locations**
1. Open **Files** > **Other Locations**

* Look for secondary drives or partitions.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Look for secondary drives or partitions.
2. Identify secondary drives or partitions. On System76 devices, secondary drives may be labeled **Extra Drive**.

* On System76 devices, secondary drives may be labeled **Extra Drive**.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* On System76 devices, secondary drives may be labeled **Extra Drive**.

* Refer to your model's service manual to remove the drive.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why remove the drive?

* Use a USB-to-SATA adapter to connect it to another system.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why this step as well?

* Back up data using the steps above.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
* Back up data using the steps above.
### Initiate the Backup

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you have to click a button after you choose a location? A screenshot here would be helpful to finalize the backup process.


Refer to your models [service manual](/articles/guides) for removing the drive(s). Once you have moved the drives containing your data to another system, you can transfer them to an external hard drive (or other location) with the steps in our [backup article](/articles/backup-files).
## If the Drive is the Problem

## What if the Drive is the Problem?
* Stop using the drive immediately.
* Contact a professional data recovery service.

If signs are pointing to the drive itself being the issue, and your files are corrupted, or no longer accessible, a data recovery service may be the only viable option. If that is the case, remove the drive, and stop using it until it can be taken to a data recovery site. Continued use of the drive may exacerbate bad sectors, or overwrite existing, partially retrievable data.
_Note:_ System76 and Ubuntu do not offer or partner with recovery service. Drive manufacturers may offer recovery options under warranty.

> **NOTE:** Data recovery services are not guarantees of data recovery, and may be cost-prohibitive for some users. System76 is not a data recovery service. Nor do we partner with any. A data recovery service is not a substitute for having robust backups. However, your drive manufacturer may provide data recovery services as part of your service agreement or warranty.
### Set Up Scheduled Backups

## Future Steps
Use Deja Dup or rsync to automate backups on a daily or weekly schedule. This ensures your data is protected without manual effort.
Follow the **3-2-1** Backup Rule
To protect your data against hardware failure, theft, or unexpected events:

Now that we have our data, and a clean install of the OS, let's prepare for if this issue happens again. It's good practice to set up scheduled backups. Our [backup article](/articles/backup-files) can help.
* **3 total copies** of your important files
* **2 stored locally** (e.g., internal drive + external USB)
* **1 stored off-site**, such as:
* A cloud storage service (e.g., Dropbox, Google Drive, Backblaze)
* An external drive kept at a trsuted relative's house
* A secure location like a safety deposit box
**This layered approach ensures that even if one or two copies are compromised, your data remains recoverable.**

> **NOTE** Good practice to prevent data loss is to ensure that any important files are backed up in at least three (3) places. Two (2) copies on-site, and one (1) copy off-site. This off-site backup could be through a cloud storage solution, or a drive that's kept at a relative's house, or in a safety deposit box.
## Restoring Data after Reinstall

<!--Rsync/Your Script? Let's also link to the service manuals page in case they need to pull the drive.-->
1. Open **Backups**.
2. Click **Restore**
3. Select the backup location.
4. Deja Dup will restore the most recent backup to its original location.