Server Fault

Return to Question

added 44 characters in body
Source Link
fejyesynb
fejyesynb
  • 111
  • 2

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc) without transferring all the data each time?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home, that can be incrementally updated like how rsync works by default

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require tar czf homes.tar.gz backups/; mv homes.tar.gz /mnt/external-hdd/backups/homes.tar.gz. That is, tarring and transferring all the data each time.

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc)?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home, that can be incrementally updated like how rsync works by default

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require tar czf homes.tar.gz backups/; mv homes.tar.gz /mnt/external-hdd/backups/homes.tar.gz. That is, tarring and transferring all the data each time.

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc) without transferring all the data each time?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home, that can be incrementally updated like how rsync works by default

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require tar czf homes.tar.gz backups/; mv homes.tar.gz /mnt/external-hdd/backups/homes.tar.gz. That is, tarring and transferring all the data each time.

deleted 36 characters in body
Source Link
fejyesynb
fejyesynb
  • 111
  • 2

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc)?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home, that can be incrementally updated like how rsync works by default

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require rsync -a ...; tar czf homes.tar.gz backups/; rmmv -rfhomes.tar.gz /mnt/external-hdd/backups/homes.tar.gz. That is, using rsync normally, tarring the data, then removing the data (which causesand rsync to transfer all data each time)transferring all the data each time.

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc)?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require rsync -a ...; tar czf homes.tar.gz backups/; rm -rf backups/. That is, using rsync normally, tarring the data, then removing the data (which causes rsync to transfer all data each time).

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc)?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home, that can be incrementally updated like how rsync works by default

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require tar czf homes.tar.gz backups/; mv homes.tar.gz /mnt/external-hdd/backups/homes.tar.gz. That is, tarring and transferring all the data each time.

Source Link
fejyesynb
fejyesynb
  • 111
  • 2

rsync uncompressed to single compressed archive

Question

How can I rsync uncompressed (but highly compressible) data to a single compressed archive (.tar.gz, .zip, etc)?

Current

This is what I am using now:

rsync -a --delete-during "/home/" "/mnt/external-hdd/backups/"

On the local side (/home/), there will be thousands of small text files that are compressible. On the "remote" side (/mnt/external-hdd/backups/), there will be an exact copy of the local side.

Wanted

  • local side: same as before
  • "remote" side: a homes.tar.gz that contains all of the data from /home

I will not be independently accessing specific files from homes.tar.gz. If an issue occurs, I will restore it to whatever homes.tar.gz contains.

This will significantly reduce storage size since data is compressed.

Prefarably, it should not require rsync -a ...; tar czf homes.tar.gz backups/; rm -rf backups/. That is, using rsync normally, tarring the data, then removing the data (which causes rsync to transfer all data each time).

Your privacy

By clicking “Accept all cookies”, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy.