Restore all unique files from a series of monthly (full) tape backups (DP 9)

Management wish to conduct a full audit of everything that has ever been done (!) and I've been tasked with restoring all the final versions of all files (and any that have been deleted) from several dozen full backups that have been backed up to several hundred tapes by SP v9. The OS is HPUX and the tapes are sitting in a 4-drive library.

Is there a straightforward way of doing this?

  • Hi , 

    There is no way to run a backup for only one object with different versions. 

    What you will need to do is run each restore one by one. Using the GUI the restore configuration remains in a tab. So what you can do is run one restore, move to this tab and change the version of the file. 

    Regards, 

  • Hmmmm. Thanks for the reply; I did wonder if that might be the case.

    I'm not sure that's a practical way of doing things, as there are - quite literally! - millions of files.

    One way I thought of doing it was to restore each object's backup in secuential order into the same directory and choosing the "overwrite"option for existing files. This would overwrite all files with their latest versions. But it also means reading several hundred tapes.

    If it's possible to export the contents of the catalogue database, into (say) a tab-delimited file, then I could load it into a database and select all the final versions of all files based on dates/times and names, and then export that file. But is it possible to feed such a file into DP to tell it which files you want?

  • I know DP has a dedupe option when writing to disc. Is it possible to copy the tapes to a series of deduped disk backups, and then restore only the "unique" files from there?

  • Hi,

    The dedupe won't change anything. It's not because data is deduped that the backup catalogs will be different. If you make copies to a dedupe device then you will just have an extra copy of the same object.

    The issue is you also need any file which was deleted any time, right? I guess that means you need to restore every single backup ever made and that with an overwrite option indeed. I didn't test this, but I believe that will be the only way to guarantee every file ever backed up will be restored.

    Anyone else any other idea about this?

    Koen

  • Thanks for the reply.

    Other people must have been confronted with this (or similar) tasks so I'm interested in hearing their experiences.

  • Hi,

    The functionality is actually available. In the restore you can choose to restore the latest available version of the object. The trick now is to make sure "Omit deleted files" is NOT checked in the Options. Like that, you will see all latest versions of any file in your destination folder. This should make your life easy! 

    Koen

  • Hi,

    may be you can compare the output from omnidb:

    root@prosp:/root # omnidb -filesystem prosp.attww.local:/tmp '/tmp' -session 2019/07/23-12 -catalog
    Protection Owner Group Size [B] Time Path
    ========================================================================================
    drwxrwxrwt root root 24576 07/23/19 12:40:54 /tmp
    -rw-rw-rw- root root 131 07/23/19 12:38:52 /tmp/.kc.trace
    srwxrwxrwx sfmdb users 0 07/23/19 12:28:36 /tmp/.s.PGSQL.10864
    -rw------- sfmdb users 49 07/23/19 12:28:36 /tmp/.s.PGSQL.10864.lock
    -rw-r--r-- root sys 6431 03/12/19 10:12:05 /tmp/DPCMInstall_sd.log
    -rw-r--r-- root sys 1260 04/12/17 08:35:55 /tmp/HPE3parinfo.log
    -rw-r--r-- root sys 517209 07/23/19 08:00:21 /tmp/alltapes.txt
    -rw-r--r-- root root 1520 10/18/17 13:50:05 /tmp/cc-sd.log
    -rw-r--r-- root root 3046 10/18/17 13:49:12 /tmp/core_intg-sd.log
    -rw-r--r-- root sys 0 05/20/19 11:19:56 /tmp/crs.out
    -rw-r--r-- root root 1520 10/18/17 13:49:32 /tmp/da-sd.log

    You have filenames, sizes, time&date...

    Mathias

     

     

  • No need to bother about this ... it's done automatically for you by Data Protector! See my previous post.

    Koen

  • Thanks Koen, that's very helpful.

    Presumably it would need to be done for every object "by hand" so to speak?

    I'm also wondering if DP is "smart" enough not to want to restore from temp directories. If not, then (as these are constantly changing and files are being constantly created & deleted) it will restore all of these as well as useful user data!

  • Well, you can select object version (or "Latest" in your case) on the top level folder .... But that should be the default selection actually. You just need to make sure that "Omit" option is not selected and you're ready to go. It cannot get much easier I would say.

    Not sure what you mean by "not to want to restore from temp directories". If you literally mean a directory called "temp" then it should be possible to get that excluded.

    Koen