Backing up large number of small files over network

Hello,

 

We are running DP 8.10. Our full backups are taking days. We are backing up about 3TB of data. Most files are under 300k and I know the directory structure is at least 120K.

 

Like I said we are doing a file level back up. The network link we have is 1Gbps yet we only see speeds of about 100 Mbps during the time of backup.  There is no layer 3 device because the backup server and the server being backed up are on the same VLAN. Why is this moving so slow?

 

Thanks for any help you may be able to offer.

 

P.

Parents
  • As you can see when there are many files it will take a lot more time than if it was just a few files with larger size. This was done with LOG_ALL, so complete filehistory was stored.

     

     

    Run Time ........... 2:42:08
    Backup Speed ....... 2283.77 KB/s

    [Normal] From: BMA-NDMP@<hostname>"ndmp_1" Time: 10/28/2014 4:28:55 PM
    Filesystem Statistics:

    Directories ........ 703094
    Regular files ...... 7030927
    ----------------------------
    Objects Total ...... 7734021
    Kbytes Total ...... 22216524

Reply
  • As you can see when there are many files it will take a lot more time than if it was just a few files with larger size. This was done with LOG_ALL, so complete filehistory was stored.

     

     

    Run Time ........... 2:42:08
    Backup Speed ....... 2283.77 KB/s

    [Normal] From: BMA-NDMP@<hostname>"ndmp_1" Time: 10/28/2014 4:28:55 PM
    Filesystem Statistics:

    Directories ........ 703094
    Regular files ...... 7030927
    ----------------------------
    Objects Total ...... 7734021
    Kbytes Total ...... 22216524

Children
No Data