DP 9 IDB Growth

Hello,

We are experiencing a strange sittuation with the growth of IDB 9 with a customer. This Cell manager are hosted in a RHEL 6.5 and is a fresh install, with no upgrades from older versions. See the report of IDB size:

 

Media Management DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Devices                                0.23             65                   unlimited      0%
 Libraries                              0.23              24                   1000             2%
 Cartridges                            16.50            9714                 unlimited      0%
 Compounds                          0.09             0                     unlimited      0%
 Pools                                   1.73               77                    unlimited      0%
 Media                                 156.98            9506               10000000      0%

Catalog DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Sessions                                77.80          52166      100000000      0%
 Objects                                689.63         203520      500000000      0%
 Object versions                  6045.98         861832      500000000      0%
 Positions                          12989.88    2.11331e 07     1000000000      2%

Archived Log Files

 Directory                                                          Size [MB]    # Files
________________________________________________________________________________________
 /var/opt/omni/server/db80/pg/pg_xlog                   1744.00        110
 /var/opt/omni/server/db80/pg/pg_xlog_archive          96.00          6

Datafiles

 Directory                                                                              Size [MB] Free Disk Space
_________________________________________________________________________________________________________________
 /var/opt/omni/server/db80/idb                                             14993.00       207924.34
 /var/opt/omni/server/db80/pg                                                    19.52       207924.34
 /var/opt/omni/server/db80/jce                                                      7.19       207924.34

Detail Catalog Binary Files

 Directory                                                            Size [MB]     Max Size     Used
_________________________________________________________________________________________
 /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf3               104863.28       204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf4               104550.45      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf1                106011.70       204800.00     52%
 /var/opt/omni/server/db80/dcbf/dcbf5               108230.39       204800.00     53%
 /var/opt/omni/server/db80/dcbf/dcbf2               190174.90       204800.00     93%

Most of tapes are already overwriting with the retentions configured and i don't know why  the IDB was growing  month over month.

The IDB have more than 750GB of data in 18 months of use. In the older Cell Manager thas was used and the IDB stoped with the 100GB of IDB with more than 10 years of use.

Parents
  • Hello

    Keep in mind that new IDB engine needs more or less 4x space than older raima database.

    DCBF migration
    The DCBF format in Data Protector 8.00 is changed and the DCBFs now contain the file version
    information. Additionally, the space requirements for the new DCBFs change as well.
    The DCBF size increase depends on various factors, but a rough guideline is an increase of
    approximately four times. 

    You can see more details into installation guide pages 276-277

    Best Regards

  • Hello,

    I know that the new IDB may be 4 times bigger or more that the 7.X but when we leave the old CM in 7.0X it has the following size:

     

    Media Management DB

    Table Size [MB] Records Used Records Total Used
    _______________________________________________________________________
    Devices 0.16 81 128 63%
    Libraries 0.09 21 64 33%
    Cartridges 5.75 6504 6680 97%
    Compounds 0.03 0 128 0%
    Pools 0.09 64 128 50%
    Media 1.97 6106 6144 99%

    Catalog DB

    Table Size [MB] Records Used Records Total Used
    _________________________________________________________________________
    Sessions 18.09 25758 26880 96%
    Objects 54.56 140129 171864 82%
    Object versions 552.69 648018 685672 95%
    Positions 1029.28 5883655 5937600 99%
    Filenames 42291.22 383056458 545825280 70%

    Extension Files

    File Size [MB] Max Size [MB] Path Free [MB]
    __________________________________________________________________________________________________________
    dirs.dat1 1054.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    dirs.dat2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext2 1696.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext3 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn2.ext1 962.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn2.ext2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn3.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn3.ext2 410.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat2 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat3 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat4 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat5 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat6 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat7 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat8 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat9 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat10 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat11 1711.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat12 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat13 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92

    Detail Catalog Binary Files

    Directory                                        Size [MB] Max Size Used
    _______________________________________________________________________________
    /var/opt/omni/server/db40/dcbf      5196.12   10000.00 52%
    /var/opt/omni/server/db40/dcbf1    5262.46 10000.00 53%
    /var/opt/omni/server/db40/dcbf2    5192.20 10000.00 52%
    /var/opt/omni/server/db40/dcbf3    5310.93 10000.00 53%

    In summary:

    RDS: 44GB

    DCBF: 22GB

    All the policies are keep the same in the new CM 9.0X and we still monitoring even we start the use, in July 2015. The new IDB has growing and growing like the first report show, and don't stop.

    The bigger problem is with the DCBF directories wich are with 600GB today, and increasing.

Reply
  • Hello,

    I know that the new IDB may be 4 times bigger or more that the 7.X but when we leave the old CM in 7.0X it has the following size:

     

    Media Management DB

    Table Size [MB] Records Used Records Total Used
    _______________________________________________________________________
    Devices 0.16 81 128 63%
    Libraries 0.09 21 64 33%
    Cartridges 5.75 6504 6680 97%
    Compounds 0.03 0 128 0%
    Pools 0.09 64 128 50%
    Media 1.97 6106 6144 99%

    Catalog DB

    Table Size [MB] Records Used Records Total Used
    _________________________________________________________________________
    Sessions 18.09 25758 26880 96%
    Objects 54.56 140129 171864 82%
    Object versions 552.69 648018 685672 95%
    Positions 1029.28 5883655 5937600 99%
    Filenames 42291.22 383056458 545825280 70%

    Extension Files

    File Size [MB] Max Size [MB] Path Free [MB]
    __________________________________________________________________________________________________________
    dirs.dat1 1054.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    dirs.dat2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext2 1696.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn1.ext3 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn2.ext1 962.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn2.ext2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn3.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fn3.ext2 410.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat2 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat3 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat4 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat5 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat6 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat7 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat8 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat9 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat10 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat11 1711.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat12 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
    fnames.dat13 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92

    Detail Catalog Binary Files

    Directory                                        Size [MB] Max Size Used
    _______________________________________________________________________________
    /var/opt/omni/server/db40/dcbf      5196.12   10000.00 52%
    /var/opt/omni/server/db40/dcbf1    5262.46 10000.00 53%
    /var/opt/omni/server/db40/dcbf2    5192.20 10000.00 52%
    /var/opt/omni/server/db40/dcbf3    5310.93 10000.00 53%

    In summary:

    RDS: 44GB

    DCBF: 22GB

    All the policies are keep the same in the new CM 9.0X and we still monitoring even we start the use, in July 2015. The new IDB has growing and growing like the first report show, and don't stop.

    The bigger problem is with the DCBF directories wich are with 600GB today, and increasing.

Children
  • Hello

    Please check one of your DCBF directorioes from point OS point of view .i.e dcbf0 

     

     Directory                                                            Size [MB]     Max Size     Used
    _________________________________________________________________________________________
     /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%

    du -hc /var/opt/omni/server/db80/dcbf/dcbf0

    You must the same space if this is true it means that DCBF files are protected or are not deleted when are expired. In such case use command omnidbutil -orphan_dcbf for to check if you have orphan files.

    Also you can check tapes protection using report command omnirpt -report media_list_extended.

    Best regards

     

     

  • server:/} du -hc /var/opt/omni/server/db80/dcbf/dcbf0

    102G    /var/opt/omni/server/db80/dcbf/dcbf0

    102G    total

     

    server:/} omnidbutil -orphan_dcbf

    CM: server

    Local MMDB: server

    Configured MMDB: server (local)

    Nothing will be deleted.

    Fetching DCBF information from IDB...

    Found 7445 DCBFs in 6 directories referenced by IDB.

    Scanning DCBFs on disk...

    Found 7453 DCBFs on disk.

    See dcbf.csv for details.

    Processing...

    See analysis.csv for details.

    Done.

  • Hello

    OS is reporting the same size than DP, you don't have orphan DCBF files therefore I believe that you have soem backup running with permanent protection and it is filling your IDB. Please open supprot case for deeper analyze.

     

    Best Regards