DP 9 IDB Growth

[dcampregher]

Hello,

We are experiencing a strange sittuation with the growth of IDB 9 with a customer. This Cell manager are hosted in a RHEL 6.5 and is a fresh install, with no upgrades from older versions. See the report of IDB size:

Media Management DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Devices                                0.23             65                   unlimited      0%
 Libraries                              0.23              24                   1000             2%
 Cartridges                            16.50            9714                 unlimited      0%
 Compounds                          0.09             0                     unlimited      0%
 Pools                                   1.73               77                    unlimited      0%
 Media                                 156.98            9506               10000000      0%

Catalog DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Sessions                                77.80          52166      100000000      0%
 Objects                                689.63         203520      500000000      0%
 Object versions                  6045.98         861832      500000000      0%
 Positions                          12989.88    2.11331e+07     1000000000      2%

Archived Log Files

 Directory                                                          Size [MB]    # Files
________________________________________________________________________________________
 /var/opt/omni/server/db80/pg/pg_xlog                   1744.00        110
 /var/opt/omni/server/db80/pg/pg_xlog_archive          96.00          6

Datafiles

 Directory                                                                              Size [MB] Free Disk Space
_________________________________________________________________________________________________________________
 /var/opt/omni/server/db80/idb                                             14993.00       207924.34
 /var/opt/omni/server/db80/pg                                                    19.52       207924.34
 /var/opt/omni/server/db80/jce                                                      7.19       207924.34

Detail Catalog Binary Files

 Directory                                                            Size [MB]     Max Size     Used
_________________________________________________________________________________________
 /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf3               104863.28       204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf4               104550.45      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf1                106011.70       204800.00     52%
 /var/opt/omni/server/db80/dcbf/dcbf5               108230.39       204800.00     53%
 /var/opt/omni/server/db80/dcbf/dcbf2               190174.90       204800.00     93%

Most of tapes are already overwriting with the retentions configured and i don't know why  the IDB was growing  month over month.

The IDB have more than 750GB of data in 18 months of use. In the older Cell Manager thas was used and the IDB stoped with the 100GB of IDB with more than 10 years of use.

[ShermanSenin_DP_L3]

Hello  dcampregher,

I would like to make some comments.

" This Cell manager are hosted in a RHEL 6.5 and is a fresh install, with no upgrades from older versions."

What is your exact current DP version - "omnicheck -patches -host <CM HOSTNAME>".

"The IDB have more than 750GB of data in 18 months of use. In the older Cell Manager thas was used and the IDB stoped with the 100GB of IDB with more than 10 years of use."

I may not be able to comment on the "older CM" - not sure if it is still up and functional.

For your current CM with 750GB/18 months - I dont have much data and so I cannot comment that much. What I can suggest are :

1. Update to the latest patches.

2. Run IDB checks

3. Do IDB purge

and then monitor for the next days/weeks/months.

I would also be very much interested on the operations you are running - specifically number of backups and how huge are they.

Maybe monitor the "rate if increase" and then we can know if this is something valid or not.

Looks to be one issue that needs to be investigated further and so maybe you can log a support case.

Hope this helps

Rgds,,

Sherman

[JBasilio]

Hello

Keep in mind that new IDB engine needs more or less 4x space than older raima database.

DCBF migration
The DCBF format in Data Protector 8.00 is changed and the DCBFs now contain the file version
information. Additionally, the space requirements for the new DCBFs change as well.
The DCBF size increase depends on various factors, but a rough guideline is an increase of
approximately four times. 

You can see more details into installation guide pages 276-277

Best Regards

[dcampregher]

Hello,

I know that the new IDB may be 4 times bigger or more that the 7.X but when we leave the old CM in 7.0X it has the following size:

Media Management DB

Table Size [MB] Records Used Records Total Used
_______________________________________________________________________
Devices 0.16 81 128 63%
Libraries 0.09 21 64 33%
Cartridges 5.75 6504 6680 97%
Compounds 0.03 0 128 0%
Pools 0.09 64 128 50%
Media 1.97 6106 6144 99%

Catalog DB

Table Size [MB] Records Used Records Total Used
_________________________________________________________________________
Sessions 18.09 25758 26880 96%
Objects 54.56 140129 171864 82%
Object versions 552.69 648018 685672 95%
Positions 1029.28 5883655 5937600 99%
Filenames 42291.22 383056458 545825280 70%

Extension Files

File Size [MB] Max Size [MB] Path Free [MB]
__________________________________________________________________________________________________________
dirs.dat1 1054.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
dirs.dat2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext2 1696.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext3 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn2.ext1 962.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn2.ext2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn3.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn3.ext2 410.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat2 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat3 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat4 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat5 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat6 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat7 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat8 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat9 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat10 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat11 1711.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat12 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat13 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92

Detail Catalog Binary Files

Directory                                        Size [MB] Max Size Used
_______________________________________________________________________________
/var/opt/omni/server/db40/dcbf      5196.12   10000.00 52%
/var/opt/omni/server/db40/dcbf1    5262.46 10000.00 53%
/var/opt/omni/server/db40/dcbf2    5192.20 10000.00 52%
/var/opt/omni/server/db40/dcbf3    5310.93 10000.00 53%

In summary:

RDS: 44GB

DCBF: 22GB

All the policies are keep the same in the new CM 9.0X and we still monitoring even we start the use, in July 2015. The new IDB has growing and growing like the first report show, and don't stop.

The bigger problem is with the DCBF directories wich are with 600GB today, and increasing.

[JBasilio]

Hello

Please check one of your DCBF directorioes from point OS point of view .i.e dcbf0 

 Directory                                                            Size [MB]     Max Size     Used
_________________________________________________________________________________________
 /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%

du -hc /var/opt/omni/server/db80/dcbf/dcbf0

You must the same space if this is true it means that DCBF files are protected or are not deleted when are expired. In such case use command omnidbutil -orphan_dcbf for to check if you have orphan files.

Also you can check tapes protection using report command omnirpt -report media_list_extended.

Best regards

[dcampregher]

server:/} du -hc /var/opt/omni/server/db80/dcbf/dcbf0

102G    /var/opt/omni/server/db80/dcbf/dcbf0

102G    total

server:/} omnidbutil -orphan_dcbf

CM: server

Local MMDB: server

Configured MMDB: server (local)

Nothing will be deleted.

Fetching DCBF information from IDB...

Found 7445 DCBFs in 6 directories referenced by IDB.

Scanning DCBFs on disk...

Found 7453 DCBFs on disk.

See dcbf.csv for details.

Processing...

See analysis.csv for details.

Done.

[JBasilio]

Hello

OS is reporting the same size than DP, you don't have orphan DCBF files therefore I believe that you have soem backup running with permanent protection and it is filling your IDB. Please open supprot case for deeper analyze.

Best Regards