New Ranks & Badges For The Community!
Notice something different? The ranks and associated badges have gone "Star Fleet". See what they all mean HERE
Highlighted
Admiral
Admiral
374 views

DP 9 IDB Growth

Hello,

We are experiencing a strange sittuation with the growth of IDB 9 with a customer. This Cell manager are hosted in a RHEL 6.5 and is a fresh install, with no upgrades from older versions. See the report of IDB size:

 

Media Management DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Devices                                0.23             65                   unlimited      0%
 Libraries                              0.23              24                   1000             2%
 Cartridges                            16.50            9714                 unlimited      0%
 Compounds                          0.09             0                     unlimited      0%
 Pools                                   1.73               77                    unlimited      0%
 Media                                 156.98            9506               10000000      0%

Catalog DB

 Part                   Allocated Space [MB]     Items Used      Max Items    Used
__________________________________________________________________________________
 Sessions                                77.80          52166      100000000      0%
 Objects                                689.63         203520      500000000      0%
 Object versions                  6045.98         861832      500000000      0%
 Positions                          12989.88    2.11331e+07     1000000000      2%

Archived Log Files

 Directory                                                          Size [MB]    # Files
________________________________________________________________________________________
 /var/opt/omni/server/db80/pg/pg_xlog                   1744.00        110
 /var/opt/omni/server/db80/pg/pg_xlog_archive          96.00          6

Datafiles

 Directory                                                                              Size [MB] Free Disk Space
_________________________________________________________________________________________________________________
 /var/opt/omni/server/db80/idb                                             14993.00       207924.34
 /var/opt/omni/server/db80/pg                                                    19.52       207924.34
 /var/opt/omni/server/db80/jce                                                      7.19       207924.34

Detail Catalog Binary Files

 Directory                                                            Size [MB]     Max Size     Used
_________________________________________________________________________________________
 /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf3               104863.28       204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf4               104550.45      204800.00     51%
 /var/opt/omni/server/db80/dcbf/dcbf1                106011.70       204800.00     52%
 /var/opt/omni/server/db80/dcbf/dcbf5               108230.39       204800.00     53%
 /var/opt/omni/server/db80/dcbf/dcbf2               190174.90       204800.00     93%

Most of tapes are already overwriting with the retentions configured and i don't know why  the IDB was growing  month over month.

The IDB have more than 750GB of data in 18 months of use. In the older Cell Manager thas was used and the IDB stoped with the 100GB of IDB with more than 10 years of use.

-----------
Please assign Kudos
0 Likes
6 Replies
Highlighted
Micro Focus Expert
Micro Focus Expert

Hello  dcampregher,

I would like to make some comments.

" This Cell manager are hosted in a RHEL 6.5 and is a fresh install, with no upgrades from older versions."

What is your exact current DP version - "omnicheck -patches -host <CM HOSTNAME>".

"The IDB have more than 750GB of data in 18 months of use. In the older Cell Manager thas was used and the IDB stoped with the 100GB of IDB with more than 10 years of use."

I may not be able to comment on the "older CM" - not sure if it is still up and functional.

For your current CM with 750GB/18 months - I dont have much data and so I cannot comment that much. What I can suggest are :

1. Update to the latest patches.

2. Run IDB checks

3. Do IDB purge

and then monitor for the next days/weeks/months.

I would also be very much interested on the operations you are running - specifically number of backups and how huge are they.

Maybe monitor the "rate if increase" and then we can know if this is something valid or not.

Looks to be one issue that needs to be investigated further and so maybe you can log a support case.

Hope this helps

Rgds,,

Sherman

Sherman Senin
Customer Support Engineer, APJ
Data Protector
Micro Focus
0 Likes
Highlighted
Micro Focus Expert
Micro Focus Expert

Hello

Keep in mind that new IDB engine needs more or less 4x space than older raima database.

DCBF migration
The DCBF format in Data Protector 8.00 is changed and the DCBFs now contain the file version
information. Additionally, the space requirements for the new DCBFs change as well.
The DCBF size increase depends on various factors, but a rough guideline is an increase of
approximately four times. 

You can see more details into installation guide pages 276-277

Best Regards

0 Likes
Highlighted
Admiral
Admiral

Hello,

I know that the new IDB may be 4 times bigger or more that the 7.X but when we leave the old CM in 7.0X it has the following size:

 

Media Management DB

Table Size [MB] Records Used Records Total Used
_______________________________________________________________________
Devices 0.16 81 128 63%
Libraries 0.09 21 64 33%
Cartridges 5.75 6504 6680 97%
Compounds 0.03 0 128 0%
Pools 0.09 64 128 50%
Media 1.97 6106 6144 99%

Catalog DB

Table Size [MB] Records Used Records Total Used
_________________________________________________________________________
Sessions 18.09 25758 26880 96%
Objects 54.56 140129 171864 82%
Object versions 552.69 648018 685672 95%
Positions 1029.28 5883655 5937600 99%
Filenames 42291.22 383056458 545825280 70%

Extension Files

File Size [MB] Max Size [MB] Path Free [MB]
__________________________________________________________________________________________________________
dirs.dat1 1054.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
dirs.dat2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext2 1696.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn1.ext3 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn2.ext1 962.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn2.ext2 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn3.ext1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fn3.ext2 410.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat1 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat2 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat3 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat4 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat5 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat6 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat7 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat8 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat9 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat10 2047.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat11 1711.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat12 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92
fnames.dat13 0.00 2047.00 /var/opt/omni/server/db40/datafiles/cdb 78700.92

Detail Catalog Binary Files

Directory                                        Size [MB] Max Size Used
_______________________________________________________________________________
/var/opt/omni/server/db40/dcbf      5196.12   10000.00 52%
/var/opt/omni/server/db40/dcbf1    5262.46 10000.00 53%
/var/opt/omni/server/db40/dcbf2    5192.20 10000.00 52%
/var/opt/omni/server/db40/dcbf3    5310.93 10000.00 53%

In summary:

RDS: 44GB

DCBF: 22GB

All the policies are keep the same in the new CM 9.0X and we still monitoring even we start the use, in July 2015. The new IDB has growing and growing like the first report show, and don't stop.

The bigger problem is with the DCBF directories wich are with 600GB today, and increasing.

-----------
Please assign Kudos
0 Likes
Highlighted
Micro Focus Expert
Micro Focus Expert

Hello

Please check one of your DCBF directorioes from point OS point of view .i.e dcbf0 

 

 Directory                                                            Size [MB]     Max Size     Used
_________________________________________________________________________________________
 /var/opt/omni/server/db80/dcbf/dcbf0               104648.42      204800.00     51%

du -hc /var/opt/omni/server/db80/dcbf/dcbf0

You must the same space if this is true it means that DCBF files are protected or are not deleted when are expired. In such case use command omnidbutil -orphan_dcbf for to check if you have orphan files.

Also you can check tapes protection using report command omnirpt -report media_list_extended.

Best regards

 

 

0 Likes
Highlighted
Admiral
Admiral

server:/} du -hc /var/opt/omni/server/db80/dcbf/dcbf0

102G    /var/opt/omni/server/db80/dcbf/dcbf0

102G    total

 

server:/} omnidbutil -orphan_dcbf

CM: server

Local MMDB: server

Configured MMDB: server (local)

Nothing will be deleted.

Fetching DCBF information from IDB...

Found 7445 DCBFs in 6 directories referenced by IDB.

Scanning DCBFs on disk...

Found 7453 DCBFs on disk.

See dcbf.csv for details.

Processing...

See analysis.csv for details.

Done.

-----------
Please assign Kudos
0 Likes
Highlighted
Micro Focus Expert
Micro Focus Expert

Hello

OS is reporting the same size than DP, you don't have orphan DCBF files therefore I believe that you have soem backup running with permanent protection and it is filling your IDB. Please open supprot case for deeper analyze.

 

Best Regards

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.