Support Tip: Size of the Metastore DB in ControlPoint

0 Likes

ControlPoint 5.x

Situation

If the amount of Data we are ingesting is 35TB, how big should I expect my Metastore database to be so I can plan how much RAM I will need for my ControlPoint database server?

Resolution

If you were ingesting 35TB of data with an average size per file of:
750KB then I would expect the Metastore DB to be 382 GB in size.
1500KB then I would expect the Metastore DB to be 191 GB in size.
3000KB then I would expect the Metastore DB to be 96 GB in size.

So in summary the size of the metastore DB will vary considerably based on the average size of files you are ingesting. If the average file size increases you can ingest fewer files for the same amount of data so the total size of the metastore DB is smaller.

The CP 5.9 Support Matrix mentions the minimum memory you should have for the database server is 32GB.
Some production systems have allocated 128GB to meet their requirements.

Access Support Article here

Tags:

Labels:

Knowledge Docs
Comment List
Related
Recommended