The purpose of this brief knowledge document is to help understand the disk constraints with ControlPoint and propose layout and distribution recommendations. This concerns the database files for the MetaStore and IDOL that are disk intensive.
Here is a simplified schema of the components involved in the ingestion of files by ControlPoint.
It is important to understand that the disk layout has a strong impact on performance of the overall system. Disk accesses are going through multiple layers. Each of these layers have their own limits.
On each servers of the architecture, there is an operating system, Windows. It is commonly installed on the C: drive. This is accessed by all Windows applications and functions.
ControlPoint will come with its program binaries. The default installation path is on the C: drive, in Program Files\Micro Focus\ControlPoint. This is specified during the installation of the components, like the creation of the IDOL installation package. This can be installed on a separate disk, although the performance impact is not that important. It can be put separate if we want to isolate CP log files. If the log level is set to high value, the writes can be intensive.
Note that each IDOL component has a parameter to define the log directory in its configuration file (.cfg in the folder). File System Connector example:
SQL Server has files containing the database data and transaction logs.
The first recommendation would be to not put these on the same disk as the Operating System (C:) nor the SQL Server application binaries. These must be on separate volumes in order to get the full bandwidth of the disks.
ControlPoint installation process requires five (5) databases to be created in SQL Server. These are not equal in terms of requirements.
One recommendation would be to isolate the MetaStore database from the other ones. This database will be strongly accessed during the ingestion process, especially during full scans. This database can be additionally separated in the Data, Index and Text on one side and the Logs on the other side. Finally, always use SQL Server 2016 partition feature in order to split the MetaStore database in multiple files (the installation tool automatically creates one file per CPU core available on the SQL Server machine).
Example of SQL Server disk layout:
File paths for databases are specified with the Database Configuration tool from CP install:
IDOL Content is the IDOL index database that stores and make available the index.
The first recommendation would be to not put these on the same disk as the Operating System (C:) nor the IDOL Content application binaries. These must be on separate volumes in order to get the full bandwidth of the disks.
We should also make care of separating Content databases on their own disks: each Content on a separate volume. This would help distributing the load on multiple file systems.
Example of IDOL Content disk layout:
IDOL Content disk path is specified when creating the IDOL installation package with the IDOL Deploy Tool:
Click on the first “Config...” button...