Having problems with your account or logging in?
A lot of changes are happening in the community right now. Some may affect you. READ MORE HERE
retryW Trusted Contributor.
Trusted Contributor.
510 views

IDOL Re-Index Progress

Jump to solution

Hey,

Unsure if I'm just blind, but can for the life of me find a way to re-open the IDOL Re-index Progress viewer once it's been closed. I'm not sure how it would have shut, as I didn't do it, and the only other person who touches the server is on holidays.

Have been requested for an update on it's progress (as you can probably tell by the number of files, it's a herculean task).

IDOLprogress.png

0 Likes
1 Solution

Accepted Solutions
Highlighted
Sten28 Outstanding Contributor.
Outstanding Contributor.

Re: IDOL Re-Index Progress

Jump to solution

From a HPE CM desktop POV, when running a very large re-index job (especially with 8 threads containing over 2 million records each!) the desktop client will appear to freeze or lock up.

Once this happens, there is little you can do - the desktop will likely become responsive once the indexing process has finished.

That said, despite the lockup, the re-index process will continue to run just fine, as long as you leave the desktop client running.

One way to check to see that your re-index is still running is to check your status folders on your IDOL Content Engines (eg: C:\HPE Content Manager\IDOL\Content Service 1\status). Records scanned by IDOL will go to this folder prior to ingestion into the index. It's likely that you'll have hundreds of thousands of files here, going off your index parameters.

Checking overall progress with a degree of accuracy can be tricky. One method to give you a rough idea is through IDOL HTTP web commands against your content engines (e.g. for Content Engine 1 it would be http://IDOL_CE:9102/action=GetStatistics). If you are comfortably with sifting through the results, you should be able to get an indicative idea of overall completion.

Finally - hopefully you have at least 2 Content Engines set up? Every IDOL CE has a hard limit of 10 million records - you are going to get a hard stop once you reach that point.

Tags (1)
2 Replies
Highlighted
Sten28 Outstanding Contributor.
Outstanding Contributor.

Re: IDOL Re-Index Progress

Jump to solution

From a HPE CM desktop POV, when running a very large re-index job (especially with 8 threads containing over 2 million records each!) the desktop client will appear to freeze or lock up.

Once this happens, there is little you can do - the desktop will likely become responsive once the indexing process has finished.

That said, despite the lockup, the re-index process will continue to run just fine, as long as you leave the desktop client running.

One way to check to see that your re-index is still running is to check your status folders on your IDOL Content Engines (eg: C:\HPE Content Manager\IDOL\Content Service 1\status). Records scanned by IDOL will go to this folder prior to ingestion into the index. It's likely that you'll have hundreds of thousands of files here, going off your index parameters.

Checking overall progress with a degree of accuracy can be tricky. One method to give you a rough idea is through IDOL HTTP web commands against your content engines (e.g. for Content Engine 1 it would be http://IDOL_CE:9102/action=GetStatistics). If you are comfortably with sifting through the results, you should be able to get an indicative idea of overall completion.

Finally - hopefully you have at least 2 Content Engines set up? Every IDOL CE has a hard limit of 10 million records - you are going to get a hard stop once you reach that point.

Tags (1)
retryW Trusted Contributor.
Trusted Contributor.

Re: IDOL Re-Index Progress

Jump to solution

Thanks for the reply.

The desktop client is closed (unsure how that happened as the server shouldn't have been touched by anyone/anything). However the status folder still has loads of files that it's churning through, and all 8 CPUs are still being utilized very heavily by the dih process.

We have 8 content engines, so we are fine on that front (already over 40 mil records :o ). 

I guess I'll just use the web commands against IDOL to get an update on where things are at.

Thanks for the help!

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.