action=list not returning a complete list

My database shows 14000 documents

When I do an export I get 14000 documents (same number as shown in the console)

However when I ask either the IDOL Content Server or QMS I receive 9954 results. The documentation says specifying MaxResults=0 is Infinite.  I've also tried 15000 and still I get 9954 results.

https://server:port/a=List&DatabaseMatch=myDB&Print=Fields&PrintFields=DREREFERENCE&MaxResults=0

I've done a comparison between the two result sets and I have not found a reason why approx 1/3 of the items are not returned.

Is there a way, other than doing an export, to get a full list?  Is there a way to do an export and get the results through the REST call and not written to disk?

  • Hi Bowker,

    It wasn't clear where you were getting some of the numbers in your post. 

    In your list command you were targeting one database, do you by chance have more than one DB in your content engine? This could be one reason for the discrepancy.  Something else to consider, some of the totals in the web pages or action commands also count sections and deleted documents. 

    Does action=list get the same result as the list command you posted?
    Have you tried the export and just target the one DB?
    Have you performed an validate and/or compact recently?

     

  • Does action=list get the same result as the list command you posted? - Yes

    Have you tried the export and just target the one DB? - Yes

    Have you performed an validate and/or compact recently? - No, not a validate.  Can you help me with the command(s) to do the validate?

  • Verified Answer

    Hi Bowker,

    Please make sure you have a good backup before you proceed.

    Browse to http://server:port/a=admin

    I've added 2 duplicate documents here.

    Admin.PNG

    Documents and Committed Documents show different values.

    On the lower-right you'll see Sync/Compact.

    Sync.PNG

    Select sync, then you'll see Validate and Compact

    Val.PNG

    Select Validate (choose what you want to validate) and select OK.

    The bottom of the screen we show progress, please wait until it's finished. 

    Then Select Compact, again please wait until everything is finished.

    If duplicate documents are what is causing the discrepancy, you'll the numbers match.

    Admin-2.PNG

    Command Documentation: https://www.microfocus.com/documentation/idol/IDOL_12_5/Content_12.5_Documentation/Help/#Index Actions/AdministerIndex/_IX_DREVALIDATE.htm

    If you are still seeing the same issue please open a ticket with support.

  • I think it's better - thank you.  The doc vs. committed doc count was off by about 25%.

    Now they're the same.