Verified Answers

If an answer to your question is correct, click on "Verify Answer" under the "More" button. The answer will now appear with a checkmark. Please be sure to always mark answers that resolve your issue as verified. Your fellow Community members will appreciate it! Learn more

  • State Verified Answer
  • Replies replies
    2
  • Subscribers subscribers
    9
  • Views views
    391
  • Users 0 members are here
  • Locked Locked
Related
Options
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

(Re)indexing for the new Solr8 makes LARGE logs

Andy Konecny
 

Before launching any re-index such as the migration to the new Solr8 index, make sure you have lots of space where ever your retain-tomcat logs are collecting.

I hit it the hard way that this indexing is taking more than a few years worth of logging space and ran HARD into those limits (Retain stopped when it got to 5GB free space left)

I started one migration after the Ed's webinar running through it Tuesday, and only up to 35% done 2 days later.  Should be finished over the weekend now that there won't be pauses due to space issues.

________________________

Andy of KonecnyConsulting.ca in Toronto
Please use the "Like" and/or "Verified Answers" as appropriate as that helps us all.

  • Verified Answer

    +1  

    I had opened a case some time ago because re-index showed a lot of errors and log directory was exploding. This is one support's (Georg) hints.

    Go to RetainServer/WEB-INF/solrweb8/WEB-INF/classes and edit 'log4j2.xml'.

    You will find these lines near to the end:

    <Loggers>
                    <Root level="debug"> 
                          <AppenderRef ref="latestSolrFileAppender" /> 
                  </Root>       
    </Loggers>

    Change debug to error!

    So your file should be similar to this one:

    Restart retain-tomcat!

    Use "Verified Answers" if your problem/issue has been solved!

  • 0   in reply to   

    ahh,  the dreaded 'debug' setting bugging us

    looks like Solr7 doesn't log quite as much as Solr8 as I had run a re-index a few years back on the same space. 

    Now that I've already made space changes, I don't really need to in this case,  but will so be saving this for any other complete indexing runs.

    This system now up to 42% as it crawls the TB of old mail.

    ________________________

    Andy of KonecnyConsulting.ca in Toronto
    Please use the "Like" and/or "Verified Answers" as appropriate as that helps us all.

Resources

Support
Documentation
Learning Services
Partner Programs
Privacy
Compliance
Help
Company
Privacy Policy
Terms of Use
Cookies Preferences
Accessibility
Anti-Slavery Statement
Support
Contact Us
Careers
Code of Business Conduct and Ethics
The opinions expressed above are the personal opinions of the authors, not of OpenText. By using this site, you accept the Terms of Use. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.), Hewlett Packard Enterprise Company, or Micro Focus. As of January 31, 2023, the Material is now offered by OpenText, a separately owned and operated company. Any reference to the HP, Hewlett Packard Enterprise/HPE, and Micro Focus marks is historical in nature and the HP, Hewlett Packard Enterprise/HPE, and Micro Focus marks are the property of their respective owners.