Need GWCHECK help/Advise

Using gw12.0.3 Stand alone gwcheck
I copied a user Archive to my local HD ran gwcheck with only Structure and Fix and User,Message options..
After 24 Hrs it did not complete the Checking Blob Files portion.
I restarted again with all options selected, after 30 hrs it seems to be sitting there, doing nothing.
The last log item displayed is "Checking Blob files for validity. This is a Large Archive and contains 540,000 files
the Archive Folder is 45Gb.

Any comments/suggestions?
  • How long did it take to copy this down to your computer?

    As a practical matter the BLOB check is not necessary. If a BLOB is corrupt or not present, the client will throw an error when looking at that particular message. Instead of "checked some options" please tell us exactly which options were used, OR supply the start of the gwcheck log file, which shows the actual options being used. It may be you are checking the blobs anyway.

    Our entire post office, which supports 700 users, has 8,000,000 blobs. And some of these users have never deleted a single message since 1998.

    So 540,000 blobs is a ridiculously large archive. On a physical server, with SSD under the databases, the BLOB check takes days.

    On your laptop? Is 24-48-72 hours reasonable? Mabey! GWCECK creates several intermediate chk logs files, one of them will be the BLOB check. See how far it gets. Perhaps its 99% done when you kill it. If the disk you are using is an external USB disk, writes are committed in-line - so that slows things down even more.

    In the end, this archive is like a monumental boil. Lancing it may take time.

    -- Bob
  • >>>>How long did it take to copy this down to your computer?
    It took about 2 hours to copy to a sub-folder on my PC with an SATA drive from the SAN that contained the Archive.

    >>>>Instead of "checked some options" please tell us exactly which options were used,
    I selected Archive, Analyze/Fix, Message, User. Structure/Contents/Fix.

    >>>>So 540,000 blobs is a ridiculously large archive.
    This users Archive starts in 1997 and they keep everything even bake sale notices, Lol

    GWCheck is running on my PC, the OS is Win7 64bit, 8Gb ram, SATA drive, currently the CPU is 29% and GWCheck is using 25%
    total CPU, only occasional fluctuating
    So I assume it isn't locked up and IS still processing. So I will wait it out as long as the User can do without their Archive.
    By the way Thank You for trying to help!
    any other suggestions will also be appreciated!
  • I agree with Bob...Patience is required when using GroupWise tools...especially with an archive of this size...


  • I'm really trying to be patient, but it is still running for 64 hrs with no real sign of being locked up (or Processing other that gwcheck using 25% of the CPU time).
    I will assume I should still sit and wait it out and the time it is taking is solely related to the enormous size of the archive.
    But this is where I'm at in case someone has a suggestion for me.
    The Progress Screen's last item says "Checking Blob files for validity"
    The log file has this:
    Novell GroupWise - GWCHKARC - Version 12.0.3
    Processed on Saturday, February 21, 2015 - 6:27 pm
    *********************************************************************
    Processing information for this run:
    Path to PO = C:\HRCJA\ofjd2arc
    Post Office=
    User = All
    Action = Analyze/Fix
    Files = Message, User
    Verify = Structure/Contents
    Fixup num = All
    Statistics = No
    Verbose = No
    Upd DiskSpace= No
    Output log = C:\HRCJA\ofjd2arc\gwchk32.log
    GWCHECK user options analysis:
    - options are consistent.
    *********************************************************************

    STRUCTURAL VERIFICATION of system databases
    STRUCTURAL VERIFICATION of database ngwguard.db
    - Database is structurally consistent
    Reading Guardian Database store catalog info

    (Former MDB Name: C:\HRCJA\ofjd2arc\msg.db)

    Checking archive message database -619536384 bytes, 02/20/15 14:51
    - Current time 6:27:36 pm
    STRUCTURAL VERIFICATION of database C:\HRCJA\ofjd2arc\msg.db
    Verifying data
    - Database is structurally consistent
    Reducing database C:\HRCJA\ofjd2arc\msg.db
    - no storage reclaimed.
    CONTENTS VERIFICATION of user's outgoing MSG database
    - processing message database records; last DRN = 1184191
    28856 LIN_RECORD check
    Problem 15- LIN_ATTACH_DRN item 58281 has wrong type
    - removing invalid reference
    - Record 28856 updated successfully
    28864 LIN_RECORD check
    Problem 15- LIN_ATTACH_DRN item 58114 has wrong type
    - removing invalid reference
    - Record 28864 updated successfully
    28868 LIN_RECORD check
    Problem 15- LIN_ATTACH_DRN item 58114 has wrong type
    - removing invalid reference
    - Record 28868 updated successfully
    1165185 LIN_RECORD check
    Problem 15- LIN_ATTACH_DRN item 446463 has wrong type
    - removing invalid reference
    - Record 1165185 updated successfully
    - checking for orphaned attachment records
    - 1175599 records read
    - 0 attachment file references found

    Processing time for database msg.db: 0:03:20

    Checking archive user database -269019136 bytes, 02/20/15 14:52
    - Current time 6:30:56 pm
    STRUCTURAL VERIFICATION of database C:\HRCJA\ofjd2arc\user.db
    Verifying data
    - Database is structurally consistent
    Reducing database C:\HRCJA\ofjd2arc\user.db
    25472000 bytes reclaimed
    CONTENTS VERIFICATION of database C:\HRCJA\ofjd2arc\user.db
    - 173487 records found, last DRN = 174911
    - checking Preference records
    - checking Folder records
    - checking Category records
    - checking Data records
    1 FOLDER_RECORD (Universal Inbox)
    28603737 kbytes in use by user's mail

    Processing time for database user.db: 0:01:52

    Checking message databases for expired orphaned message records:
    -=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
  • GWCkeck running for more that 7 days, not completed yet.
    I know there are a lot of Files but is this normal?
  • dkamp wrote:

    > I know there are a lot of Files but is this normal?


    Generally no. Did you say that it's running but you don't see any movement in
    the log? I think it's probably not doing anything at this point.

    --
    Danita
    Novell Knowledge Partner
    Are you a GroupWise Power Administrator? Join our site.
    http://www.caledonia.net/register

    If you find this post helpful and are logged into the web interface,
    show your appreciation and click on the star below...
  • Danita Wrote:
    Generally no. Did you say that it's running but you don't see any movement in
    the log? I think it's probably not doing anything at this point.

    I stopped it, Removed my AntiVirus , Fresh Boot, Started again in Verbose mode.
    It went thru several processes and then when it got to the "Checking Blob files for Validity" portion it seems to stop.
    The log file timestamp has not changed.
    Performance monitor shows no GW related files opening/closing
    GWCheck has 24.95% of the CPU's attention but no other activity related to GWCheck that I can see.
    Very Strange Indeed.
    Any suggestions?
  • In article <54F5CFE7.043F.00C6.1@mydomain.org>, Dkamp wrote:
    > Performance monitor shows no GW related files opening/closing
    > GWCheck has 24.95% of the CPU's attention but no other activity related to GWCheck that I can see.
    > Very Strange Indeed.


    Do you see any drive activity?
    Exactly what options do you have selected for this GWCheck?

    How is drive space on this PC? I'm wondering if a basic clearing of temp files (CCleaner or Disk
    Cleanup) and a defragment might help. Just those basics have helped with silly things before for
    me.
    Any power management that spins down the harddrive when there is no keyboard or mouse activity?

    Perhaps trying a slightly older GWCheck such as the one from 12.0.2


    Andy of
    http://KonecnyConsulting.ca in Toronto
    Knowledge Partner
    http://forums.novell.com/member.php/75037-konecnya
    If you find a post helpful and are logged in the Web interface, please show your appreciation by
    clicking on the star below. Thanks!


  • Andy said:

    >>Do you see any drive activity?
    >>Exactly what options do you have selected for this GWCheck?
    >>
    >>How is drive space on this PC? I'm wondering if a basic clearing of temp files (CCleaner or Disk
    >>Cleanup) and a defragment might help. Just those basics have helped with silly things before for
    >>me.
    >>Any power management that spins down the harddrive when there is no keyboard or mouse activity?
    >>
    >>Perhaps trying a slightly older GWCheck such as the one from 12.0.2


    I see no drive activity.
    These are the Options used previously and now again on another Windows8.1 PC using GWCheck version 12.0.2 build 18211 :
    Novell GroupWise - GWCHKARC - Version 12.0.2
    Processed on Wednesday, March 4, 2015 - 8:24 am
    *********************************************************************
    Processing information for this run:
    Path to PO = \\hosp.uhhg.org\dfs\userfolders\H\hrcja\Email Archive\email\ofjd2arc\
    Post Office=
    User = All
    Action = Analyze/Fix
    Files = Message, User
    Verify = Structure/Contents
    Fixup num = All
    Statistics = No
    Verbose = Yes
    Upd DiskSpace= No
    Output log = D:\gwchk32.log
    GWCHECK user options analysis:
    - options are consistent.
    *********************************************************************

    It stopped at the same point saying "Checking Blob files for validity again.
    the log file and msg.db and user.db timestamp is not updating.

    And Again....
    Thank you for helping!!
  • Hi,

    Perhaps it's just me, but.... I never run a both a Structure and Content check simultaneously. I, personally, would suggest first doing the structure check and then, once that has completed, doing the Content check. Many years ago I had a complete nightmare breakout over running both checks at the same time - once bitten, twice shy! On that same vein, you might want to run separate checks separating user database and message database. By getting more granular we might be able to get to the bottom of your issue.

    Cheers,