I installed a new Win2k3-based ZCM 10.3.0 server lately, fresh off the media in its own dev zone, then updated through system update to 10.3.1. Everything looked fine, no error message, no problems accessing ZCC, deploying the agent etc.

Until I ran ZDC (v0.6) against it:

ERROR 	Missing file: C:\WINDOWS\System32\dfmirage.dll
ERROR 	Missing file: C:\WINDOWS\System32\nzrNotifier.dll
ERROR 	Missing file: C:\WINDOWS\NalRedir.dll
ERROR 	Missing file: C:\WINDOWS\System32\drivers\dfmirage.sys
ERROR 	Missing file: C:\WINDOWS\System32\x86\dfmirage.dll
ERROR 	Missing file: C:\WINDOWS\System32\x86\dfmirage.sys
ERROR 	Missing file: C:\WINDOWS\System32\NLS\CHS\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\CHT\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\DEU\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\ENU\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\ESN\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\FRA\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\ITA\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\JPN\ZenLgnR.dll
ERROR 	Missing file: C:\WINDOWS\System32\NLS\PTB\ZenLgnR.dll
ERROR 	Missing file: C:\Program Files\Novell\CASA\etc\auth\mechanisms\ZcmScardAuthenticate.conf
ERROR 	Missing file: C:\Program Files\Novell\CASA\lib\zcmscardmech.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\InstallUI.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\installuserman.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\InstallUtilLib.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\NalRedir.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\NalShell.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\NalUI.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\NalView.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\NalWin.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrFlasher.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrHooks.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrLauncher.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrLogger.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrSignaller.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrSwitcher.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\nzrWinVNC.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\xmlparse.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\xmltok.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\browserbookmarksenf.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\CommonClasses.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\dluenf.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\launcherconfig.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\lfrwindowsenf.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\Printerenf.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\PrinterPoliciesLib.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\RMenf.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\roamprofenf.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\snmpenf.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\WindowsGPNativeHelper.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\WindowsGroupNameProvider.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\WindowsGroupPolicy.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\WindowsGroupPolicyPlural.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\WindowsWOW64NativeHelper.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\ZenworksIPrintProvider.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\handlers\ZenworksPrinterProvider.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\ChineseS\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\ChineseT\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Deutsch\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\English\NalRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\English\NalUIRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\English\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Espanol\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Francais\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Italiano\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Nihongo\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\nls\Portugue\nzrWinVNCRes.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\mfc80.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80CHS.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80CHT.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80DEU.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80ENU.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80ESP.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80FRA.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80ITA.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80JPN.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\MFC80KOR.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\mfc80u.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\mfcm80.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\mfcm80u.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\msvcm80.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\msvcp80.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\msvcr80.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\ZISWIN.EXE
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\ziswinReg64.exe
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\NALModule.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\NalRedir.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\Novell.Zenworks.PolicyManager.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\Novell.Zenworks.RMModule.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\PatchModule.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\RemotingService.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\ZenCacheExplorer.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\XmlSerializers\ZENPol.XmlSerializers.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\IEBookmarksHandlerUserModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\NALModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\Novell.Zenworks.PolicyManager.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\Novell.Zenworks.RMModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\PatchModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\PolicyHandlerRegistrationModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\PrinterPolicyUserModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\RemotingService.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\WindowsGPUserModule.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\modules\WindowsGPUserModulePlural.dll
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\Microsoft.VC80.CRT.manifest
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\Microsoft.VC80.MFC.manifest
ERROR 	Missing file: D:\Novell\ZENworks\bin\preboot\Microsoft.VC80.MFCLOC.manifest
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\bookmarks.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\dlupolicy.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\grouppolicy.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\launcher.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\lfrwindows.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\PolicyDefinitions.xml
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\printer.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\remotemanagement.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\roaming.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\pmconfig\snmp.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\resources\PatchModule.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\resources\PolicyHandlers.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\resources\PolicyManager.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\resources\PolicyUI.conf
ERROR 	Missing file: D:\Novell\ZENworks\conf\resources\RemoteManagement.conf
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_de.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_es.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_fr.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_it.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_ja.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_pt.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_zh_CN.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PatchModule_zh_TW.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_de.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_es.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_fr.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_it.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_ja.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_pt.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_zh_CN.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyHandlersResource_zh_TW.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_de.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_es.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_fr.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_it.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_ja.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_pt.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_zh_CN.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyManager_zh_TW.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_de.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_es.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_fr.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_it.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_ja.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_pt.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_zh_CN.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\PolicyUI_zh_TW.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_de.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_es.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_fr.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_it.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_ja.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_pt.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_zh_CN.dll
ERROR 	Missing file: D:\Novell\ZENworks\lang\RemoteManagement_zh_TW.dll
ERROR 	Missing file: D:\Novell\ZENworks\lib\Interop.IWshRuntimeLibrary.dll
ERROR 	Missing file: D:\Novell\ZENworks\zpm\snoozeList.xml
ERROR 	File 'C:\WINDOWS\System32\NWGina.dll' is inconsistent!!!
ERROR 	File 'C:\WINDOWS\System32\ZenCCS.dll' is inconsistent!!!
ERROR 	File 'C:\WINDOWS\System32\ZenLgn.dll' is inconsistent!!!
ERROR 	File 'C:\WINDOWS\System32\ZenPol.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\BundleFrameworkModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\modules\AppModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\modules\AppUserModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\NalRedir.tlb' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\Novell.Zenworks.MDStatus.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\AppModule.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\AppUserModule.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\Novell.Zenworks.MDStatus.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.x86_64.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\rpm\novell-zenworks-xplat-jsvc-1.0.1-1.i586.rpm' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_zh_TW.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_zh_TW.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_zh_TW.dll' is inconsistent!!!

So I got 197 incorrect/missing files right after a fresh install! Not nice, and not exactly trust-inspiring, either (after all ZCM is a system management tool and its job is to distribute files correctly, right? If it does not even manage to do that properly with its own components on a local machine, what can you expect when distributing all the various custom software out there to thousands of remote devices..?)

Anyway, taking a closer look at the file list, it seems most files are client side stuff like NAL components, GPO handler etc. I checked a few files being reported as inconsistent and found they all have a version number 10.3.0.* instead of 10.3.1.*. Which reminded me of the fact that I had changed the agent settings to only install the inventory module by default while waiting for the 10.3.1 update to be downloaded (we run ZFD in production now and want to roll out the ZCM agent in inventory only mode first. Only at a later stage devices will be fully managed by ZCM).

So I guess the initial 10.3.0 setup installed all agent features, but the system update updated only the inventory components, either removing the others or leaving them in the older version on disk.

So I went into the primary server device properties and changed the agent settings to install all components (and set those not being used to disabled). Refreshed the device, rebooted and ran ZDC another time. Here's what I got:

ERROR 	Missing file: D:\Novell\ZENworks\zpm\snoozeList.xml
ERROR 	File 'D:\Novell\ZENworks\bin\BundleFrameworkModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\modules\AppModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\modules\AppUserModule.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\Novell.Zenworks.MDStatus.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\AppModule.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\AppUserModule.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\bin\XmlSerializers\Novell.Zenworks.MDStatus.XmlSerializers.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.x86_64.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\rpm\novell-zenworks-xplat-jsvc-1.0.1-1.i586.rpm' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppModule_zh_TW.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\AppUserModuleStrings_zh_TW.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_de.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_es.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_fr.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_it.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_ja.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_pt.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_zh_CN.dll' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\lang\NalModule_zh_TW.dll' is inconsistent!!!

So now we're down to 34 missing/inconsistent files, not so bad. Maybe there's still hope for ZCM...

Let's take another close look at the file list: apart from the missing XML file and three MSI/RPM packages, they still all look like agent components. Again, a quick version check confirms all those DLLs are still at 10.3.0.*. Maybe some of the MSI installers did not run properly (or at all?) during the system update?

So let's find out which MSIs contain the files and run a repair on them. But how to obtain a list of files for all of the 134 MSI packages in $ZENWORKS_HOME\install\downloads\msi? Luckily there's Google and the VBscript online help, which made me come up with a small script:

On Error Resume Next

Function ReplaceText(str1, patrn, replStr)
    Set regEx = New RegExp
    regEx.Pattern = patrn
    regEx.IgnoreCase = True
    ReplaceText = regEx.Replace(str1, replStr)
End Function

MSIfile = WScript.Arguments.Item(0)
WScript.Echo String(80,"_")
WScript.Echo MSIfile   ":"   vbNewLine

Set installer = Wscript.CreateObject("WindowsInstaller.Installer")
Set database = installer.OpenDatabase(MSIfile, 0)
Set View = database.OpenView("SELECT FileName, FileSize, Version FROM File")
View.Execute
Do
   Set Record = View.Fetch
   If Record Is Nothing Then Exit Do
   Wscript.Echo Left(ReplaceText(Record.StringData(1),"^. \|","")   Space(40),40)   _
                Right( Space(12)   Record.StringData(2),12)   "   "   Record.StringData(3)
Loop
Set View = Nothing

Saved it as MsiFileLister.vbs and ran

      for %m in ( "%ZENWORKS_HOME%\install\downloads\msi\*.msi" ); do ( cscript //NoLogo MsiFileLister.vbs "%m" >> FullMsiFileList.txt )

and checked the resulting FullMsiFileList.txt file. The following four MSI packages contain all the inconsistent DLLs:

novell-zenworks-bundle-10.3.1.60099.msi
novell-zenworks-bundle-langs-client-10.3.1.60756.msi
novell-zenworks-primary-agent-10.3.1.34138.msi
novell-zenworks-windows-desktop-langs-client-10.3.1.60756.msi

So I tried to repair the first, but did not succeed since you can only repair MSI packages that are already installed - which novell-zenworks-bundle-10.3.1.60099.msi was not!

So I installed it (Right click - Install), as well as novell-zenworks-bundle-langs-client-10.3.1.60756.msi and repaired the other two (Right click - Repair), rebooted and ran ZDC a third time:

ERROR 	Missing file: D:\Novell\ZENworks\zpm\snoozeList.xml
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\msi\authtokenclientdevel.x86_64.msi' is inconsistent!!!
ERROR 	File 'D:\Novell\ZENworks\install\downloads\rpm\novell-zenworks-xplat-jsvc-1.0.1-1.i586.rpm' is inconsistent!!!

Down to 4 now, we're getting closer... I don't care much about the missing snoozeList.xml, ZPM is not enabled in the zone yet, and I guess it will be created once I start using ZPM. The MSI/PRM packages on the other hand worry me, and I downloaded ZCM_10.3.1_Update.zip from novell.com to check if I can find the correct versions there. 860MB later I had at least the correct version of the RPM package and replaced the older one in the $ZENWORKS_HOME\install\downloads\rpm folder.

Not a trace of updated authtokenclientdevel*.msi packages, though. Luckily it seems like the only DLL in those MSIs is Novell.Casa.Client.Auth.dll, which is also contained in the authtokenclient*.msi (without "devel") packages, which are installed properly. I still opened a SR about it with Novell, not sure if this is a bug in ZCM or ZDC... I'll post the results later.

So as a summary: always install all agent components on ZCM servers, and verify MSIs if you end up seeing older file versions than you would expect. Still very sad that ZCM shows these very basic issues, but at least they can be identified and fixed with the help of ZDC.

Editor's Note: "At the end, the remaining discrepancies in this article are due to a newly-discovered bug in ZDC, which Novell is investigating", they can safely be ignored"