REST Driver issue with RL

[aortizmicrofocus]

Hi,

We are having a very wierd issue with REST Driver, following you can find detailed description and behavior:

1.- The Driver works fine when running DriverShim directly from IDM Server.

2.- When using Java Remote Loader from another Server we got this Error Message in Remote loader log:

 <status event-id="report status" level="fatal" type="remoteloader">Exception caused by SubscriptionShim.init()
java.lang.NoSuchMethodError: org.apache.http.impl.client.HttpClientBuilder.setConnectionManagerShared(Z)Lorg/apache/http/impl/client/HttpClientBuilder;
        at com.novell.nds.dirxml.driver.rest.HTTPSubscriberConnectionInfo.makeHttpClient(HttpRESTOperations.java:579)
        at com.novell.nds.dirxml.driver.rest.RESTSubscriptionShim.init(RESTSubscriptionShim.java:253)
        at com.novell.nds.dirxml.remote.loader.Driver.startDriver(Driver.java:397)
        at com.novell.nds.dirxml.remote.loader.Driver.driverStart(Driver.java:90)
        at com.novell.nds.dirxml.remote.loader.RemoteLoader.run(RemoteLoader.java:951)
        at java.lang.Thread.run(Thread.java:745)
</status>

3.- We updated following libraries in both servers (IDM Server in lib/dirxml/classes and RL lib directory):

jna-platform-4.5.2.jar
jna-4.5.2.jar
httpmime-4.5.10.jar
httpclient-win-4.5.10.jar
httpclient-osgi-4.5.10.jar
httpclient-cache-4.5.10.jar
fluent-hc-4.5.10.jar
commons-codec-1.11.jar
httpcore-4.4.12.jar
commons-logging-1.2.jar
commons-cli-1.2.jar
(All files are in 777 mode on both servers)

4.- After restarting RL & Driver the error persists.

Important Note: There are two more Java RL instances for Gsuite that works fine in the same Server (where all RL were installed).

Enviroment Information:

IDM versión: 4.6.0
Rest Driver versión: 1.0.2.0
JVM version (IDM Server): 1.8.0_112
JVM version (Remote Loader Server): 1.8.0_112

Attached you can find RL log trace.

[cpedersen]

Hi,

You do not have the apache httpclient in your list.

I'd guess that you need "httpclient-4.4.1.jar" (what I have with 4.7).

Casper

[aortizmicrofocus]

Hi

Actually we have httpclient-4.5.10.jar but I just missed put it in the list. 😞

With this jar the error still continues.

Thanks.

[cpedersen]

It can't find this class: org/apache/http/impl/client/HttpClientBuilder (org.apache.http.impl.client.HttpClientBuilder) which is in that .jar file.

Are you sure that your remote loader is picking up your jar files correctly are they in /opt/novell/eDirectory/lib/dirxml/classes or have your configured you startup script to get them from where you put them.

You should be able to echo out the class path from the script, which should verify if you have it correctly configured. 

[aortizmicrofocus]

Hi

I have the jars at the both sides. In the IDM server and RL Server.

When I execute the following command in the RL server the classpath is visible:

ps -fea | grep java

idm 31580 31577 20 09:49 pts/0 00:00:00 /tmp/java8_112/jdk1.8.0_112/bin/java -classpath :/opt/novell/Laboratorio/lib/aalto-xml-1.0.0.jar:/opt/novell/Laboratorio/lib/activation.jar:/opt/novell/Laboratorio/lib/activemq-all-5.12.1.jar:/opt/novell/Laboratorio/lib/adutil.jar:/opt/novell/Laboratorio/lib/afadmin.jar:/opt/novell/Laboratorio/lib/ARSDriver75.jar:/opt/novell/Laboratorio/lib/arshim.jar:/opt/novell/Laboratorio/lib/axis-1.4_1.jar:/opt/novell/Laboratorio/lib/bcprov-jdk15on-150.jar:/opt/novell/Laboratorio/lib/Blackboard.jar:/opt/novell/Laboratorio/lib/ckdrvhealthjob.jar:/opt/novell/Laboratorio/lib/collections.jar:/opt/novell/Laboratorio/lib/CommonDriverShim.jar:/opt/novell/Laboratorio/lib/commons-cli-1.2.jar:/opt/novell/Laboratorio/lib/commons-codec-1.11.jar:/opt/novell/Laboratorio/lib/commons-httpclient.jar:/opt/novell/Laboratorio/lib/commons-io-2.4.jar:/opt/novell/Laboratorio/lib/commons-lang3-3.4.jar:/opt/novell/Laboratorio/lib/commons-logging-1.2.jar:/opt/novell/Laboratorio/lib/ComposerDriverShim.jar:/opt/novell/Laboratorio/lib/concurrentlinkedhashmap-lru-1.2.jar:/opt/novell/Laboratorio/lib/CUSTOM1_MicrofocusBase64Handler.jar:/opt/novell/Laboratorio/lib/CUSTOM_MicrofocusBase64Handler.jar:/opt/novell/Laboratorio/lib/Davi_CarteraCredito.jar:/opt/novell/Laboratorio/lib/DaviviendaIdentidades.jar:/opt/novell/Laboratorio/lib/dcsshim.jar:/opt/novell/Laboratorio/lib/DelimitedTextShim.jar:/opt/novell/Laboratorio/lib/DelimitedTextUtil.jar:/opt/novell/Laboratorio/lib/dhutil.jar:/opt/novell/Laboratorio/lib/dirxmlcomps.jar:/opt/novell/Laboratorio/lib/dirxml.jar:/opt/novell/Laboratorio/lib/dirxml_misc.jar:/opt/novell/Laboratorio/lib/dirxml_monitor.jar:/opt/novell/Laboratorio/lib/dirxml_remote.jar:/opt/novell/Laboratorio/lib/DVRoles01.jar:/opt/novell/Laboratorio/lib/dxjetty.jar:/opt/novell/Laboratorio/lib/EBSHRShim.jar:/opt/novell/Laboratorio/lib/EBSShim.jar:/opt/novell/Laboratorio/lib/EBSTCAShim.jar:/opt/novell/Laboratorio/lib/EBSUserShim.jar:/opt/novell/Laboratorio/lib/EdirDriverShim.jar:/opt/novell/Laboratorio/lib/ejb.jar:/opt/novell/Laboratorio/lib/EntitlementServiceShim.jar:/opt/novell/Laboratorio/lib/FanoutDriverShim.jar:/opt/novell/Laboratorio/lib/fluent-hc-4.5.10.jar:/opt/novell/Laboratorio/lib/gdata-appsforyourdomain-1.0.jar:/opt/novell/Laboratorio/lib/gdata-appsforyourdomain-meta-1.0.jar:/opt/novell/Laboratorio/lib/gdata-base-1.0.jar:/opt/novell/Laboratorio/lib/gdata-client-1.0.jar:/opt/novell/Laboratorio/lib/gdata-client-meta-1.0.jar:/opt/novell/Laboratorio/lib/gdata-contacts-3.0.jar:/opt/novell/Laboratorio/lib/gdata-contacts-meta-3.0.jar:/opt/novell/Laboratorio/lib/gdata-core-1.0.jar:/opt/novell/Laboratorio/lib/gmailshim.jar:/opt/novell/Laboratorio/lib/google-api-client-1.22.0.jar:/opt/novell/Laboratorio/lib/google-api-services-admin-directory_v1-rev68-1.22.0.jar:/opt/novell/Laboratorio/lib/google-api-services-groupssettings-v1-rev60-1.22.0.jar:/opt/novell/Laboratorio/lib/google-api-services-oauth2-v1-rev117-1.22.0.jar:/opt/novell/Laboratorio/lib/google-http-client-1.22.0.jar:/opt/novell/Laboratorio/lib/google-http-client-gson-1.22.0.jar:/opt/novell/Laboratorio/lib/google-http-client-jackson2-1.22.0.jar:/opt/novell/Laboratorio/lib/google-oauth-client-1.22.0.jar:/opt/novell/Laboratorio/lib/google-oauth-client-jetty-1.22.0.jar:/opt/novell/Laboratorio/lib/gson-2.3.1.jar:/opt/novell/Laboratorio/lib/guava-11.0.2.jar:/opt/novell/Laboratorio/lib/GWRestShim.jar:/opt/novell/Laboratorio/lib/hamcrest-core-1.3.jar:/opt/novell/Laboratorio/lib/hamcrest-library-1.3.jar:/opt/novell/Laboratorio/lib/httpclient-4.5.10.jar:/opt/novell/Laboratorio/lib/httpclient-cache-4.5.10.jar:/opt/novell/Laboratorio/lib/httpclient-osgi-4.5.10.jar:/opt/novell/Laboratorio/lib/httpclient-win-4.5.10.jar:/opt/novell/Laboratorio/lib/httpcore-4.4.12.jar:/opt/novell/Laboratorio/lib/httpmime-4.5.10.jar:/opt/novell/Laboratorio/lib/idmcp.jar:/opt/novell/Laboratorio/lib/idprovider.jar:/opt/novell/Laboratorio/lib/init-idm-resources.jar:/opt/novell/Laboratorio/lib/jackson-annotations-2.6.0.jar:/opt/novell/Laboratorio/lib/jackson-core-2.6.3.jar:/opt/novell/Laboratorio/lib/jackson-core-asl-1.9.13.jar:/opt/novell/Laboratorio/lib/jackson-databind-2.6.3.jar:/opt/novell/Laboratorio/lib/jackson-dataformat-xml-2.6.3.jar:/opt/novell/Laboratorio/lib/jackson-jaxrs-1.9.13.jar:/opt/novell/Laboratorio/lib/jackson-mapper-asl-1.9.13.jar:/opt/novell/Laboratorio/lib/jackson-module-jaxb-annotations-2.6.3.jar:/opt/novell/Laboratorio/lib/javax-xml-soap-1.6.0.jar:/opt/novell/Laboratorio/lib/jaxrpc-api.jar:/opt/novell/Laboratorio/lib/jbosssx-client.jar:/opt/novell/Laboratorio/lib/jclient.jar:/opt/novell/Laboratorio/lib/jcl-over-slf4j-1.7.21.jar:/opt/novell/Laboratorio/lib/jco3environment.jar:/opt/novell/Laboratorio/lib/JDBCConfig.jar:/opt/novell/Laboratorio/lib/JDBCShim.jar:/opt/novell/Laboratorio/lib/JDBCUtil.jar:/opt/novell/Laboratorio/lib/jersey-bundle-1.18.jar:/opt/novell/Laboratorio/lib/jettison-1.2.jar:/opt/novell/Laboratorio/lib/jetty-all-9.3.11.v20160721-uber.jar:/opt/novell/Laboratorio/lib/jms.jar:/opt/novell/Laboratorio/lib/JMSShim.jar:/opt/novell/Laboratorio/lib/jna-4.5.2.jar:/opt/novell/Laboratorio/lib/jna-platform-4.5.2.jar:/opt/novell/Laboratorio/lib/jnet.jar:/opt/novell/Laboratorio/lib/jntls.jar:/opt/novell/Laboratorio/lib/js.jar:/opt/novell/Laboratorio/lib/json-simple-1.1.1.jar:/opt/novell/Laboratorio/lib/jsr305-1.3.9.jar:/opt/novell/Laboratorio/lib/jsr311-api-1.1.1.jar:/opt/novell/Laboratorio/lib/jsso.jar:/opt/novell/Laboratorio/lib/jsso-prov.jar:/opt/novell/Laboratorio/lib/junit-4.12.jar:/opt/novell/Laboratorio/lib/ksutil.jar:/opt/novell/Laboratorio/lib/ldap.jar:/opt/novell/Laboratorio/lib/LDAPShim.jar:/opt/novell/Laboratorio/lib/LDAPUtil.jar:/opt/novell/Laboratorio/lib/leveldbjni-all-1.8.jar:/opt/novell/Laboratorio/lib/log4j-1.2.14.jar:/opt/novell/Laboratorio/lib/log4j.jar:/opt/novell/Laboratorio/lib/loopback.jar:/opt/novell/Laboratorio/lib/mail.jar:/opt/novell/Laboratorio/lib/ManualTaskServiceBase.jar:/opt/novell/Laboratorio/lib/ManualTaskServiceShim.jar:/opt/novell/Laboratorio/lib/mapdb.jar:/opt/novell/Laboratorio/lib/MSGatewayCommon.jar:/opt/novell/Laboratorio/lib/MSGatewayDriverShim.jar:/opt/novell/Laboratorio/lib/NdsToNds.jar:/opt/novell/Laboratorio/lib/NotesDriverShim.jar:/opt/novell/Laboratorio/lib/novlact.jar:/opt/novell/Laboratorio/lib/npki.jar:/opt/novell/Laboratorio/lib/NPUM_api.jar:/opt/novell/Laboratorio/lib/NPUMDriverShim.jar:/opt/novell/Laboratorio/lib/nrfdriver.jar:/opt/novell/Laboratorio/lib/nulldriver.jar:/opt/novell/Laboratorio/lib/NxSettings.jar:/opt/novell/Laboratorio/lib/nxsl.jar:/opt/novell/Laboratorio/lib/ojdbc6.jar:/opt/novell/Laboratorio/lib/opencsv-2.1.jar:/opt/novell/Laboratorio/lib/passgenjob.jar:/opt/novell/Laboratorio/lib/psoftshim.jar:/opt/novell/Laboratorio/lib/pwdexpjob.jar:/opt/novell/Laboratorio/lib/RESTCommon.jar:/opt/novell/Laboratorio/lib/RESTDriverShim.jar:/opt/novell/Laboratorio/lib/RestPeajes.jar:/opt/novell/Laboratorio/lib/RESTUtil.jar:/opt/novell/Laboratorio/lib/saaj-api.jar:/opt/novell/Laboratorio/lib/SalesforceShim.jar:/opt/novell/Laboratorio/lib/SAPBLShim.jar:/opt/novell/Laboratorio/lib/SAPHRShim.jar:/opt/novell/Laboratorio/lib/SAPPortalShim.jar:/opt/novell/Laboratorio/lib/sapumshim.jar:/opt/novell/Laboratorio/lib/schdrvjob.jar:/opt/novell/Laboratorio/lib/sentinel-client-base.jar:/opt/novell/Laboratorio/lib/sentinel-client-base-java.jar:/opt/novell/Laboratorio/lib/sentinel-client-beans.jar:/opt/novell/Laboratorio/lib/SentinelRESTShim.jar:/opt/novell/Laboratorio/lib/ServicenowShim.jar:/opt/novell/Laboratorio/lib/servlet-api-3.1.jar:/opt/novell/Laboratorio/lib/shimwrapper.jar:/opt/novell/Laboratorio/lib/slf4j-api-1.7.21.jar:/opt/novell/Laboratorio/lib/slf4j-simple-1.7.13.jar:/opt/novell/Laboratorio/lib/Smc.jar:/opt/novell/Laboratorio/lib/SOAPShim.jar:/opt/novell/Laboratorio/lib/SOAPUtil.jar:/opt/novell/Laboratorio/lib/sqljdbc4.jar:/opt/novell/Laboratorio/lib/srvprvUAD.jar:/opt/novell/Laboratorio/lib/statistics.jar:/opt/novell/Laboratorio/lib/stax2-api-3.0.1.jar:/opt/novell/Laboratorio/lib/sungardbannershim.jar:/opt/novell/Laboratorio/lib/triggerjob.jar:/opt/novell/Laboratorio/lib/WorkOrder.jar:/opt/novell/Laboratorio/lib/wss4j-1.6.6.jar:/opt/novell/Laboratorio/lib/wssdk.jar:/opt/novell/Laboratorio/lib/xcd-all.jar:/opt/novell/Laboratorio/lib/xconfig.jar:/opt/novell/Laboratorio/lib/XDS.jar:/opt/novell/Laboratorio/lib/xercesImpl.jar:/opt/novell/Laboratorio/lib/xmlsec.jar:/opt/novell/Laboratorio/lib/xp.jar:/opt/novell/Laboratorio/lib/xpp3.jar:/opt/novell/Laboratorio/lib/zOS.jar com.novell.nds.dirxml.remote.loader.RemoteLoader -config config9001MACI.txt

Actually both servers are using the same java version too.

🙂

[cpedersen]

Interesting, just for "fun" have you tried to run the remote loader on the engine server to see if it has to do with the remote loader - which is basically what I can think of right now.

[aortizmicrofocus]

Finally, after many attempts we were unable to operate the connection of the driver with the RL. Fortunately, a colleague suggested that we protect the web resource through the NAM Access Gateway and thus directly consume the web service. We did this and it worked great.

[cpedersen]

That is a very interesting solution to this problem. Thank you for the update.