• State Verified Answer
  • Replies replies
    5
  • Subscribers subscribers
    7
  • Views views
    606
  • Users 0 members are here
  • Locked Locked
This discussion has been locked.
You can no longer post new replies to this discussion. If you have a question you can start a new discussion

Some services missing/not running after upgrade of appliance from 8.2 to 8.5

MaMoPwC

After some initial troubles, I have managed to upgrade three sentinel appliances from 8.2 to 8.5, but I seem to be missing some services on the sentinel server.

Perhaps some of you out there can help me locate them?

My collector manager is trying to send event to the sentinel server on port 61616. It seems this should be an ActiveMQ instance, but nothing is currently running there and I don't see a clear service to start it?

Could someone with a functioning system (8.5 is possible, but I guess any 8.x version will do) check what is responding on that port and see if they can locate the service and/or package that is responsible?

I think I might save a current snapshot and momentarily revert to before OS upgrade to see if I can find the files there, but any help would be appreciated.

There might be other services that should be running but are not. This is the most obvious one from the logs, though.

  • 0

    Well, apparently the problem was already there in the first snapshot I still have. Looks like I might be missing some files in /opt/novell/sentinel/3rdparty and possibly /var/opt/novell/sentinel/3rdparty/activemq/data

    Anyone got an /opt/novell/sentinel/3rdparty/activemq directory?

  • 0

    Looking into an activemq directly from Apache...

  • Verified Answer

    +1   in reply to 

    ActiveMQ runs embedded in the main Sentinel process.

    sentinel:~ # lsof -i :61616
COMMAND   PID   USER   FD   TYPE  DEVICE SIZE/OFF NODE NAME
java    12948 novell  374u  IPv6 2293196      0t0  TCP *:61616 (LISTEN)

sentinel:~ # ps ww -p 12948
  PID TTY      STAT   TIME COMMAND
12948 ?        Sl    54:55 /opt/novell/sentinel/jdk/jre/bin/java -Dsrv_name=Server -server -Desecurity.home=/opt/novell/sentinel -Desecurity.data.home=/var/opt/novell/sentinel -Desecurity.config.home=/etc/opt/novell/sentinel -Desecurity.log.home=/var/opt/novell/sentinel -Desecurity.dataobjects.config.file=/xml/BaseMetaData.xml,/xml/WorkflowMetaData.xml,/xml/ActMetaData.xml -Desecurity.service.plugin=esecurity.util.service.ContainerService -Dcom.esecurity.configurationfile=/etc/opt/novell/sentinel/config/configuration.xml -Djava.util.logging.config.file=/etc/opt/novell/sentinel/config/server_log.prop -XX:+HeapDumpOnOutOfMemoryError -Xrs -Desecurity.sentinel.terminationTimeout=0 -Desecurity.sentinel.gracefulShutdownTimeout=30000 -XX:OnOutOfMemoryError=kill -9 %p -Desecurity.communication.service=Server2 -XX:MaxPermSize= -XX:+UseG1GC -XX:HeapDumpPath=/var/opt/novell/sentinel/log/Server.hprof -Duser.language=en -Dsentinel.securitymode.fips=false -Dfile.encoding=UTF8 -Desecurity.cache.directory=/var/opt/novell/sentinel/data/server.cache -Djava.security.auth.login.config=/etc/opt/novell/sentinel/config/auth.login -Djava.security.krb5.conf=/etc/opt/novell/sentinel/config/krb5.conf -Desecurity.execution.config.file=/etc/opt/novell/sentinel/config/execution.properties -Desecurity.router.config.file=/etc/opt/novell/sentinel/config/event-router.properties -Desecurity.jdbc.config.file=/etc/opt/novell/sentinel/config/postgresql_jdbc.properties -Djavax.net.ssl.trustStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.trustStorePassword=nw910oGE3PHtB5TAgKIo0A -Dsentinel.users.workflowlink.disable=false -Dactivemq.base=/var/opt/novell/sentinel/3rdparty/activemq -Djavax.net.ssl.keyStore=/etc/opt/novell/sentinel/config/.activemqkeystore.jks -Djavax.net.ssl.keyStorePassword=nw910oGE3PHtB5TAgKIo0A -Dactivemq.brokermaxmem=298 mb -Dlog4j.configurationFile=file:/etc/opt/novell/sentinel/config/activemqlog4j.properties -Dactivemq.classpath=/opt/novell/sentinel/3rdparty/activemq/conf -Djava.awt.headless=true -Xmx2988m -Dactivemq.brokermaxcon=2980 -Dsentinel.ldap.truststore.name=/etc/opt/novell/sentinel/config/.ldapkeystore.jks -Dsentinel.ldap.truststore.password=nw910oGE3PHtB5TAgKIo0A -Duser.country=US -Dreport.standalone.process.maxmem=2988 -Dreport.standalone.process.maxpermgenmem= -DEXCLUDED_CIPHERS=SSL_RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_RC4_128_MD5,TLS_ECDHE_RSA_WITH_RC4_128_SHA,RSA_WITH_RC4_128_MD5,RSA_WITH_RC4_128_SHA,SSL_RSA_WITH_3DES_EDE_CBC_SHA,TLS_ECDHE_RSA_WITH_3DES_EDE_CBC_SHA,SSL_DHE_RSA_WITH_3DES_EDE_CBC_SHA -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -Xloggc:/var/opt/novell/sentinel/log/gc.log -XX:+PrintGC -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=10M -Djava.io.tmpdir=/var/opt/novell/sentinel/tmp -Dplatform=Linux -Ddebug=false -Dsystem.root= -javaagent:/opt/novell/sentinel/lib/notsoserial-1.0.jar -Dnotsoserial.blacklist=/etc/opt/novell/sentinel/config/deserialization-blacklist.conf -Dinternal.osp.framework.ext-context-dir=/etc/opt/novell/sentinel/osp -Dinternal.osp.framework.generic-properties-filename=/etc/opt/novell/sentinel/config/osp-configuration.properties -Xms2988m -Djava.library.path=/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64:/opt/novell/sentinel/lib:/opt/novell/sentinel/jdk/jre/lib/amd64/server:/opt/novell/sentinel/jdk/jre/lib/amd64::/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64:/opt/novell/sentinel/lib/x86_64:/lib64:/usr/lib64 -classpath /opt/novell/sentinel/lib/server-all.jar:/opt/novell/sentinel/lib/si-base-all.jar:/opt/novell/sentinel/lib/sm-bridge-all.jar:/opt/novell/sentinel/lib/jms-all.jar:/opt/novell/sentinel/lib/webserver-all.jar:/opt/novell/sentinel/jdk/lib/tools.jar -Dwrapper.key=q97WKDQFYwanZW6J -Dwrapper.port=32000 -Dwrapper.jvm.port.min=31000 -Dwrapper.jvm.port.max=31999 -Dwrapper.pid=12933 -Dwrapper.version=3.2.3 -Dwrapper.native_library=wrapper -Dwrapper.service=TRUE -Dwrapper.cpu.timeout=10 -Dwrapper.jvmid=1 esecurity.util.service.Service /etc/opt/novell/sentinel/config/server.xml /etc/opt/novell/sentinel/config/configuration.properties

    In my fresh 8.5 system (no attached collector managers) there is just an empty /var/opt/novell/sentinel/3rdparty/activemq/data/ directory.

  • 0 in reply to   

    Thank you, klasen. I tried to get a post in yesterday that I got it running after I got the structure in place, but very nice to know that all you need is likely the empty structure. Do you have anything in /opt/novell/sentinel/3rdparty related to activemq? I didn't. I did have the /var/opt/novell/sentinel/3rdparty/activemq/data directory, though.

    It seems to me that I needed at least to have /opt/novell/sentinel/3rdparty/activemq/conf existing for it to start listening on port 61616. It does not seem to be described in any real detail that I have been able to find.

  • 0   in reply to 

    These are all the activemq directories and files I have:

    sentinel:~ # find  /opt/novell/sentinel/ -iname "*activemq*" -ls
2277789    4 drwxr-xr-x   2 novell   novell       4096 Sep  8 17:52 /opt/novell/sentinel/3rdparty/kibana/src/plugins/home/public/assets/activemq_logs
2279880    4 -rw-r--r--   1 novell   novell       2206 May 31 09:00 /opt/novell/sentinel/3rdparty/kibana/src/plugins/home/public/assets/logos/activemq.svg
2277855    4 drwxr-xr-x   2 novell   novell       4096 Sep  8 17:52 /opt/novell/sentinel/3rdparty/kibana/src/plugins/home/server/tutorials/activemq_logs
2277856    4 drwxr-xr-x   2 novell   novell       4096 Sep  8 17:52 /opt/novell/sentinel/3rdparty/kibana/src/plugins/home/server/tutorials/activemq_metrics
2198778  672 -rw-------   1 novell   novell     681026 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-kahadb-store-5.15.12.jar
2198782  172 -rw-------   1 novell   novell     170398 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-spring-5.15.12.jar
2198776   40 -rw-------   1 novell   novell      38966 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-jaas-5.15.12.jar
2198777   56 -rw-------   1 novell   novell      52800 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-jms-pool-5.15.12.jar
2198775 1404 -rw-------   1 novell   novell    1432307 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-client-5.15.12.jar
2198724 1172 -rw-------   1 novell   novell    1192281 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-broker-5.15.12.jar
2198781  152 -rw-------   1 novell   novell     147874 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-protobuf-1.1.jar
2198779  676 -rw-------   1 novell   novell     685740 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-openwire-legacy-5.15.12.jar
2198780   24 -rw-------   1 novell   novell      20899 Aug 20 16:29 /opt/novell/sentinel/lib/activemq-pool-5.15.12.jar
2614427  672 -rw-------   1 novell   novell     681026 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-kahadb-store-5.15.12.jar
2614431  172 -rw-------   1 novell   novell     170398 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-spring-5.15.12.jar
2614425   40 -rw-------   1 novell   novell      38966 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-jaas-5.15.12.jar
2614426   56 -rw-------   1 novell   novell      52800 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-jms-pool-5.15.12.jar
2614424 1404 -rw-------   1 novell   novell    1432307 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-client-5.15.12.jar
2614423 1172 -rw-------   1 novell   novell    1192281 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-broker-5.15.12.jar
2614430  152 -rw-------   1 novell   novell     147874 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-protobuf-1.1.jar
2614428  676 -rw-------   1 novell   novell     685740 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-openwire-legacy-5.15.12.jar
2614429   24 -rw-------   1 novell   novell      20899 Aug 20 16:24 /opt/novell/sentinel/setup/db_update/lib/activemq-pool-5.15.12.jar
sentinel:~ # find  /etc/opt/novell/sentinel/ -iname "*activemq*" -ls
2523948    4 -rw-------   1 novell   novell        236 Aug 20 16:24 /etc/opt/novell/sentinel/config/activemq_login.prop
2524020   16 -rw-------   1 novell   novell      13467 Aug 20 16:24 /etc/opt/novell/sentinel/config/activemq.xml
2525995    4 -rw-------   1 novell   novell       2953 Dec 15  2020 /etc/opt/novell/sentinel/config/.activemqkeystore.jks
2524342    4 -rw-------   1 novell   novell        157 Sep  8 17:56 /etc/opt/novell/sentinel/config/activemqusers.properties
2523949    4 -rw-------   1 novell   novell         54 Aug 20 16:24 /etc/opt/novell/sentinel/config/activemqgroups.properties
2525997    4 -rw-------   1 novell   novell       2953 Dec 15  2020 /etc/opt/novell/sentinel/config/.activemqclientkeystore.jks
2523950    4 -rw-------   1 novell   novell        230 Aug 20 16:24 /etc/opt/novell/sentinel/config/activemqlog4j.properties
sentinel:~ # find  /var/opt/novell/sentinel/ -iname "*activemq*" -ls
3097670    4 drwx------   3 novell   novell       4096 Aug 20 16:24 /var/opt/novell/sentinel/3rdparty/activemq

    You could grep for activemq in /etc/opt/novell/sentinel/config to see if there are any references to other files.

Resources

Support
Documentation
Learning Services
Partner Programs
Privacy
Compliance
Help
Company
Privacy Policy
Terms of Use
Cookies Preferences
Accessibility
Anti-Slavery Statement
Support
Contact Us
Careers
Code of Business Conduct and Ethics
The opinions expressed above are the personal opinions of the authors, not of OpenText. By using this site, you accept the Terms of Use. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.), Hewlett Packard Enterprise Company, or Micro Focus. As of January 31, 2023, the Material is now offered by OpenText, a separately owned and operated company. Any reference to the HP, Hewlett Packard Enterprise/HPE, and Micro Focus marks is historical in nature and the HP, Hewlett Packard Enterprise/HPE, and Micro Focus marks are the property of their respective owners.