Java App cannot locate Server Object : org.omg.CORBA.OBJECT_NOT_EXIST:

My Client Java App installed in some PC cannot connect to Server Object whereas most of the others PC can connect. We have enable Client VBJ debug logs and compare the "netstat -a" between the Success and Failed connect PC.

(1) Client PC Client ports used

OSAGENT_PORT = 15149

-Dvbroker.agent.clientPort=28001 -Dvbroker.agent.clientPortRange=5 

The VBJ debug logs lines show failed message (sorry so many lines below). But I cannot locate the what's going wrong, please help and give me pointer to troubleshoot. Many Thanks!!!

ObjBus DEBUG : freeORB class successful
[2016-02-22 16:22:00.237] OUT ORB Version : excelhk.objbus.MwCorbaPOA Thread[main,5,main]
ObjBus DEBUG : loadORB class, excelhk.objbus.MwCorbaPOA successful
[2016-02-22 16:22:00.237] OUT AGENT PORT = 15149 Thread[main,5,main]
[2016-02-22 16:22:00.237] OUT AGENT ADDR = null Thread[main,5,main]
System ORB port = null
Custom ORB port = null
22 Feb 2016 16:22:00,456 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,IIOP package has been initialized ()
22 Feb 2016 16:22:00,471 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - QoS package has been initialized ()
22 Feb 2016 16:22:00,487 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,keepAliveTimer set to 120 seconds ()
22 Feb 2016 16:22:00,503 [main] Error VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - DSUser: Use UDP port 28001 ()
22 Feb 2016 16:22:00,518 [AreYouAlive orb=749c749c] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Disconnected from OSAgent...will attempt reconnect every 30 seconds ()
22 Feb 2016 16:22:00,518 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,URLNaming package has been initialized ()
22 Feb 2016 16:22:00,518 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,Interface Repository package has been initialized ()
22 Feb 2016 16:22:00,518 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,NameService fail-over activated. ()
22 Feb 2016 16:22:00,518 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,INS package has been initialized ()
22 Feb 2016 16:22:00,518 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - IOP package has been initialized ()
22 Feb 2016 16:22:00,518 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - CONV_FRAME package has been initialized ()
22 Feb 2016 16:22:00,534 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - rmi/CORBA package has been initialized ()
22 Feb 2016 16:22:00,534 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,Notification service initialized. ()
22 Feb 2016 16:22:00,549 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,com.inprise.vbroker.naming.Initialize.init Entered. ()
22 Feb 2016 16:22:00,549 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,INS package has been initialized ()
22 Feb 2016 16:22:00,549 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.secure - 010.010.034.065,00000000,Initializing Security Service ()
22 Feb 2016 16:22:00,565 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.secure - 010.010.034.065,00000000,Default QOP = Server QOP policy = valuetype com.borland.security.csiv2.ServerQoPConfig {
boolean disable=false,
short transport=1,
boolean supportIdentityAssertion=true,
com.borland.security.csiv2.AccessPolicyManager access_manager=null,
boolean trustInClient=false,
java.lang.String[] realms={null},
short requiredIdentityType=3
} ()
22 Feb 2016 16:22:00,565 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.secure - 010.010.034.065,00000000,Default QOP = Client QOP policy = valuetype com.borland.security.csiv2.ClientQoPConfig {
short transport=2,
boolean trustInTarget=false
} ()
22 Feb 2016 16:22:00,565 [main] Alert VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.secure - 010.010.034.065,00000000,Security Service disabled ()
22 Feb 2016 16:22:00,581 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,orb.version_info(Borland VisiBroker for Java [08.05.00.C1.03] (JAN 27 2011 11:46:12)
Borland Software Corporation: http://www.borland.com/
Local Environment:
Java: Version 1.6.0 from IBM Corporation
OS: Windows 7 version 6.1 build 7600; CPU: x86) ()
Proxy Name is com.excelhk.settlement.admin.mw.ServerSettingRepositoryCorbaPoaProxy
22 Feb 2016 16:22:00,581 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,ORB.bind: repId=IDL:com.excelhk.settlement.admin.mw.IServerSettingRepositoryCorbaPoa:1.0,objectName=SET_SERVERSETTING,hostName=null ()
22 Feb 2016 16:22:00,596 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,remote object created : ()
22 Feb 2016 16:22:00,596 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,getIOR: IDL:com.excelhk.settlement.admin.mw.IServerSettingRepositoryCorbaPoa:1.0:SET_SERVERSETTING:null ()
22 Feb 2016 16:22:00,596 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - DSUser reconnecting... ()
22 Feb 2016 16:22:00,596 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - Logging in... ()
22 Feb 2016 16:22:00,596 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - 010.010.034.065,00000000,ORB.getLocalHost: 10.10.34.65 ()
22 Feb 2016 16:22:00,596 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,OSAgent Search Order: [r6itsprdsp02, 10.10.34.65, 255.255.255.255] ()
22 Feb 2016 16:22:00,596 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Looking for agent at: DSAddr[hostName=r6itsprdsp02, portNumber=15149] ()
22 Feb 2016 16:22:00,612 [Login] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(0:5): DSAMessage[version=ds.String[string=ORBeline 2.0], messageType=GET_CLIENT_HANDLER_ADDR, messageNumber=135407253, messageObject=null, userDataLength=4, userData=[0][0][0][0]] ()
22 Feb 2016 16:22:00,612 [DatagramThread orb=749c749c] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Received message: DSAReply[super=DSAMessage[version=ds.String[string=ORBeline 2.0], messageType=REPLY, messageNumber=1455954930, messageObject=DSAddr[hostName=10.85.142.111, portNumber=8008], userDataLength=4, userData=[0][0][0][0]], replyType=REPLY_GET_CLIENT_HANDLER_ADDR, requestNumber=135407253, status=SUCCESS] ()
22 Feb 2016 16:22:00,612 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Agent found at: DSAddr[hostName=10.85.142.111, portNumber=8008] ()
22 Feb 2016 16:22:00,612 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(0:5): DSRequest[super=DSMessage[version=ds.String[string=ORBeline 2.0], messageType=REQUEST_MSG, messageNumber=135407254, userDataLength=4, userData=[0][0][0][0]], requestType=REQ_LOGIN, request=DSLogin[hostName=ds.String[string=10.10.34.65], loginName=ds.String[string=java], password=ds.String[string=java], userName=ds.String[string=java], pid=135407268, machineType=1, verifyPort=28001]] ()
22 Feb 2016 16:22:01,127 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(1:5): DSRequest[super=DSMessage[version=ds.String[string=ORBeline 2.0], messageType=REQUEST_MSG, messageNumber=135407254, userDataLength=4, userData=[0][0][0][0]], requestType=REQ_LOGIN, request=DSLogin[hostName=ds.String[string=10.10.34.65], loginName=ds.String[string=java], password=ds.String[string=java], userName=ds.String[string=java], pid=135407268, machineType=1, verifyPort=28001]] ()
22 Feb 2016 16:22:02,141 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(2:5): DSRequest[super=DSMessage[version=ds.String[string=ORBeline 2.0], messageType=REQUEST_MSG, messageNumber=135407254, userDataLength=4, userData=[0][0][0][0]], requestType=REQ_LOGIN, request=DSLogin[hostName=ds.String[string=10.10.34.65], loginName=ds.String[string=java], password=ds.String[string=java], userName=ds.String[string=java], pid=135407268, machineType=1, verifyPort=28001]] ()
22 Feb 2016 16:22:04,153 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(3:5): DSRequest[super=DSMessage[version=ds.String[string=ORBeline 2.0], messageType=REQUEST_MSG, messageNumber=135407254, userDataLength=4, userData=[0][0][0][0]], requestType=REQ_LOGIN, request=DSLogin[hostName=ds.String[string=10.10.34.65], loginName=ds.String[string=java], password=ds.String[string=java], userName=ds.String[string=java], pid=135407268, machineType=1, verifyPort=28001]] ()
22 Feb 2016 16:22:08,162 [main] Debug VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - 010.010.034.065,00000000,Sending request(4:5): DSRequest[super=DSMessage[version=ds.String[string=ORBeline 2.0], messageType=REQUEST_MSG, messageNumber=135407254, userDataLength=4, userData=[0][0][0][0]], requestType=REQ_LOGIN, request=DSLogin[hostName=ds.String[string=10.10.34.65], loginName=ds.String[string=java], password=ds.String[string=java], userName=ds.String[string=java], pid=135407268, machineType=1, verifyPort=28001]] ()
22 Feb 2016 16:22:16,165 [main] Error VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.agent - DSUser reconnection failed. ()
22 Feb 2016 16:22:16,165 [main] Info VBJ-Application.orb_com.inprise.vbroker.orb.ORB@749c749c.vbroker.log.default.filter.orb - trying to bind to IOR[type_id=IDL:com.excelhk.settlement.admin.mw.IServerSettingRepositoryCorbaPoa:1.0,profiles={valuetype com.inprise.vbroker.orb.LocatorProfileBodyValue {
boolean byPOA=false,
java.lang.String name="SET_SERVERSETTING",
java.lang.String host="",
byte[] oid={null}
}}] ()
org.omg.CORBA.OBJECT_NOT_EXIST:
Could not locate the following Object:
repository id : IDL:com.excelhk.settlement.admin.mw.IServerSettingRepositoryCorbaPoa:1.0
object name : SET_SERVERSETTING
vmcid: 0x0 minor code: 0 completed: No
at com.inprise.vbroker.orb.LocatorBidder.getBid(Unknown Source)
at com.inprise.vbroker.ProtocolEngine.ManagerImpl.startBidding(Unknown Source)
at com.inprise.vbroker.ProtocolEngine.ManagerImpl.getConnector(Unknown Source)
at com.inprise.vbroker.orb.DelegateImpl._bind(Unknown Source)
at com.inprise.vbroker.orb.DelegateImpl.bind(Unknown Source)
at com.inprise.vbroker.CORBA.portable.ObjectImpl._bind(Unknown Source)
at com.inprise.vbroker.orb.ORB.bind(Unknown Source)

  • Hi Albert,

    The reason for the OBJECT_NOT_EXIST exception is, the client is not able to login to the osagent.

    Is there any firewall running between this 10.10.34.65 client machine and 10.85.142.111 osagent machine?  If so, does it restricts incoming traffic on certain ports?

    FYI, the source port used here is 28001 and the destination port is 8008.

    Cheers,

    Karthi.

  • In reply to Karthikeyan:

    Hi Karthi,

    Thanks for your prompt reply.

    Of course, there is firewall, but how I can know which port number (TCP or UDP) is being blocked. Can any command and utility can be used? I will try to use osfind.exe on client machine later to see if any osagent can be located. I will post information later.

    As you said, the source port used here is 28001 (Is it Client Machine?) and the destination port is 8008 (Is it osagent machine?) Please correct me if I am wrong?

    Any more info can be explained for the client vbj debug log? Thanks again.

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Albert,

    Yes, the source port 28001 is from client machine and 8008 port is from the osagent machine.

    You may also need to configure OSAGENT_CLIENT_HANDLER_PORT environment variable in 10.85.142.111 so that the TCP & UDP client handler port used by the osagent will also be fixed. Currently, the TCP client handler port is 8008 which could be a random port assigned by the OS.

    Cheers,

    Karthi.

  • In reply to Karthikeyan:

    Hi Karthi,

    Yes, I have already configured the serverside Java remote object using below port setting.

    VBROKER_PORT=8010

    VBROKER_CLIENT_PORT=8110

    -Dvbroker.agent.clientPort=$VBROKER_CLIENT_PORT -Dvbroker.agent.clientPortRange=500 -Dvbroker.se.iiop_tp.scm.iiop_tp.listener.port=$VBROKER_PORT -Dvbroker.se.iiop_tp.scm.iiop_tp.listener.portRange=1

    Currently, I am still thinking of any firewall that might block the UDP port. Any tools to troubleshoot in the windows clientside? (e.g. osfind, netstat, tracert).

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Karthi,

    Where to configure OSAGENT_CLIENT_HANDLER_PORT? In osagent launch ? Or in serverside remote obect jaca process ? Any reference link ?

    Albert

  • In reply to AlbertTsun:

    Hi Karthi,

    After I google this link about "OSAGENT_CLIENT_HANDLER_PORT"

    community.microfocus.com/.../7198.fix-osagent-client-handler-port-for-app-server-running-behind-firewall.aspx

    community.microfocus.com/.../13739.how-to-specify-a-the-udp-and-tcp-ports-for-client-handlers-for-osagent.aspx

    , I found that, in my env, the below environment parameters are set, before we start the osagent.

    Does it mean that  the UDP and TCP port of 8008, is used when osagent broadcasts? Is the error happened due to that port is blocked by the firewall in between? Any way to prove it or is it shown in the above debug log lines? Sorry for so many questions.

    OSAGENT_CLIENT_HANDLER_UDP_PORT=8007   <== It should be no use in my vb85 env.

    OSAGENT_CLIENT_HANDLER_PORT=8008

    OSAPORT=15149

    export OSAGENT_CLIENT_HANDLER_UDP_PORT

    export OSAGENT_CLIENT_HANDLER_PORT

    export OSAPORT

    export OSAGENT_LOCAL_FILE=../cfg/osagent_localaddr

    export OSAGENT_ADDR_FILE=../cfg/osagent_addr

    nohup /opt/MicroFocus/VisiBroker/bin/osagent -v -p $OSAPORT > $SET_LOG_PATH/$OSAGENT_LOG 2>&1 &

    Thanks in advance

    Regards,

    Albert

  • In reply to Karthikeyan:

    Hi Karthi,

    Sorry. For "Currently, the TCP client handler port is 8008 which could be a random port assigned by the OS.", does you mean it is the AIX serverside or the Window Client PC side?

    And "OSAGENT_CLIENT_HANDLER_PORT" is to be set in server side ?

    I found this env parameter is set in my AIX osagent server.

    OSAGENT_CLIENT_HANDLER_UDP_PORT=8007   <== It should be no use in my vb85 env.

    OSAGENT_CLIENT_HANDLER_PORT=8008

    OSAPORT=15149

    export OSAGENT_CLIENT_HANDLER_UDP_PORT

    export OSAGENT_CLIENT_HANDLER_PORT

    export OSAPORT

    export OSAGENT_LOCAL_FILE=../cfg/osagent_localaddr

    export OSAGENT_ADDR_FILE=../cfg/osagent_addr

    nohup /opt/MicroFocus/VisiBroker/bin/osagent -v -p $OSAPORT > $SET_LOG_PATH/$OSAGENT_LOG 2>&1 &

    Does it mean that  the UDP and TCP port of 8008, is used when osagent broadcasts? Is the error happened due to that port is blocked by the firewall in between? Any way to prove it or is it shown in the above debug log lines? Sorry for so many questions.

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Albert,

    Since you have already configured OSAGENT_CLIENT_HANDLER_PORT for the oasgent, there will be a UDP and TCP port listening on 8008 along with the 15149 UDP port. All these three ports should be allowed in the firewall.

    Now, check if the incoming traffic from source port 28001(to port range 28005) from 10.10.34.65 client machine is allowed to 10.85.142.111 machine in your firewall.

    You can also use wireshark tool to capture TCP packets exchanged between these two machines and check the packets for any problems.

    Cheers,

    Karthi.

  • In reply to Karthikeyan:

    Hi Karthi,

    Thanks.

    We have checked that the firewall between the Client PC (10.x.x.x) (SOURCE) and 10.85.142.111(DEST) (physical server IP) have permitted below port (confirmed by network team) as below.

    (TCP) 1234, 8009-8013

    (UDP) 28001-28005, 15149

    (TCP&UDP) 8008

    And it is rather strange that there is another workable PC (10.10.51.136) which can connect and locate the server object, whereas 2 other PCs on the same floor (10.10.51.69,  10.10.34.65 ) cannot locate server objects.

    Is there anyway to troubleshoot as it may be impossible to install "wireshark" in Prod PC? 

    Is it useful to use "osfind" to see if Client PC can locate the osagent?

    Thanks a lot.

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Karthi,

    As confirmed by the network Team, the firewall setting for all Client PCs is in the subset level 10.10.x.x. It means that whenever one PC can be connected successfully which can imply all PCs should be ok.

    Is the above statement correct?

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Albert,

    If your firewall is allowing the 10.10.x.x and the ports given in your comment, then the client should be able to connect to osagent. Maybe, install Wireshark tool in this client machine, capture packets exchanged and check for any issues.

    You could also try to run osfind in 10.10.34.65 client machine with the command below:

    osfind -VBJprop vbroker.agent.clientPort=28003 -VBJprop vbroker.agent.port=15149 -VBJprop vbroker.agent.addr=10.85.142.111

    I believe, osfind also will have the same problem as the VisiBroker client.

    So, I suggest to open an incident(if you have a valid support contract) with us to work on this issue. Our website is, supportline.microfocus.com.

    Cheers,

    Karthi.

  • In reply to Karthikeyan:

    Hi Karthi,

    I know that, the osagent existence broadcast controlled by the env "OSAGENT_LOCAL_FILE".

    My file has file has the following line :

    r6itsprdsp02 255.255.255.0 10.85.142.255

    whereas

    r6itsprdsp02 is the hostname which osagent and java appl start (it should be 10.85.142.111)

    What does "255.255.255.0'  do ? Should it be 255.255.0.0. ?

    What does "10.85.142.255" do ? Does it means that broadcast to a limited portion (10.85.142) of the (10.85) subnet.

    For Client PC, their IP address is '10.10.x.x', so what should be set in the OSAGENT_LOCAL_FILE ? Please advise.

    Cheers,

    Albert

  • In reply to AlbertTsun:

    Hi Karthi,

    For your updates, it was found that the problem PC has Windows firewall enabled. After it was disabled, it can connect to Java server app.

    Thank you very much.

    Cheers,

    Albert