Getting MAX SESSIONS EXCEED ERROR

Hi Team,

We are frequently facing "Max Session Exceed" error, as a corrective action we are restarting SM services

We are using SM 9.30 version and horizontal scaling environment.

Getting below error

6864(  6372) 09/02/2016 10:52:25 JRTE I Balancer Couldn't find any available nodes. LoadBalancer is up, but none of the servers are ready to take the load.

  9160(  7192) 09/02/2016 10:52:25  RTE D evjscall: Using existing js context 26c7c670

  6864(  6372) 09/02/2016 10:52:25 JRTE I Balancer Couldn't find any available nodes. LoadBalancer is up, but none of the servers are ready to take the load.

  6864(  6372) 09/02/2016 10:52:25 JRTE I Balancer Couldn't find any available nodes. LoadBalancer is up, but none of the servers are ready to take the load.

  9160(  7192) 09/02/2016 10:52:25  RTE D evjscall: Using existing js context 26c7c670

  • can you post your sm.cfg and sm.ini?

     

    how many servlets do you have configured in sm.cfg?

  • Hi Enzo,

    Thanks for reply..

    how many servlets do you have configured in sm.cfg? around 8 to 9

    we are using 2 ports of 3 servers for user login and other ports are used for TeMIP integration.

    We are using failover cluster in which 2 primary server are configured i.e 8.114 as a active server and 8.79 as a passive server.

    Other than this server there are 7 secondary servers and 3 web servers.

    8.114 server : Active server 
    SM.ini
    # ServiceManager Initialization file
    # (c) Copyright 2008 Hewlett-Packard Development Company, L.P.
    # Configuration Modified Date:8/29/12 5:14 PM
    shared_memory:512000000
    log:../logs/sm.log
    system:13080
    httpPort:13080
    sslConnector:0
    #httpsPort:13443
    groupbindaddress:10.114.8.114
    sqldictionary:oracle11
    [oracle11]
    sqldb:SNOCSMDB
    sqllogin:hpsmadmin/hpsmadmin
    plugin0:kmplugin.dll
    grouplicenseip:10.114.8.104
    groupname:smgroup
    groupmcastaddress:224.0.0.255
    groupsubnetaddress:255.255.255.0
    groupport:13100
    threadsperprocess:50
    sessiontimeout:60
    webservices_sessiontimeout:180
    heartbeatinterval:60
    ir_asynchronous:1
    #ir_disable:1
    sqllibrary:sqoracle.oci10.DLL
    KMSearchEngineClass:com.hp.ov.sm.server.plugins.knowledgemanagement.solr.KMSolrSearch
    msg_buffer_size:64536
    sqllimit:60
    #sqlstats:1
    #log file limit
    numberoflogfiles:10
    maxlogsize:131457280
    #primary_key_mode:0
    dbcachequery:extaccess
    debugprocesses
    threadTerminateWait:2400
    
    #rtm:3
    #sqldebug:1
    #jsgctrigger:67108864
    
    keystoreFile:server.keystore
    keystorePass:changeit
    truststoreFile:cacerts
    truststorePass:changeit
    
    
    =================================================
    SM.cfg
    # start background schedulers
    #
    
    sm -loadBalancer -httpPort:13080 -threadsperprocess:50 
    sm -que:ir 
    
    sm -httpPort:13083 -httpsPort:13084     -log:../logs/sm13083.log -threadsperprocess:50
    sm -httpPort:13093 -httpsPort:13094	-log:../logs/sm13093.log -threadsperprocess:50 -debugNode:1
    sm -bg scheduler problem10 10 1 -log:../logs/problem7.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
    sm -bg scheduler WSCCSV 10 1 -log:../logs/WSCCSV.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
    sm -bg scheduler outage 10 1 -log:../logs/outage.log -httpport:13095 -debugnode:1 -deadnodelocktimeout:1
    
    
    
    #sm -httpPort:13085 -httpsPort:13086 -log:../logs/sm13085.log -threadsperprocess:50
    #sm -httpPort:13081 -httpsPort:13082 -log:../logs/sm13081.log -threadsperprocess:50
    #sm -scautolistener:12790
    #sm -scautolistener:12690
    sm system.start
    
    ********************************************************************************************
    8.79 Passive server : sm.ini
    
    # ServiceManager Initialization file
    # (c) Copyright 2008 Hewlett-Packard Development Company, L.P.
    # Configuration Modified Date:8/13/12 4:24 PM
    shared_memory:512000000
    log:../logs/sm.log
    system:13080
    httpPort:13080
    sslConnector:0
    #httpsPort:13443
    groupbindaddress:10.114.8.79
    sqldictionary:oracle11
    [oracle11]
    sqldb:SNOCSMDB
    sqllogin:hpsmadmin/hpsmadmin
    sqllibrary:sqoracle.oci10.DLL
    plugin0:kmplugin.dll
    grouplicenseip:10.114.8.104
    groupname:smgroup
    groupmcastaddress:224.0.0.255
    groupsubnetaddress:255.255.255.0
    groupport:13100
    threadsperprocess:50
    sessiontimeout:30
    webservices_sessiontimeout:1800
    heartbeatinterval:60
    ir_asynchronous:1
    KMSearchEngineClass:com.hp.ov.sm.server.plugins.knowledgemanagement.solr.KMSolrSearch
    msg_buffer_size:64536
    sqllibrary:sqoracle.oci10.DLL
    sqllimit:60
    sqlstats:1
    #log file limit
    numberoflogfiles:10
    maxlogsize:31457280
    ====================================================
    SM.cfg
    
    
    #
    # start background schedulers
    #
    
    sm -loadBalancer -httpPort:13080
    sm -que:ir 
    sm -httpPort:13081 -httpsPort:13082	-log:../logs/sm13081.log
    sm -httpPort:13083 -httpsPort:13084	-log:../logs/sm13083.log
    sm -httpPort:13085 -httpsPort:13086	-log:../logs/sm13085.log
    sm -scautolistener:12790
    sm -scautolistener:12690
    sm system.start
  • Hi BAG,

    Please find below repoert lb status report

    Microsoft Windows [Version 6.1.7601]
    Copyright (c) 2009 Microsoft Corporation.  All rights reserved.
    
    C:\Users\smadmin>cd C:\Program Files (x86)\HP\Service Manager 9.30\Server\RUN
    
    C:\Program Files (x86)\HP\Service Manager 9.30\Server\RUN>sm -reportlbstatus
    Load Balancer Status:Tue Sep 06 18:33:01 IST 2016
    HP Service Manager LoadBalancer Running on Host:SMRPTSRV.vdfsm.com Port:13080
    List of Hosts:
    
    HostName: SMHELPSRV.vdfsm.com
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        5004       SMHELPSRV-42716      13083       0       (17/50)     N       N     N       RUN          N   (104365304/178978816/58.31154)(3067797504/4294836224/71.42991)
        4792       SMHELPSRV-14324      13080       0       (0/50)      N       N     Y       RUN          N   (90153080/178978816/50.37081)(1115615232/4294836224/25.975735)
        4324       SMHELPSRV-29848      13093       0       (0/50)      Y       N     N       RUN          N   (116332168/178978816/64.99773)(1100410880/4294836224/25.62172)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        6496       SMHELPSRV-50125         RUN          N   (88171024/178978816/49.26339)(2873040896/4294836224/66.89524)   system.start
        9172       SMHELPSRV-20726         RUN          N   (100728920/178978816/56.279804)(1280077824/4294836224/29.805044)   -bg scheduler WSCCSV 10 1 -log:../logs/WSCCSV.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        6384       SMHELPSRV-57173         RUN          N   (105643184/178978816/59.025524)(1118269440/4294836224/26.037535)   -bg scheduler outage 10 1 -log:../logs/outage.log -httpport:13095 -debugnode:1 -deadnodelocktimeout:1
        7868       SMHELPSRV-54425         RUN          N   (106112144/178978816/59.287544)(1152937984/4294836224/26.84475)   -bg scheduler problem10 10 1 -log:../logs/problem7.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
    
    HostName: smsrvapp04
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        4124       SMSRVAPP04-8040      13087       0       (3/30)      Y       N     N       RUN          N   (142572224/178978816/79.658714)(1350209536/4294836224/31.437975)
        5388      SMSRVAPP04-21934      13081       0       (0/30)      Y       N     N       RUN          N   (104833296/178978816/58.57302)(1109561344/4294836224/25.834776)
        3696      SMSRVAPP04-13219      13095       0       (10/30)     Y       N     N       RUN          N   (49628064/178978816/27.728456)(2708283392/4294836224/63.05906)
        5048      SMSRVAPP04-62725      13097       0       (0/30)      Y       N     N       RUN          N   (124434176/178978816/69.52453)(1093832704/4294836224/25.468554)
        2408      SMSRVAPP04-28230      13091       0       (0/30)      Y       N     N       RUN          N   (111478536/178978816/62.285885)(1093832704/4294836224/25.468554)
        2744      SMSRVAPP04-30235      13089       0       (0/30)      Y       N     N       RUN          N   (138931024/178978816/77.62428)(1095143424/4294836224/25.499073)
        4252      SMSRVAPP04-48347      13085       0       (4/50)      Y       N     N       RUN          N   (114766592/178978816/64.123)(1762533376/4294836224/41.03843)
        4792       SMSRVAPP04-9149      13083       0       (0/50)      Y       N     N       RUN          N   (148030440/178978816/82.70836)(1093832704/4294836224/25.468554)
        4344      SMSRVAPP04-36802      13099       0       (0/30)      Y       N     N       RUN          N   (88662376/178978816/49.537914)(1093832704/4294836224/25.468554)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        2968      SMSRVAPP04-27043         RUN          N   (136113480/178978816/76.05005)(1092292608/4294836224/25.432695)   -sync
    
    HostName: SM6APPSRV
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        3604       SM6APPSRV-23705      13097       0       (0/30)      Y       N     N       RUN          N   (38728752/178978816/21.638735)(1106812928/4294836224/25.770782)
        5624       SM6APPSRV-63464      13083       0       (4/30)      Y       N     N       RUN          N   (123088136/178978816/68.77246)(2815467520/4294836224/65.55471)
        1068       SM6APPSRV-11750      13081       0       (13/30)     Y       N     N       RUN          N   (45737904/178978816/25.554924)(1977917440/4294836224/46.053383)
        3056       SM6APPSRV-62050      13087       0       (0/30)      Y       N     N       RUN          N   (52785792/178978816/29.49276)(1353031680/4294836224/31.503685)
        3284       SM6APPSRV-34782      13095       0       (0/30)      Y       N     N       RUN          N   (39918712/178978816/22.303596)(1106812928/4294836224/25.770782)
        4256       SM6APPSRV-40668      13099       0       (7/30)      Y       N     N       RUN          N   (57147240/178978816/31.929611)(2010619904/4294836224/46.814823)
        3560       SM6APPSRV-41900      13085       0       (0/30)      Y       N     N       RUN          N   (89707288/178978816/50.121735)(1539678208/4294836224/35.84952)
        4084       SM6APPSRV-48650      13089       0       (0/30)      Y       N     N       RUN          N   (44696696/178978816/24.973175)(1110745088/4294836224/25.862339)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        4832        SM6APPSRV-694          RUN          N   (30991888/178978816/17.315952)(1124147200/4294836224/26.17439)   -bg scheduler crmprocess 10 1 -log:../logs/crmprocess.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        4472       SM6APPSRV-51917         RUN          N   (29585000/178978816/16.52989)(1156718592/4294836224/26.932775)   -bg scheduler problem6 10 1 -log:../logs/problem6.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
        4676       SM6APPSRV-26813         RUN          N   (30283392/178978816/16.9201)(1157767168/4294836224/26.95719)   -bg scheduler problem7 10 1 -log:../logs/problem7.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
    
    HostName: SMRPTSRV.vdfsm.com
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        9208       SMRPTSRV-43346       13085       0       (17/50)     N       N     N       RUN          N   (87819272/178978816/49.066853)(2913603584/4294836224/67.83968)
        9196       SMRPTSRV-56649       13081       0       (18/50)     N       N     N       RUN          N   (105529632/178978816/58.96208)(3195678720/4294836224/74.40747)
        8252       SMRPTSRV-46029       13080       0       (0/50)      N       N     Y       RUN          N   (102340864/178978816/57.180435)(1130618880/4294836224/26.325075)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        7452       SMRPTSRV-23133          RUN          N   (117345792/178978816/65.564064)(2596900864/4294836224/60.465656)   system.start
        7072       SMRPTSRV-34372          RUN          N   (103890432/178978816/58.04622)(1098866688/4294836224/25.585764)   -scautolistener:12790
        572         SMRPTSRV-4896          RUN          N   (113127840/178978816/63.207394)(1098866688/4294836224/25.585764)   -scautolistener:12690
    
    HostName: SM2APPSRV
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        6156       SM2APPSRV-56768      13097       0       (0/30)      Y       N     N       RUN          N   (89792088/178978816/50.169117)(1012207616/4294836224/23.568014)
        3340       SM2APPSRV-2911       13089       0       (6/30)      Y       N     N       RUN          N   (123308136/178978816/68.89538)(1162235904/4294836224/27.06124)
        8800       SM2APPSRV-5372       13095       0       (0/30)      Y       N     N       RUN          N   (83209920/178978816/46.491493)(1012097024/4294836224/23.56544)
        348        SM2APPSRV-10405      13091       0       (0/30)      Y       N     N       RUN          N   (133163016/178978816/74.40155)(1012363264/4294836224/23.571638)
        4292       SM2APPSRV-44118      13083       0       (16/50)     N       N     N       RUN          N   (148855728/178978816/83.169464)(2139000832/4294836224/49.804012)
        8776       SM2APPSRV-34653      13087       0       (4/30)      Y       N     N       RUN          N   (84914360/178978816/47.443806)(1128968192/4294836224/26.286642)
        4828       SM2APPSRV-58227      13081       0       (6/30)      Y       N     N       RUN          N   (115116144/178978816/64.318306)(1234903040/4294836224/28.753204)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        8280       SM2APPSRV-50614         RUN          N   (116984248/178978816/65.36206)(1019146240/4294836224/23.729572)   -bg scheduler problem2 10 1 -log:../logs/problem2.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
        1928       SM2APPSRV-49992         RUN          N   (101740496/178978816/56.84499)(1020018688/4294836224/23.749886)   -bg scheduler problem4 10 1 -log:../logs/problem4.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
        4264       SM2APPSRV-36945         RUN          N   (134051648/178978816/74.89805)(1025478656/4294836224/23.877014)   -bg scheduler problem3 10 1 -log:../logs/problem3.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        3456       SM2APPSRV-52838         RUN          N   (117654800/178978816/65.73672)(999038976/4294836224/23.261398)   -sync
    
    HostName: SM1APPSRV
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        6440       SM1APPSRV-26535      13081       0       (5/30)      Y       N     N       RUN          N   (43302648/178978816/24.194286)(1639985152/4294836224/38.185043)
        6424       SM1APPSRV-41972      13089       0       (6/30)      Y       N     N       RUN          N   (30100640/178978816/16.81799)(1941708800/4294836224/45.21031)
        6596       SM1APPSRV-20391      13087       0       (6/30)      Y       N     N       RUN          N   (131354072/178978816/73.39085)(2029330432/4294836224/47.250473)
        4400       SM1APPSRV-25963      13097       0       (2/30)      Y       N     N       RUN          N   (97242752/178978816/54.331985)(1358635008/4294836224/31.634151)
        1308       SM1APPSRV-61538      13083       0       (17/50)     N       N     N       RUN          N   (116272032/178978816/64.964134)(3227021312/4294836224/75.137245)
        3292       SM1APPSRV-35718      13085       0       (17/50)     N       N     N       RUN          N   (108263320/178978816/60.48946)(3438206976/4294836224/80.054436)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        1432       SM1APPSRV-43957         RUN          N   (75152552/178978816/41.989635)(1168220160/4294836224/27.200575)   -bg scheduler problem1 10 1 -log:../logs/problem1.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        6448       SM1APPSRV-6352          RUN          N   (73680288/178978816/41.16704)(1187946496/4294836224/27.65988)   -bg scheduler problem 10 1 -log:../logs/problem.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
        1896       SM1APPSRV-41118         RUN          N   (106973896/178978816/59.769028)(1098883072/4294836224/25.586145)   -sync
    
    HostName: SM5APPSRV
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        5412       SM5APPSRV-9252       13099       0       (0/30)      Y       N     N       RUN          N   (149767968/178978816/83.67916)(1123717120/4294836224/26.164377)
        9004        SM5APPSRV-692       13083       0       (0/30)      Y       N     N       RUN          N   (147601496/178978816/82.4687)(1754042368/4294836224/40.84073)
        5100       SM5APPSRV-18354      13081       0       (2/30)      Y       N     N       RUN          N   (149783216/178978816/83.687675)(1647349760/4294836224/38.35652)
        5892       SM5APPSRV-37692      13085       0       (0/30)      Y       N     N       RUN          N   (144927712/178978816/80.974785)(1107136512/4294836224/25.778316)
        7316       SM5APPSRV-16848      13097       0       (0/30)      Y       N     N       RUN          N   (129962320/178978816/72.61324)(1107136512/4294836224/25.778316)
        9144       SM5APPSRV-53211      13095       0       (0/30)      Y       N     N       RUN          N   (122904568/178978816/68.6699)(1107136512/4294836224/25.778316)
        8548       SM5APPSRV-37999      13087       0       (3/30)      Y       N     N       RUN          N   (122344840/178978816/68.35716)(2455539712/4294836224/57.174232)
        4040       SM5APPSRV-1337       13089       0       (3/30)      Y       N     N       RUN          N   (110588112/178978816/61.78838)(2889134080/4294836224/67.26995)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        2952       SM5APPSRV-21800         RUN          N   (134121464/178978816/74.93706)(1171263488/4294836224/27.271435)   -bg scheduler problem8 10 1 -log:../logs/problem8.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
        8756       SM5APPSRV-52846         RUN          N   (125853808/178978816/70.31771)(1174409216/4294836224/27.34468)   -bg scheduler problem9 10 1 -log:../logs/problem9.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        4300       SM5APPSRV-61750         RUN          N   (134772392/178978816/75.30075)(1102974976/4294836224/25.681421)   -sync
        7596       SM5APPSRV-28823         RUN          N   (130207584/178978816/72.750275)(1271468032/4294836224/29.604576)   -bg scheduler alert 10 1 -log:../logs/alert.log -httpport:13097 -debugnode:1 -deadnodelocktimeout:1
    
    HostName: SM7APPSRV.internal.vodafone.com
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        3772       SM7APPSRV-34010      13085       0       (4/50)      Y       N     N       RUN          N   (113729720/178978816/63.54368)(3479302144/4294836224/81.01129)
        292        SM7APPSRV-40267      13097       0       (0/30)      Y       N     N       RUN          N   (149428808/178978816/83.48966)(1116827648/4294836224/26.003963)
        4548       SM7APPSRV-17953      13095       0       (0/30)      Y       N     N       RUN          N   (152288720/178978816/85.08756)(1100247040/4294836224/25.617905)
        3492       SM7APPSRV-28301      13081       0       (4/30)      Y       N     N       RUN          N   (149589120/178978816/83.57923)(2380005376/4294836224/55.41551)
        4140       SM7APPSRV-43359      13089       0       (0/30)      Y       N     N       RUN          N   (82547136/178978816/46.121178)(1096179712/4294836224/25.523201)
        836        SM7APPSRV-23749      13091       0       (0/30)      Y       N     N       RUN          N   (102520744/178978816/57.280937)(1116827648/4294836224/26.003963)
        2184       SM7APPSRV-61963      13099       0       (2/30)      Y       N     N       RUN          N   (159287264/178978816/88.99783)(1204580352/4294836224/28.047178)
        4920       SM7APPSRV-25898      13083       0       (7/50)      Y       N     N       RUN          N   (117342840/178978816/65.56242)(2186878976/4294836224/50.918797)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
    
    HostName: SM3APPSRV
    -----------------------------------------------------------------------------Server Instances-----------------------------------------------------------------------------
     ProcessID     ClusterAddress     HttpPort  HttpsPort  Sessions  DbgMode  QMode  LB      State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT
        2792       SM3APPSRV-35604      13083       0       (17/50)     N       N     N       RUN          N   (50673896/178978816/28.312788)(2936868864/4294836224/68.38139)
        4244       SM3APPSRV-59365      13095       0       (0/30)      Y       N     N       RUN          N   (41590984/178978816/23.237936)(1229697024/4294836224/28.631989)
        5072       SM3APPSRV-19122      13089       0       (3/30)      Y       N     N       RUN          N   (44936768/178978816/25.10731)(2414915584/4294836224/56.22835)
        3636       SM3APPSRV-60305      13085       0       (15/50)     N       N     N       RUN          N   (126170696/178978816/70.49477)(2730971136/4294836224/63.58732)
        4572       SM3APPSRV-9200       13099       0       (4/30)      Y       N     N       RUN          N   (45413008/178978816/25.373398)(1962782720/4294836224/45.700993)
        4756       SM3APPSRV-4125       13081       0       (6/30)      Y       N     N       RUN          N   (63739424/178978816/35.61283)(2325458944/4294836224/54.145462)
        4900       SM3APPSRV-50229      13087       0       (19/50)     N       N     N       RUN          N   (71414920/178978816/39.901325)(3116859392/4294836224/72.57225)
        3952       SM3APPSRV-2035       13091       0       (0/30)      Y       N     N       RUN          N   (41314880/178978816/23.08367)(1233371136/4294836224/28.717535)
        4404       SM3APPSRV-2283       13097       0       (2/30)      Y       N     N       RUN          N   (44648216/178978816/24.94609)(1563340800/4294836224/36.400475)
    ---------------------------------------------------------------------------Non Server Instances---------------------------------------------------------------------------
     ProcessID     ClusterAddress         State      LowMem     JAVA_USED/MAX/PERCENT       HEAP_USED/MAX/PERCENT    Command Line parameters
        3292       SM3APPSRV-49376         RUN          N         (0/67108864/0.0)      (961114112/4294836224/22.378365)   -reportlbstatus
        5420       SM3APPSRV-47161         RUN          N   (12980328/178978816/7.252438)(1226846208/4294836224/28.56561)   -sync
        5264       SM3APPSRV-3334          RUN          N   (26539768/178978816/14.828441)(1280651264/4294836224/29.818396)   -bg scheduler problem5 10 1 -log:../logs/problem5.log -httpport:13093 -debugnode:1 -deadnodelocktimeout:1
        4700       SM3APPSRV-11490         RUN          N   (30230056/178978816/16.890299)(1277505536/4294836224/29.745152)   -bg scheduler problem4 10 1 -log:../logs/problem4.log -httpport:13091 -debugnode:1 -deadnodelocktimeout:1
    
    
    C:\Program Files (x86)\HP\Service Manager 9.30\Server\RUN>
  • you have only 4 servers for load balancer others works only in stand alone server.
    possibility you got 200 licenses and that's all.

  •  LoadBalancer does not forward any clients to the process while debugnode is active.

    https://s3.amazonaws.com/smhelpcenter/smhelp941/codeless/index.html#parameters/reference/parameter_debugnode.htm?Highlight=debugnode

    Check if the concurrent users amount exceed the non debugnode can support; and also check sm.log if there is any severe errors like signal 11 which may cause the issue, and upgrade to latest service manager server&client should solve these issues; another possible cause is the network between loadbalancer and other SM nodes are not stable.

    Hope it helps, 

    Ling-Yan