SNMP & EMail Alerts not getting triggered from BSM 9.26

We have recently installed the BSM 9.26 on our servers and has noticed that BSM was not able to trigger a SNMP or Email alert if the Data Grouping option is selected in the Alert Trigger Criteria.

BSM is throwing the below exception in the alerts.ejb log when the Data Grouping is selected

2016-09-15 10:13:47,393 [pool-AlertMDBContext-thread-72] (AlertTask.java:145) ERROR - Customer ID: 1 Alert ID: 22f7c56cd921aa96f31965bf0cbd1cfb MERQ-120630: Exception was throws while processing an alert, the alert may not be sent
Details=id: 22f7c56cd921aa96f31965bf0cbd1cfb, customer id: 1
java.lang.NullPointerException
at com.mercury.am.eum.alerts.common.extendedproperties.ExtendedPropertiesUtils.addGroupByToCommonMap(ExtendedPropertiesUtils.java:87)
at com.mercury.am.eum.alerts.common.extendedproperties.BpmTransExtendedPropsProvider.getExtendedPropertiesMap(BpmTransExtendedPropsProvider.java:39)
at com.mercury.am.eum.alerts.common.extendedproperties.EUMAlertsExtendedPropertiesHandler.enrichAlertMessageDetails(EUMAlertsExtendedPropertiesHandler.java:33)
at com.mercury.am.platform.processing.alerts.listener.AlertMessageDetails.<init>(AlertMessageDetails.java:168)
at com.mercury.am.platform.processing.alerts.listener.AlertHandler.handleAlert(AlertHandler.java:84)
at com.mercury.am.platform.processing.alerts.listener.AlertTask.run(AlertTask.java:89)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

When the  Data Grouping option is not selected, the alert is getting triggered.

2016-09-13 19:05:03,636 [pool-AlertMDBContext-thread-10] (AlertHandler.java:419) INFO - Alert (id: 22f7c56cd921aa96f31965bf0cbd1cfb, customer id: 1, name: Homepage_Profile Transaction Response time exceeds threshold) was sent sucessfully
2016-09-13 19:05:03,648 [pool-NotificationMDBContext-thread-1] (SnmpV1Notification.java:164) INFO - SNMPv1 trap sent successfully to trapx.com on port 162. (alert id: 22f7c56cd921aa96f31965bf0cbd1cfb)
2016-09-13 19:05:03,649 [pool-NotificationMDBContext-thread-1] (NotificationTask.java:197) INFO - Notification (type: SNMPv1, alert id: 22f7c56cd921aa96f31965bf0cbd1cfb command: Send trap to trapx.com) was executed successfully

Any help is much appreciated

Thanks,

Praveen

Parents
  • Hi Praveen,

    if this is new installation and not an update from an earler 9.2x version, I would say that it is a bug.
    If it's an updated installation, simply try to delete and recreate the alert, perhaps something broke during the upgrade.
    From the stack trace it seems that we fail when trying to add the information "what do we group on" to the alert message.
    BTW, what did you select in area
     Data Grouping
       Group data by specific criteria
          Business Transaction Flow
          Transaction
          Location
          Script
          Mobile Device 

    I did a quick test on my 9.26 IP2 sxystem, with using Group By Location, the email is sent as expected.
    Same when grouping by BTF or Transaction.
    Do you use any additional alert variable in your alert definition?

    Greetings
    Siggi

  • Hey Siggi,

    Thanks for the quick reply.

    This is a brand new installation of 9.26. It is not an update from the previous version.


    I used the below criteria for Data Grouping

    • Transaction
    • Locations

    No, i have not used any additional alert variable in my alert definiton

  • Hi Praveen,

    thanks for the update and for providing all the data.

    After checking alerts.ejb.log I can see that enabling DEBUG logging odesn't help a lot,
    but at least a little bit.

    we have these entities and fail with one (or more) of them:

    2016-09-22 09:01:39,996 [pool-AlertMDBContext-thread-73] (AlertHandler.java:53) DEBUG - Customer [1] handling alert [9f4636755bbbfb9af5ebb152f54c4a9a] in [REGULAR_MODE] mode

    (TriggeredDataContainer.java:144) DEBUG - adding data to group
    [0x30c504e6e09f01ff030d1b73b43f78b3|0x1b4d76f75f237c7633aff210d918804e|]:

    [groupBy:
    0x30c504e6e09f01ff030d1b73b43f78b3
    0x1b4d76f75f237c7633aff210d918804e

    szTransactionName=100_TableauServer_Workbooks
    u_iScriptId=322
    u_iBTFId=0x6a9307a407c3f1f0e48f6ff86944558c
    u_iTransactionId=0x30c504e6e09f01ff030d1b73b43f78b3
    u_iBpmAgentId=1986
    u_iLocationId=0x1b4d76f75f237c7633aff210d918804e
    application_id=0xf910d384933852aaa77bd094240052ed

    2016-09-22 09:01:41,000 [pool-AlertMDBContext-thread-73] (TriggeredDataContainer.java:292) DEBUG - creating new message, current state:[T][E][E][E][E]

    2016-09-22 09:01:41,000 [pool-AlertMDBContext-thread-73] (AlertTask.java:145) ERROR - Customer ID: 1 Alert ID: 9f4636755bbbfb9af5ebb152f54c4a9a MERQ-120630: Exception was throws while processing an alert, the alert may not be sent
    Details=id: 9f4636755bbbfb9af5ebb152f54c4a9a, customer id: 1
    java.lang.NullPointerException
    at com.mercury.am.eum.alerts.common.extendedproperties.ExtendedPropertiesUtils.addGroupByToCommonMap(ExtendedPropertiesUtils.java:87)
    at com.mercury.am.eum.alerts.common.extendedproperties.BpmTransExtendedPropsProvider.getExtendedPropertiesMap(BpmTransExtendedPropsProvider.java:39)
    at com.mercury.am.eum.alerts.common.extendedproperties.EUMAlertsExtendedPropertiesHandler.enrichAlertMessageDetails(EUMAlertsExtendedPropertiesHandler.java:33)

    The only ideas I have are as follows:
    - check whether or not all CIs the alert uses exist in RTSM:

    0x30c504e6e09f01ff030d1b73b43f78b3 <- that's the transaction
    0x1b4d76f75f237c7633aff210d918804e <- that's a location

    BTF
    0x6a9307a407c3f1f0e48f6ff86944558c

    Transaction
    0x30c504e6e09f01ff030d1b73b43f78b3

    Location
    0x1b4d76f75f237c7633aff210d918804e

    Application
    0xf910d384933852aaa77bd094240052ed

    To check, go to BSM -> Admin -> RTSM -> IT Universe Manager -> Modeling
    CI Selector -> Search CIs
    in the field "CI Name" enter the CI ID (omit the 0X)

    here enter one CI ID after the other and check whether it exists or not.

    Here is an example from my system:

    (TriggeredDataContainer.java:144) DEBUG - adding data to group [0xb8506be7abd403959e6d5f74899bbe97|0xe4e4c72c6e0a43d9745c0106df67dd2b|]:

    so I check for 0xb8506be7abd403959e6d5f74899bbe97 and enter "b8506be7abd403959e6d5f74899bbe97" and see that it's a Business Transaction.

    I assume that at least one of the elements do NOT exist in RTSM.

    Greetings
    Siggi

  • Siggi,

    Thank you for looking into it. I have checked the CIs in RTSM and found that all the CIs are present in RTSM. Please find below the screenshot

    Thanks,

    Praveen

  • Siggi,

    Thank you for looking into it. I have checked the CIs in RTSM and found that all the CIs are present in RTSM. Please find below the screenshot

    Thanks,

    Praveen

  • Siggi,

    Thank you for looking into it. I have checked the CIs in RTSM and found that all the CIs are present in RTSM. Please find below the screenshot

    Thanks,

    Praveen

  • Hi Praveen;

    did you already delete the alert and re-create it from scratch, but the issue still occurs?
    Do this occur for all EUM alerts with the same data grouping configuration?
    If it's a yes, then please go ahead and open a case with Support.

    Greetings
    Siggi

  • Hey Siggi,

    No, i have not deleted and created a new alert. Let me test that out and will let you know if that works.

    But, i still having a strong feeling about the alertengine.properties & alertengine,xml files which i sent to you. I have got those files from HP for fixing SNMP dialog box not getting popped up.

    Could you please test your BSM by switching with those files and try to generate an alert for Data Grouping option?

    Thanks,

    Praveen

  • Hi Praveen,

    I tested the files you send me on my BSM 9.26 IP2 system,
    BSM still generates emails fine for EUM alerts with
     Data Grouping on Transaction and Locations
    no errors in alerts.ejb.log ...

    Greetings
    Siggi

  • Hey Siggi,

    Could you please provide the link to download the BSM 9.26 IP2?

    Thanks,

    Praveen

Reply Children