Having problems with your account or logging in?
A lot of changes are happening in the community right now. Some may affect you. READ MORE HERE
Outstanding Contributor.. JimiT Outstanding Contributor..
Outstanding Contributor..
430 views

Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Hi All,

Question about aggregation on SS_T (Sitescope SAM Data via Custom Query Builder).

Seems I can't extract the RAW data from GDE Open API or the Custom Query Builder for the Sitescope data.  It appears the best I can return is one or two samples per hour even if I narrow the SELECT statement time range for a specified hour.

My URL Sitescope Monitor (Monitor Title is 'Url_WebServer_Prod') runs every 10 minutes, I would like to have ALL samples accessible via GDE for any given day or any given hour. 

Is this possible?

Here is my Select Statement used in the web query method...

select byTime(time_stamp, 20, 6, 10) as ByTimeStamp, max(time_stamp) as SampleTime, szMonitorTitle as ApplicationName, szErr as StatusMessage, szCategoryName as StatusCategory, IF(szErr,IS,NULL,SUCCESS,FAILED) as Status, u_iStatus as u_iStatus, u_iQuality as u_iQuality, IF(DowntimeState, >,0,TRUE,FALSE) as DT from ss_t where (time_stamp >= (1532008800) AND time_stamp <= (1532012400) AND szMonitorTitle = ( 'Url_WebServer_Prod ') AND szCategoryName = ( 'status ')) ORDER BY 2

Here are the results for this hour... I am only getting in return one result, I want to be able to return all results for this hour and expect to see at least 5 samples.

ByTimeStamp SampleTime ApplicationName StatusMessage StatusCategory Status u_iStatus u_iQuality DT
1.5320088E9 1.532008804E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE

I run the same query and select time range of 10 hours and here are those results...

select byTime(time_stamp, 20, 6, 10.0) as ByTimeStamp, max(time_stamp) as SampleTime, szMonitorTitle as ApplicationName, szErr as StatusMessage, szCategoryName as StatusCategory, IF(szErr,IS,NULL,SUCCESS,FAILED) as Status, u_iStatus as u_iStatus, u_iQuality as u_iQuality, IF(DowntimeState,>,0,TRUE,FALSE) as DT from ss_t where (time_stamp >= (1532008800) AND time_stamp <= (1532041200) AND szMonitorTitle = ('Url_WebServer_Prod') AND szCategoryName = ('status')) ORDER BY 2

ByTimeStamp SampleTime ApplicationName StatusMessage StatusCategory Status u_iStatus u_iQuality DT
1.5320088E9 1.532008804E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.5320124E9 1.532012404E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.53201528E9 1.532015404E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.532016E9 1.532016003E9 Url_WebServer_Prod monitor disable status FAILED 2 0 FALSE
1.5320196E9 1.532019604E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.5320232E9 1.532023204E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.5320268E9 1.532026804E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.5320304E9 1.532030404E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.532034E9 1.532034004E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE
1.5320376E9 1.532037604E9 Url_WebServer_Prod <empty Variant> status SUCCESS 0 1 FALSE

Much appretiate your responses..

Jim

If you find that this or any post resolves your issue, please be sure to mark it as an accepted solution. Don't forget to Kudo!!
0 Likes
1 Solution

Accepted Solutions
Micro Focus Expert
Micro Focus Expert

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Hi Jim,

another way to determine what is the raw data is by running the "Sitescope cross performance report" for 1-2 hours, just make sure you select the "raw data" radio button.

the answer to your question (is it possible) is YES. by default SiS have data reduction enabled so it will generate sample only if there is status change and not for every monitor run. if you want to change this behavior you need to modify your master.config and change "_topazEnforceUseDataReduction=false" (restart is needed).

note: SiS will send a lot more samples to BSM/APM. make sure you have enough capacity and that you maintain your profile DB correctly (purging and partitioning).

Asaf

5 Replies
Micro Focus Expert
Micro Focus Expert

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Hi Jim,

another way to determine what is the raw data is by running the "Sitescope cross performance report" for 1-2 hours, just make sure you select the "raw data" radio button.

the answer to your question (is it possible) is YES. by default SiS have data reduction enabled so it will generate sample only if there is status change and not for every monitor run. if you want to change this behavior you need to modify your master.config and change "_topazEnforceUseDataReduction=false" (restart is needed).

note: SiS will send a lot more samples to BSM/APM. make sure you have enough capacity and that you maintain your profile DB correctly (purging and partitioning).

Asaf

Outstanding Contributor.. JimiT Outstanding Contributor..
Outstanding Contributor..

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Thanks Asaf,

This is good to know!! 

I b look at the began looking at sitescope api /api/data, would you have a working example of using the /api/data getData?  I can't seem to find a simple example to help me know how to use it.

Jim

If you find that this or any post resolves your issue, please be sure to mark it as an accepted solution. Don't forget to Kudo!!
0 Likes
Micro Focus Expert
Micro Focus Expert

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

no, i dont have, sorry.

0 Likes
Contributor.. corymjacik Contributor..
Contributor..

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Hi Jim,

I could never get getData to work how I wanted it. The one that I found most useful was the getGroupSnapshots() getMonitorSnapshots() ... I've used the SOAP API via PHP to make requests to SiteScope and pull data. By now I think they released the REST API so it should be much simpler.

A good example is here...

https://community.softwaregrp.com/t5/Application-Perf-Mgmt-BAC-BSM/sitescope-api-to-read-particular-monitor-status/td-p/219799

Outstanding Contributor.. JimiT Outstanding Contributor..
Outstanding Contributor..

Re: Aggregation question on SS_T (Custom Query Builder and SAM Reports)

Jump to solution

Thanks Cory, I'll check that out!

I've since made the change to the master.config as per Asaf's mention, I can now see all the samples - made the change just after 9am...

"ByTimeStamp","SampleTime","ApplicationName","StatusMessage","StatusCategory","Status","u_iStatus","u_iQuality","DT","epochByTimeStamp","epochSampleTime"
"07/21/2018 00:30:00","07/21/2018 00:30:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.532097E9","1.532097003E9"
"07/21/2018 01:18:00","07/21/2018 01:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53209988E9","1.532100004E9"
"07/21/2018 02:18:00","07/21/2018 02:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53210348E9","1.532103604E9"
"07/21/2018 03:18:00","07/21/2018 03:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53210708E9","1.532107204E9"
"07/21/2018 04:18:00","07/21/2018 04:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53211068E9","1.532110804E9"
"07/21/2018 05:18:00","07/21/2018 05:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53211428E9","1.532114404E9"
"07/21/2018 06:18:00","07/21/2018 06:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53211788E9","1.532118004E9"
"07/21/2018 07:18:00","07/21/2018 07:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53212148E9","1.532121604E9"
"07/21/2018 08:18:00","07/21/2018 08:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53212508E9","1.532125204E9"
"07/21/2018 09:18:00","07/21/2018 09:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53212868E9","1.532128804E9"
"07/21/2018 09:30:00","07/21/2018 09:30:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321294E9","1.532129403E9"
"07/21/2018 09:36:00","07/21/2018 09:40:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53212976E9","1.532130003E9"
"07/21/2018 09:48:00","07/21/2018 09:50:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213048E9","1.532130603E9"
"07/21/2018 10:00:00","07/21/2018 10:00:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321312E9","1.532131203E9"
"07/21/2018 10:06:00","07/21/2018 10:10:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213156E9","1.532131804E9"
"07/21/2018 10:18:00","07/21/2018 10:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213228E9","1.532132404E9"
"07/21/2018 10:30:00","07/21/2018 10:30:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.532133E9","1.532133004E9"
"07/21/2018 10:36:00","07/21/2018 10:40:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213336E9","1.532133604E9"
"07/21/2018 10:48:00","07/21/2018 10:50:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213408E9","1.532134204E9"
"07/21/2018 11:00:00","07/21/2018 11:00:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321348E9","1.532134804E9"
"07/21/2018 11:06:00","07/21/2018 11:10:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213516E9","1.532135404E9"
"07/21/2018 11:18:00","07/21/2018 11:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213588E9","1.532136004E9"
"07/21/2018 11:30:00","07/21/2018 11:30:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321366E9","1.532136604E9"
"07/21/2018 11:36:00","07/21/2018 11:40:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213696E9","1.532137204E9"
"07/21/2018 11:48:00","07/21/2018 11:50:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213768E9","1.532137804E9"
"07/21/2018 12:00:00","07/21/2018 12:00:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321384E9","1.532138404E9"
"07/21/2018 12:06:00","07/21/2018 12:10:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213876E9","1.532139004E9"
"07/21/2018 12:18:00","07/21/2018 12:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53213948E9","1.532139604E9"
"07/21/2018 12:30:00","07/21/2018 12:30:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321402E9","1.532140204E9"
"07/21/2018 12:36:00","07/21/2018 12:40:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214056E9","1.532140804E9"
"07/21/2018 12:48:00","07/21/2018 12:50:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214128E9","1.532141404E9"
"07/21/2018 13:00:00","07/21/2018 13:00:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.532142E9","1.532142004E9"
"07/21/2018 13:06:00","07/21/2018 13:10:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214236E9","1.532142604E9"
"07/21/2018 13:18:00","07/21/2018 13:20:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214308E9","1.532143204E9"
"07/21/2018 13:30:00","07/21/2018 13:30:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321438E9","1.532143804E9"
"07/21/2018 13:36:00","07/21/2018 13:40:04","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214416E9","1.532144404E9"
"07/21/2018 14:18:00","07/21/2018 14:20:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214668E9","1.532146803E9"
"07/21/2018 14:30:00","07/21/2018 14:30:02","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.5321474E9","1.532147402E9"
"07/21/2018 14:36:00","07/21/2018 14:40:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214776E9","1.532148003E9"
"07/21/2018 14:48:00","07/21/2018 14:50:03","Url_WebServer_Prod","<empty Variant>","status","SUCCESS","0","Good","FALSE","1.53214848E9","1.532148603E9"

 

If you find that this or any post resolves your issue, please be sure to mark it as an accepted solution. Don't forget to Kudo!!
0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.