Having problems with your account or logging in?
A lot of changes are happening in the community right now. Some may affect you. READ MORE HERE
Highlighted
GPatrick Frequent Contributor.
Frequent Contributor.
91 views

Tests marked as failed in Jenkins when SLA is not exceeded, due to errors?

I am trying to set up Jenkins to exectue multiple Load Runner Scenarios. I am able to run most of the tests but there is one that does have some thread safe issues ocurring under load. I would like for my pipeline to continue since this is a known issue that has to be resolved. However, when the error occurs, it fails the test. It looks like if there are any errors reported during the test execution, it is being marked as failed even thought the thresholds for the SLA were not exceeded. The SLA is set up for average response time and there are no error based SLAs set. I am also using the Performance Report Plugin and those thresholds are not being exceeded. 

Thanks 

-George

Console output....

 

Running LoadRunner Scenario step
[LR_WebHTML_Load_MM] $ C:\Jenkins\workspace\LR_WebHTML_Load_MM\HpToolsLauncher.exe -paramfile props18022019131609031.txt
"Started..."
Run build tests
Launcher timeout is 10675199::02:48:05
Controller Polling Interval: 30 seconds
PerScenarioTimeout: 00::00:10:00 minutes
FileSystemTestRunner timeout is 10675199.02:48:05.4775807
Mc connection info is - Mc HostAddress: , McPort: 8080, Username: , TenantId: , UseSSL: 0, UseProxy: 0, ProxyType: 0, ProxyAddress: , ProxyPort: 0, ProxyAuth: 0, ProxyUser: 
1 tests found:
\\{PATH TO SERVER\Jenkins\WebHTML_Load.lrs
============================================================================
18/02/2019 13:16:09 Running: \\{PATH TO SERVER}\WebHTML_Load.lrs
\\{PATH TO SERVER}\Jenkins\WebHTML_Load.lrs
Cleaning up the environment...
Preparing scenario \\{PATH TO SERVER}\WebHTML_Load.lrs for execution.
Load Generator 10.41.8.25 connected
Load Generator 10.41.8.26 connected
setting scenario result folder to C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\LRR
scenario result folder: C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\LRR
Starting scenario...
Scenario run has started
Error: Scenario Execution timeout 00:00:10:00 (d:h:m:s) passed.
Scenario \\{PATH TO SERVER}\WebHTML_Load.lrs ended after 0:10:0.
============================================================================
Analyzing results...
closing Controller
Controller closed
calling analysis report generator
executing Analysis launcher with arguments : "C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\LRR\LRR.lrr" "C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\LRA\LRA.lra" "C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\HTML\HTML.html" ""
time for analysis: 00::00:10:00
starting analysis launcher
creating analysis COM object
creating analysis session
analysis session created
creating HTML reports
HTML reports created
loading errors, if any
error count: 2
Error(s) report:
ID: 0 Name: LoadLogin.c(67) Error -26377 No match found for the requested parameter "ViewStateGenerator2". Either the specified boundaries were not found in the response or the matched text is longer than current max html parameter size of 1028 bytes. The total len_0
ID: 1 Name: LoadLogin.c(67) Error -26377 No match found for the requested parameter "EventValidation2". Either the specified boundaries were not found in the response or the matched text is longer than current max html parameter size of 1028 bytes. The total length_1
Gathering Run statistics
closing session
SLA report:
calculating SLA
SLA calculation done
WholeRunRules : 0
TimeRangeRules : 1
================================
Transaction Name: Action_Transaction
Full Name : Transaction Response Time (Average)
Measurement : AverageTRT
SLA Load Threshold Value : None
LoadThresholds : 1
TimeRanges : 121
status : Passed
================================
saving RunReport.xml to C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\RunReport.xml
saving SLA.xml to C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada\SLA.xml
closing analysis session
time passed: 00::00:01:11
analysis report generator finished
Error: LoadLogin.c(67) Error -26377 No match found for the requested parameter "ViewStateGenerator2". Either the specified boundaries were not found in the response or the matched text is longer than current max html parameter size of 1028 bytes. The total len_0
Error: total number of errors: 1
Error(s) summary: 
0 ignored , 1 errors


Error summary:
1 : LoadLogin.c(67) Error -26377 No match found for the requested parameter "ViewStateGenerator2". Either the specified boundaries were not found in the response or the matched text is longer than current max html parameter size of 1028 bytes. The total len_0

Error: Test FAILED. 1 errors occurred during scenario execution.
Test result: Failed
18/02/2019 13:28:32 Test complete: \\{PATH TO SERVER}\Jenkins\WebHTML_Load.lrs ------------------------------------------------------------------------------------------------------- Cleaning up the environment... ================================================ Run status: Job failed, total tests: 1, succeeded: 0, failures: 1, errors: 0 Failed : \\{PATH TO SERVER}\Jenkins\WebHTML_Load.lrs ================================================ Recording test results Report archiving mode is set to: ALWAYS_ARCHIVE_TEST_REPORT Zipping report folder: C:\Jenkins\workspace\LR_WebHTML_Load_MM\980ada Parsing test run dataset for perfomrance report[Pipeline] }[Pipeline] // stage[Pipeline] stage[Pipeline] { (ANALYZING RESULTS)[Pipeline] perfReportPerformance: Recording LoadRunner reports '**/*LRA.mdb' Performance: Parsing JMeter report file 'C:\Jenkins\jobs\LR_WebHTML_Load_MM\builds\6\performance-reports\LoadRunner\LRA.mdb'. Performance: Percentage of relative difference less than -15.0 % sets the build as [FAILURE] Performance: Percentage of relative difference more than 25.0 % sets the build as [FAILURE] Performance: Percentage of relative difference less than -15.0 % sets the build as [UNSTABLE] Performance: Percentage of relative difference more than 25.0 % sets the build as [UNSTABLE] Performance: Recording LoadRunner reports '**/*LRA.mdb'

 

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.