Highlighted
Outstanding Contributor.. Outstanding Contributor..
Outstanding Contributor..
307 views

LoadRunner vs SoapUI: differences

Hi all, 

I've tested a web-service with LoadRunner, 10 Vusers for 10 minutes. Leave out other metrics, but I have a lot of HTTP 500 error. I tryed also with SoapUI (usually I use it for a premilinary single web service call), simulating a load test with 10 Threads (in SoapUI that's the name for Vusers) and 10 minutes, but there aren't errors. 

Can anyone explain me this particular behavior? I know that the logic of the test are different: LoadRunner use load generators unlike to SoapUI, but the results and some other informations about differences between two products are interesting. 

Thank you very much,

Lorenzo

0 Likes
6 Replies
Highlighted
Super Contributor.
Super Contributor.

Do you have LR running in the same machine as SOAPUI? I have seen such errors when there is a firewall between the LR machine and the host. From the LR machine, can you try to ping the loadbalancer or the app server (whichever comes first) and see if you can ping?

Highlighted
Outstanding Contributor.. Outstanding Contributor..
Outstanding Contributor..

Hi J_Jena, 

thanks for response. I've tested the application with LoadRunner and SoapUI from the same workstation, and I can ping the server machine. 

As I sayd, inconvenience lies on performance differences: from LoadRunner I have some errors, but there aren't similar evidence from SoapUI. 

Thanks for the help,

Lorenzo

0 Likes
Highlighted
Trusted Contributor.
Trusted Contributor.

Hi,

Do you run the vusers as a process? If not you can try it.

Hier is explained the Multithreading

The Controller uses a driver program (such as mdrv.exe or r3vuser.exe) to run your Vusers. If you
run each Vuser as a process, then the same driver program is launched (and loaded) into the
memory again and again for every instance of the Vuser. Loading the same driver program into
memory uses up large amounts of RAM (random access memory) and other system resources.
This limits the numbers of Vusers that can be run on any load generator.
Alternatively, if you run each Vuser as a thread, the Controller launches only one instance of the
driver program (such as mdrv.exe), for every 50 Vusers (by default). This driver process/program
launches several Vusers, each Vuser running as a thread. These threaded Vusers share segments
of the memory of the parent driver process. This eliminates the need for multiple re-loading of the
driver program/process saves much memory space, thereby enabling more Vusers to be run on a
single load generator.

2. The following article could help by error 500 with SOAP

 

https://softwaresupport.softwaregrp.com/doc/KM820303

HTTP 500 and a SOAP Fault during replay of a Web Service script

Solution: Add "ExpectedResponse=AnySoap" in the web_service_call functions

BR,

 

Valentin

 

Highlighted
Outstanding Contributor.. Outstanding Contributor..
Outstanding Contributor..

Valentin, 

thanks for the interesting response, and the use of the header "ExpectedResponse=AnySoap" is newsworthy in case of HTTP 500. 

But my doubt was about the difference between results on LoadRunner and SoapUI runs: in the first case, I have some HTTP 500 error (even if I add the header "ExpectedResponse") but there aren't with SoapUI. This is strange, because the launch configuration (users/threads, duration, web service call) is the same. 

Thanks for every type of help about this matter,

Lorenzo

0 Likes
Highlighted
Trusted Contributor.
Trusted Contributor.

Hi,

 

From your explanation I understand that you have this problem only by concurrent vusers in Loadrunner and for this reason I suggested to run the vusers as a process. (Runtime Settings - Miscellaneous - Run Vuser as a process)

BR,

Valentin

 

0 Likes
Highlighted
Outstanding Contributor.. Outstanding Contributor..
Outstanding Contributor..

Sorry Valentin, 

I had forgotten to tell you that I have just tried a run with "Run Vuser as a process" option under "Runtime Settings" page from Controller...but the results is the same. 

I'm curious to know why results are differents despite SoapUI see Vusers as threads, exactly as I handle multithreading in LoadRunner's runs.

Have you other ideas about this particular topic?

Thank you very much,

Lorenzo

0 Likes
The opinions expressed above are the personal opinions of the authors, not of Micro Focus. By using this site, you accept the Terms of Use and Rules of Participation. Certain versions of content ("Material") accessible here may contain branding from Hewlett-Packard Company (now HP Inc.) and Hewlett Packard Enterprise Company. As of September 1, 2017, the Material is now offered by Micro Focus, a separately owned and operated company. Any reference to the HP and Hewlett Packard Enterprise/HPE marks is historical in nature, and the HP and Hewlett Packard Enterprise/HPE marks are the property of their respective owners.