Application Delivery Management
Application Modernization & Connectivity
CyberRes
IT Operations Management
Test Framework gives a set of predefined test scenarios to help you certify a successful upgrade and allows you to adapt and enhance the same based on the feature set used in your Access Manager deployment.
Using this solution, you can perform the following:
In addition to the default features and test cases, you can customize it, if required, as follows:
A high-level flow of actions is described in the below figure:
This document provides you guidelines to set up and use the Test Framework.
This solution has been tested and validated for upgrading Access Manager from version 4.5 to 4.5 Service Pack 2 on a Linux platform.
Ensure that you have the following ready:
NOTES:
The following plugins are needed for Test Framework:
Serial Number |
Plugin Name |
Plugin Description |
1. |
Pytest |
A python-based testing framework that enables us to write test codes in python. |
2. |
Pytest-html |
A plugin for pytest that generates an HTML report for the test results. |
3. |
Pytest-sugar |
A plugin for pytest that shows a progress bar of execution. |
Instead of manually installing these plugins, you can use the setup.py script to easily install these plugins. The script will install the latest version of plugins.
Perform the following steps to run setup.py:
The input.py file works as a property file for Test Framework, which can be used by admins/users to update Access Manager setup details. It is important to update the input.py file with Administration Console, Identity Server, and Access Gateway IPs as given below. Other parameters mentioned in the input.py file are specific to the test cases.
Option |
Description |
Related Information |
Pre-Upgrade or Pre-Install Check |
Readiness and functional check |
An HTML report with name - Precheck_install_report.html or Precheck_upgrade_report.html is generated in folder ‘reports’ after test case execution for further examination. |
Access Manager installation/upgrade |
This option can be used when Access Manager installation or upgrade is automated and admin/user wants to run test cases along with installation/upgrade |
Section ‘Integrating Automated Installation/Upgrade solutions with Test Framework ’outlines the steps to the plug-in automated procedure for Access Manager installation/upgrade into Test Framework. |
Post-upgrade or Post-install checks |
Used to execute test cases which will verify basic Access Manager functionality is working after successful upgrade/installation |
An HTML report with name - Postcheck_install_report.html or Postcheck_upgrade_report.html is generated in folder ‘reports’ after test case execution for further examination. |
Feature functional test cases |
It contains functional test cases specific to Access Manager features. |
|
Custom automated test cases |
This option can be used to run custom automated test cases. |
Refer to ‘Adding Test Cases to Test Framework’ to add custom automated scripts or test cases to Test Framework. |
Exit |
Exits from the Test Framework tool. |
You can run each of the feature test cases individually by selecting respective feature option OR, you can run test cases on multiple features.
NOTE:
Here are different ways in which you can add test cases to the framework.
You can plug the recurrently used automated scripts/test cases into the Test Framework and run as a test case from a single platform with Test Framework.
Follow the steps to add these customized automated scripts:
Example: If the automated script file is named automated_test_case.sh
You can add new test cases to existing features by adding them to the respective test module file. Follow the pytest coding guidelines while adding new test cases.
Example: A new test case for the OAuth feature can be added in the test/test_OAuth.py file. Similarly, for the Analytics Server feature, the new test case can be added in the test_analytics_server.py file.
To add a new feature test module to the Test Framework, follow below steps:
If you are an admin/user who has automated Access Manager installation or upgrades procedure, you can even integrate that solution with Test Framework, and use Test Framework as a single tool to install/upgrade Access Manager and verify successful installation/upgrade using the test cases available in Test Framework.
An Ansible script written to automate the Access Manager upgrade procedure is provided as an example to explain how the automated upgrade solution can be integrated with Test Framework.
NOTE:
Where PLAY RECAP provides a summary of the Ansible task run status against each of the node’s IPs. These nodes IPs can be IPs of Administration Console, Identity Server, or Access Gateway for which the upgrade script was run.