Author: Neftaly Malatjie

Demonstrated Capabilities

This section provides an overview and summary analysis of the testing program. Describe the overall capabilities and deficiencies of the testing software module or system.  Where tests were intended to demonstrate one or more specific performance requirements, findings should be presented that compare the test results with the performance requirements.  Include an assessment of any differences in the test environment versus the operational environment that may have had an effect on the demonstrated capabilities.  Provide a statement, based on the results of the system or module test, concerning the adequacy of the system or module to meet overall security requirements.

System Deficiencies

This section describes test results showing software deficiencies.  Identify all problems by name and number when placed under configuration control.  Describe the cumulative or overall effect of all detected deficiencies on the system of module.

System Refinements

 

This section itemizes any indicated improvements in system design or operation based on the results of the test period.  Accompanying each improvement or enhancement suggested should be a discussion of the added capability it provides and the effect on the system design.  The improvements should he indicated by name and requirement number when placed under configuration control.

Recommendations and Estimates

This section provides a statement describing the overall readiness for system implementation.  For each deficiency, address the effect on system performance and design.  Include any estimates of time and effort required for correction of each deficiency and any recommendations on the following:

• The urgency of each correction
• Parties responsible for corrections
• Recommended solution or approach to correcting deficiencies

Test Problem Report

This section contains copies of the test Problem Reports related to the deficiencies found in the test results.  The Test Problem Report will vary according to the information system development project, its scope and complexity, etc.  Test Problem Report forms are generated as required and attached to the Test Analysis Reports during testing at the integration level and higher.  The disposition of problems found, starting with integration testing should be tracked and reported under configuration control.

Test Analysis Approval Determination Form

This section contains one copy of the Test Analysis Approval Determination form. This form briefly summarizes the perceived readiness for migration of the software. In the case of a User Acceptance Test, it serves as the user’s recommendation for migration to production.

This section summarizes the test results, organized according to the numbered requirements listed in the Trace ability section of the test plan.  Each numbered requirement should be described in a separate section.  Repeat the subsections of this section for each numbered requirement covered by the test plan.

Requirement Number and Name

The requirement number provided in the title to this section is the number from the requirements trace ability matrix in the test plan and the name provided is the requirement’s short name.

Findings

This subsection briefly describes the requirement, including the software and hardware capabilities, and states the findings from one or more tests.

Limitations

This subsection describes the range of data values tested, including dynamic and static data, for this requirement and identifies deficiencies, limitations, and constraints detected in the software and hardware during the testing.

 

 

Results of a test must be recorded in the test analysis report.

Test Analysis Report

 

Overview

The Test Analysis Report documents software testing unit/module, subsystem integration, system, user acceptance, and security – as defined in the test plan.  The Test Analysis Report records results of the tests., presents the capabilities and deficiencies for review, and provides a means of assessing software progression to the next stage of development or testing.  Results of each type of test are added to the software development document for the module or system being tested.  Reports are created as required in the remaining phases. The set of Test Analysis Reports provides a basis for assigning responsibility for deficiency correction and follow up, and for preparation of a statement of project completion.

 

Test Problem Report forms are generated as required and attached to the Test Analysis Reports during testing at the integration level and higher.  The disposition of problems found, starting with integration testing, will be traced and reported under configuration control.

 

PURPOSE

This section should present a clear, concise statement of the purpose for the Test Analysis Report.

 

SCOPE

This section identifies the software application system tested and the test(s) conducted covered by this Test Analysis Report.  The report summarizes the results of tests already conducted and identities testing that remain to be conducted.  Provide a brief summary of the project objectives, and identify the System Proponent and users.

REFERENCE: DOCUMFNTS

This section provides a bibliography of key project references and deliverables applicable to system software testing. 

Security

This section describes any security considerations associated with the system or module being tested, the test analysis, and the data begin handled – such as confidentiality requirements, audit trials, access control, and recoverability.  If this Test Analysis Report is not documenting the formal security test, also summarize the security capabilities included in the system or module test and itemize the specific security deficiencies detected while conducting the test.

The results of specific tests, findings, deficiency analysis, and recommendations will be discussed in the subsequent sections.  Reference those portions of this document that specifically address system security issues.  If no deficiencies were detected during the system or module test, state this fact.

Glossary

This section defines all terms and provides a list of abbreviations used in the Test Analysis Report.  If the list is several pages in length, it may be placed as an appendix.

TEST ANALYSIS

This section describes the results of each test performed.  Tests at each level should include verification of access control and system standards, functionality, and error processes.  Repeat the subsections of this section for each test performed.

Test Name

The test performed for the specified unit, module, subsystem, or system is discussed in this section.  For each test, provide the subsequent sections.

System Function

A high-level description of the function tested and a description of system capabilities designed to satisfy these functions are contained in this section.  Each system function should be described separately.

Functional Capability

This section evaluates the performance of each function demonstrated in the test.  This section also assesses the manner in which the test environment may be different from the operational environment and the effect of this difference on functional capabilities.

Performance Capability

This section quantitatively compares the software performance characteristics with the criteria stated in the test plan.  The comparison should identify deficiencies, limitations, and constraints detected for each function during testing.  If appropriate, a test history or log can be included as an appendix.

Tests must be planned and documented to ensure that test coverage is systematic and complete.

The test documentation tree

• test plan
• test design description
• test procedure description
• test case description
• test incident report
• test log
• test summary report