System Evaluation¶

Engineers must be honest and realistic in stating claims or estimates based on available data [1]. Therefore, you must objectively evaluate your work and report accomplishments based on available data. Consider the following issues to plan your system evaluation activities.

System Evaluation Worksheet - export:template documents/System Evaluation Worksheet.xlsx

1. Define Evaluation Objectives and Criteria
   a. Verification – Evaluate whether or not your system (solution) meets the requirements and specifications.
   b. Validation – Evaluate whether or not your system (solution) meets the client’s (customers’) needs.
2. Choose Evaluation Methods and Techniques – Testing a system is one of the evaluation methods. Examples of other methods are as follows.
   a. Tests – Apply known input and compare the output(s) against expected values.
   b. Simulations
   c. Inspections
   d. Reviews, such as software codes and mathematical derivation.
3. Select Approaches
   a. When a system is evaluated manually, procedures must be defined.
   b. When a system is evaluated automatically, an appropriate (test) environment, such as unit test codes, must also be developed.
4. Resources – Examples of resources in evaluations are as follows.
   a. Inputs
   - Calibrated samples
   - Signal generator for circuit designs
   - Test data for software testing
   b. Fixture for repeatable tests
   c. Measuring apparatus
   d. Focus group (volunteers) for usability tests

References
[1] IEEE, "IEEE Code of Ethics," [Online]. Available: https://www.ieee.org/about/corporate/governance/p7-8.html.