Benchmark 2 Documentation

 

 

Data analysis software verification Benchmark Test 2
Using Group B signals

 

 

Function of test

 

The function of this test is to check the computation of statistics for square wave signals.

 The statistics to be computed are: 

    Number of Values
    Maximum signal level
    Minimum signal level
    Mean level
    Standard deviation
    Root mean square
    Skew
    Kurtosis

   

Test Group B Signal Details

 

The data is simulated 16 bit Analogue to Digital Converter (ADC) output. The data is scaled to a full-scale range of +/-10 Volts.

Eight signals are supplied in the group.

All files have the names starting with EIS_DATA_B_ followed by:

1_short_V1.TXT          Short duration square wave signal with
                                zero mean and integral number of waves.

1_long_V1.TXT          Long duration square wave signal with
                              zero mean and integral number of waves.

2_short_V1.TXT          Short duration square wave signal with
                                zero mean and non-integral number of waves.

2_long_V1.TXT          Long duration square wave signal with
                              zero mean and non-integral number of waves.

3_short_V1.TXT          Short duration square wave signal with
                                non-zero mean and integral number of waves.

3_long_V1.TXT          Long duration square wave signal with
                               non-zero mean and integral number of waves.

4_short_V1.TXT          Short duration square wave signal with
                                non-zero mean and non-integral number of waves. 

4_long_V1.TXT          Long duration square wave signal with
                               non-zero mean and non-integral number of waves.

Analysis parameters to be used

The data is supplied in ASCII form and each file represents one signal. When loaded into an analysis package the data should be set to a sample rate of 400 samples per second. 

In each case the analysis should be performed on the entire signal. 

Reference results

The design cases for the signals are:

Signal 1_short_V1

Positive level +7.5126 V, Negative level –7.5126 V, Frequency 4.0 Hz, 8000 samples  

Signal 1_long_V1

Positive level +7.5126 V, Negative level –7.5126 V, Frequency 4.0 Hz, 128000 samples

Signal 2_short_V1

Positive level +7.5126 V, Negative level –7.5126 V, Frequency 4.0 Hz, 8054 samples  

Signal 2_long_V1

Positive level +7.5126 V, Negative level –7.5126 V, Frequency 4.0 Hz, 128054 samples

Signal 3_short_V1

Positive level +9.3906 V, Negative level –5.6346 V, Frequency 4.0 Hz, 8000 samples 

Signal 3_long_V1

Positive level +9.3906 V, Negative level –5.6346 V, Frequency 4.0 Hz, 128000 samples

Signal 4_short_V1

Positive level +9.3906 V, Negative level –5.6346 V, Frequency 4.0 Hz, 8054 samples  

Signal 4_long_V1

Positive level +9.3906 V, Negative level –5.6346 V, Frequency 4.0 Hz, 128054 samples

Based on the above the theoretical results are as shown in Table 1. 

Signal

No. Samples

Max. level

Min. level

Mean

R.M.S.

S. D.

Skewness

Kurtosis

B1_short

8000

7.5126

-7.5126

0.0

7.5126

7.5126

0.0

1.0

B1_long

128000

7.5126

-7.5126

0.0

7.5126

7.5126

0.0

1.0

B2_short

8054

7.5126

-7.5126

0.042907822

7.512600001

7.512477466

-0.01142308177

1.000130487

B2_long

128054

7.5126

-7.5126

0.002698702

7.512600000

7.512599513

-0.00071844695

1.000000516

B3_short

8000

9.3906

-5.6346

1.878

7.7438

7.5126

0.0

1.0

B3_long

128000

9.3906

-5.6346

1.878

7.7438

7.5126

0.0

1.0

B4_short

8054

9.3906

-5.6346

1.920907822

7.754173364

7.512477466

-0.01142308177

1.000130487

B4_long

128054

9.3906

-5.6346

1.880698702

7.744428907

7.512599513

-0.00071844695

1.000000516

Note:  All results have been evaluated to the same precision but trailing zeros have been suppressed for clarity.

Table 1 Reference Results

 

 

Acceptable tolerance in computed results

The tolerance on the results of the specified analyses should as follows:

Number of samples processed should be exact.

Maximum and Minimum levels should be within +/- 1 ADC level (i.e. +/- 3.0e-4V referred to a 10V full scale value)

Other results should be accurate to 4 significant figures. (This is considered to be acceptable for normal analysis purposes)

 

Typical Benchmark 2 erroneous results and their causes

If good agreement with the reference results is obtained for the short signals and poor results for the long signals the most likely cause is the use of single precision floating point computation for both cases instead of double precision.  

Results return documents.

In order to aid the working party in the development of benchmark data users are invited to submit the results obtained when employing the tests. These submissions will be assessed by the working party and summaries may be used in presentations and publications of the working party’s activities.

If you wish to submit results please use the document contained in Appendix A.

Appendix A

Benchmark 2.  Analysis results return.

Name:                                                Organisation:                                                Date:

Address:

Email:                                                 Tel:                              Fax:

 

Analysis Package used:                                                  Version:

 

Computer Hardware and operating system details

Processor:                             Speed:                                   Memory size:                       Mb:

Operating System:                     Version:

 

Signal

No. Sample Processed

Max. level

Min. level

Mean

R.M.S.

S. D.

Skewness

Kurtosis

Crest Factor

B_1_short

 

 

 

 

 

 

 

 

 

B_1_long

 

 

 

 

 

 

 

 

 

B_2_short

 

 

 

 

 

 

 

 

 

B_2_long

 

 

 

 

 

 

 

 

 

B_3_short

 

 

 

 

 

 

 

 

 

B_3_long

 

 

 

 

 

 

 

 

 

B_4_short

 

 

 

 

 

 

 

 

 

B_4_long

 

 

 

 

 

 

 

 

 

 

Comments:

 

Suggestions for further benchmark tests:

 

 

 

Return results to:  Dr. B. J .May  1, Westhall Road, Mickleover, Derby. DE3 0PA. UK

Email: verification@e-i-s.org.uk               Tel: +44 (01332) 737034


 

NOTES:

1.      Numeric precision

All results should be quoted to 4 significant figures.

 

2.      Trailing zeros

Trailing zeros may be suppressed.

 

3.      Use of results

The working party may make use of the information received in Analysis results returns for the purpose of promoting the work of the party and for informing the Data Analysis community of the variation of results obtained.

 

When results are used for presentations no reference will be made to either the source or analysis package employed.

 

    

 

Copyright(c) 2003 Engineering Integrity Society. All rights reserved.
verification@e-i-s.org.uk