Benchmark1 Documentation
 

 

Data analysis software verification Benchmark 1
using Test Group A signals

Function of test

The function of this test is to check the ability of the analysis package to import and convert the supplied ASCII data into engineering form ready for the computation of the following basic signal statistics:

Maximum signal level

Minimum signal level

Mean level

Standard deviation

Root mean square

Test Group A Signal Details

The data are integers simulating an Analogue to Digital Converter (ADC) output. The data are constrained to lie in the range –32767 to +32767 and the intended full scale range of the ADC is +/-10 Volts. For each of the signals three files are supplied simulating output from 12, 14 and 16 bit ADCs. In all cases the full range equivalent value for a 10 Volt input will be 32768.

Twenty-four files in eight subsections are supplied for this test group.

All files have the names starting with EIS_DATA_ followed by:

A_1_12bit.TXT )
A_1_14bit.TXT )         Short duration positive static signal without quantizing noise A_1_16bit.TXT )

A_2_12bit.TXT )
A_2_14bit.TXT )         Short duration positive static signal with quantizing noise
A_2_16bit.TXT ) 

A_3_12bit.TXT )
A_3_14bit.TXT )         Long duration positive static signal without quantizing noise
A_3_16bit.TXT ) 

A_4_12bit.TXT )
A_4_14bit.TXT )         Long duration positive static signal with quantizing noise
A_4_16bit.TXT ) 

A_5_12bit.TXT )
A_5_14bit.TXT )         Short duration negative static signal without quantizing noise
A_5_16bit.TXT ) 

A_6_12bit.TXT )
A_6_14bit.TXT )         Short duration negative static signal with quantizing  noise
A_6_16bit.TXT ) 

A_7_12bit.TXT )
A_7_14bit.TXT )         Long duration negative static signal without quantizing noise
A_7_14bit.TXT ) 

A_8_12bit.TXT )
A_8_14bit.TXT )         Long duration negative static signal with quantizing  noise
A_8_16bit.TXT ) 

Analysis parameters to be used

The data is supplied in ASCII form and each file represents one signal. When loaded into an analysis package the data should be set to a sample rate of 250 samples per second.

To be representative of normally acquired data the signals should be scaled to represent a full-scale value of 10.0 Volts (i.e. the supplied numbers should be divided by 3276.8)

In each case the analysis should be performed on the entire signal.

Reference results

The design case for the signals is:

 7.5126 Volts for the positive signals

-7.4873 Volts for the negative signals

Based on the above the above the reference analysis results should be as shown in Table 1.


Signal

Mean

Max. level

Min. level

S. D.

R.M.S.

No. Samples

A_1_12bit.TXT

7.51465

7.51465

7.51465

0.0

7.51465

8000

A_1_14bit.TXT

7.51221

7.51221

7.51221

0.0

7.51221

8000

A_1_16bit.TXT

7.51251

7.51251

7.51251

0.0

7.51251

8000

A_2_12bit.TXT

7.51260

7.51953

7.50977

 

7.51260

8000

A_2_14bit.TXT

7.51260

7.51343

7.51099

 

7.51260

8000

A_2_16bit.TXT

7.51260

7.51281

7.51220

 

7.51260

8000

A_3_12bit.TXT

7.51465

7.51465

7.51465

0.0

7.51465

128000

A_3_14bit.TXT

7.51221

7.51221

7.51221

0.0

7.51221

128000

A_3_16bit.TXT

7.51251

7.51251

7.51251

0.0

7.51251

128000

A_4_12bit.TXT

7.51260

7.51953

7.50977

 

7.51260

128000

A_4_14bit.TXT

7.51260

7.51343

7.51099

 

7.51260

128000

A_4_16bit.TXT

7.51260

7.51281

7.51220

 

7.51260

128000

A_5_12bit.TXT

-7.48535

-7.48535

-7.48535

0.0

7.48535

8000

A_5_14bit.TXT

-7.48779

-7.48779

-7.48779

0.0

7.48779

8000

A_5_16bit.TXT

-7.48718

-7.48718

-7.48718

0.0

7.48718

8000

A_6_12bit.TXT

-7.48730

-7.48047

-7.49023

 

7.48730

8000

A_6_14bit.TXT

-7.48730

-7.48657

-7.48901

 

7.48730

8000

A_6_16bit.TXT

-7.48730

-7.48688

-7.48749

 

7.48730

8000

A_7_12bit.TXT

-7.48535

-7.48535

-7.48535

0.0

7.48535

128000

A_7_14bit.TXT

-7.48779

-7.48779

-7.48779

0.0

7.48779

128000

A_7_16bit.TXT

-7.48718

-7.48718

-7.48718

0.0

7.48718

128000

A_8_12bit.TXT

-7.48730

-7.48047

-7.49023

 

7.48730

128000

A_8_14bit.TXT

-7.48730

-7.48657

-7.48901

 

7.48730

128000

A_8_16bit.TXT

-7.48730

-7.48688

-7.48749

 

7.48730

128000

Table 1.  Reference results for Group A signals.

Acceptable tolerance in computed results

The tolerance on the results of the specified analyses should be no more than the equivalent of +/- 1 ADC level.

Quantization

± 1 bit

7.5126

-7.4873

 

 

max

min

max

min

12

± 0.00483

7.517483

7.507717

-7.482417

-7.492183

14

± 0.00122

7.513821

7.511379

-7.486079

-7.488521

16

± 0.00031

7.512905

7.512295

-7.486991

-7.487605

Table 2.  Permitted tolerances

Typical erroneous results and their causes

If good agreement with the reference results is obtained for the short signals and poor results for the long signals the most likely cause is the use of single precision floating point computation for both cases instead of double precision.

Results return documents.

In order to aid the working party in the development of benchmark data users are invited to submit the results obtained when employing the tests. These submissions will be assessed by the working party and summaries may be used in presentations and publications of the working party’s activities.

If you wish to submit results please use the document contained in Appendix A.

Issue 2 08/08/2003

© Engineering Integrity Society 2002


Appendix A

Analysis results return.

Name: -                                                          Organisation: -                                 Date: -

Address: -

 

Email: -                                                          Tel: -                           Fax: -

 

 

Analysis Package used: -                                                   Version: -

 

Computer Hardware and operating system details

Processor: -                          Speed: -                                 Memory size: -         Mb

Operating System: -                       Version: -

 

Signal

Mean

Max. level

Min. level

S. D.

R.M.S.

No. Sample Processed

A_1_12bit.TXT

 

 

 

 

 

 

A_1_14bit.TXT

 

 

 

 

 

 

A_1_16bit.TXT

 

 

 

 

 

 

A_2_12bit.TXT

 

 

 

 

 

 

A_2_14bit.TXT