GB/T 31071-2014 English PDF (GBT31071-2014)
GB/T 31071-2014 English PDF (GBT31071-2014)
GB/T 31071-2014: General science and technology infrastructure -- Principles and methods for conformance testing
NATIONAL STANDARD OF THE
PEOPLE REPUBLIC OF CHINA
General science and technology infrastructure -
Principles and methods for conformance testing
ISSUED ON. DECEMBER 22, 2014
IMPLEMENTED ON. JUNE 01, 2015
General Administration of Quality Supervision, Inspection
and Quarantine of the PEOPLE Republic of China;
Standardization Administration of the PEOPLE Republic of
Table of Contents
Foreword ... 3
Introduction ... 4
1 Scope ... 5
2 Normative references ... 5
3 Terms and Abbreviations ... 5
4 Basic Principles of Conformance Testing ... 8
5 Conformance Testing Methods ... 9
6 Conformance Testing Process ... 11
Annex A (Informative) An Example of the Questionnaire of
Implementation Conformance Statement ... 13
Annex B (Informative) An Example of the Abstract Test Suite of GB/T
30523-2014 ?€?Science and Technology Infrastructure - Resource Core
Metadata?€? ... 15
Annex C (Informative) Framework of Conformance Testing Report ... 19
Bibliography ... 21
This Standard is drafted in accordance with the rules specified in GB/T 1.1-2009. This Standard was proposed by and shall be under the jurisdiction of China National Technical Committee for Standardization of Science and Technology Platform (SAC/TC 486).
Drafting organizations of this Standard. China National Institute of Standardization, National Science and Technology Infrastructure Center, Beihang University, Computer Network Information Center, Chinese Academy of Sciences AND Qingdao University. Main drafters of this Standard. Yin Shurui, Wang Zhiqiang, Yang Qinghai, Chen Zhihui, Zhou Qiongqiong, Zhang Hui, Wang Deqing, Liu Ning, Cheng Ping, Hu Yongjian, Zhan Junfeng, Liu Shouhua, Hong Yan and Yin Huaixian.
Science and technology resources have characteristics of wide variety and great quantity. With the help of conformance testing method, science and technology resources, criteria and relevant standards can maintain conformance to avoid unnecessary overlapping, repetition and even contradiction. This Standard produces the criteria to be fulfilled when statements are in conformance to relevant standards. Conformance testing on science and technology resources and standards can accelerate integration and sharing of science and technology resources.
General Science and Technology Infrastructure -
Principles and Methods for Conformance Testing
This Standard specifies the basic principles, methods and process.
This Standard applies to conformance testing BETWEEN science and technology resources, general science and technology infrastructure standards AND relevant standards.
2 Normative references
The following documents are indispensable for application of this document. For the dated documents so quoted, only the dated versions apply to this document. For the undated documents so quoted, the latest versions (including all modification sheets) apply to this document.
GB/T 19333.5-2003 Geographic information - Conformance and testing
3 Terms and Abbreviations
The terms and definitions defined in GB/T 19333.5-2003 and mentioned below apply to this document. For ease of use, some terms and definitions in GB/T 19333.5-2003 are repeated here.
3.1.1 Science and Technology (S and T) Resources
The generic term of human, material and financial resources for science and technology [Translator note. hereafter abbreviated as S and T] activities as well as elements such as organization, management and information.
[GB/T 31075-2014, Definitions 2.2.1]
3.1.2 General Science and Technology (S and T) Infrastructure Standard
A normative document that is agreed to be established and approved by competent standardization organization concerned for joint use or reuse to obtain the best order in the sphere related to the general S and T infrastructure.
[GB/T 31075-2014, Definitions 2.1.5]
Requirements that meet what is specified.
[GB/T 19333.5-2003, Definitions 3.8]
3.1.4 Conformance Assessment Process
The process of conducting a conformance assessment that is realized by a standard. [GB/T 19333.5-2003, Definitions 3.9]
3.1.5 Conformance Clause
Clauses that specify necessary requirements for meeting this Standard.
[GB/T 19333.5-2003, Definitions 3.10]
3.1.6 Conformance Testing
Test that is done on S and T resources and general S and T infrastructure standards, so as to confirm the level of implementation of conformance BETWEEN S and T resources, general S and T infrastructure standards AND relevant standards.
3.1.7 Conformance Test Report
A summary in conformity with this Standard and all the test details that support the general summary.
[GB/T 19333.5-2003, Definitions 3.12]
3.1.8 Abstract Test Case
General tests for specific requirements.
Note. The abstract test case is a formal foundation from which executable test cases are derived. An abstract test case may include one or more test purposes. One abstract test case does not depend on implementation, nor on values. It shall be complete enough to definitely distribute the test determination to every patient observable test result (e.g. test event sequence).
[GB/T 19333.5-2003, Definitions 3.1]
3.1.9 Abstract Test Suite
The abstract test module - it provides all the requirements that need to be met to achieve conformance.
[GB/T 19333.5-2003, Definitions 3.4]
3.1.10 Basic Test
The initial capability test - its purpose is to determine those obvious nonconformance. [GB/T 19333.5-2003, Definitions 3.6]
3.1.11 Capability Test
A test that is designed to determine whether an implementation under test (IUT) is in line with the specific characteristics of a standard described in the test purposes. [GB/T 19333.5-2003, Definitions 3.7]
3.1.12 Executable Test Suite
If the basic test fails to fulfil requirements, a testing laboratory can carry out capability tests. Capability tests shall have the ability to test observable IUT; the ability shall be consistent with what the ICS claims. Within the full scope of the conformance requirements as set forth by corresponding standards, capability tests shall be as compressive as possible. The abstract capability test in ATS is a standardized test.
Basic tests, either abstract or executable in form, shall give as detailed tests to the implementation within the full scope of the conformance requirements specified by a standard as possible. Capability tests shall be carried out when mandatory capability and the IUT-supported optional capability determined in ICS are tested.
Capability tests are served to test whether IUT capability fulfils the conformance requirements, and give causes of failure.
5.4 Test Methods
5.4.1 Classified According to Test Purpose
184.108.40.206 Verification Test
The verification test is the test and assessment carried out to determine whether S and T resources and S and T infrastructure standards meet the specified testing requirements. Even using strict methods of correctness proof, the test shall be able to make clear-cut and exhaustive verification for an implementation.
A verification test ensures that a specific test suite can cover all the connotations of a standard. For technical and economic reasons, however, most standards often make it impractical to carry out verification tests due to their scale and complexity. 220.127.116.11 Falsification Test
A falsification test is a method of developing specific test sets or suites for an implementation according to a standard to test errors in the implementation. The falsification test is simple and easy for operation. However, falsification tests cannot ensure that a specific test suite can cover all the connotations of a standard, because an implementation failed in specific tests or specific test sets can be pronounced not up to a standard. However, even an implementation leads to correct results in a complete test suite, it is still not completely convinced that the implementation is up to a reference standard. 5.4.2 Classified According to Automation Level
18.104.22.168 Automatic Test
Automatic tests can make use of software to carry out the required tests. It can be used for both of verification tests and falsification tests.
Example. Whether the metadata format of the S and T resources of every S and T infrastructure conforms to S and T Infrastructure-Resource Core Metadata.
Considering that there may have many test methods, the test method used shall be reported.
An Example of the Abstract Test Suite of GB/T 30523-2014 ?€?Science and
Technology Infrastructure - Resource Core Metadata?€?
B.1 Abstract Test Suite of Identifiers
B.1.1 Test Case Identifier. Test of Uniqueness
The content of the test case is as follows.
a) Test purpose. ensure the uniqueness of every metadata identifier, which is favorable to the integration and sharing of S and T resources.
b) Test method. check if every metadata ident...