GB/T 38665.1-2020 English PDF (GBT38665.1-2020)

Delivery: 3 seconds. Download true-PDF + Invoice.
Get Quotation: Click GB/T 38665.1-2020 (Self-service in 1-minute)
Historical versions (Master-website): GB/T 38665.1-2020
Preview True-PDF (Reload/Scroll-down if blank)

GB/T 38665.1-2020: Information Technology - Gesture Interaction System - Part 1: General Technical Requirements
GB/T 38665.1-2020
Information technology--Gesture interaction system--Part 1.General technical requirements
ICS 35.240
L60
National Standards of People's Republic of China
Information technology gesture interaction system
Part 1.General technical requirements
2020-04-28 release
2020-11-01 implementation
State Administration of Market Supervision and Administration
Issued by the National Standardization Management Committee
Contents
Foreword I
1 Scope 1
2 Normative references 1
3 Terms and definitions 1
4 Gesture interaction system framework 2
5 Functional requirements 3
6 Performance requirements 5
Reference 7
Foreword
GB/T 38665 "Information Technology Gesture Interaction System" is intended to be divided into 10 parts.
---Part 1.General technical requirements;
---Part 2.External interface of the system;
---Part 3.General test methods;
---Part 4.Gesture interactive interface design tool;
---Part 5.Design guidelines for desktop gesture interaction;
---Part 6.Design Guidelines for Pen Gesture Interaction;
---Part 7.Design Guidelines for Touch Gesture Interaction;
---Part 8.Design Guidelines for Air Gesture Interaction;
---Part 9.Design Guidelines for Two-Hand Gesture Interaction;
---Part 10.Guidelines for interactive design of body posture.
This part is Part 1 of GB/T 38665.
This section was drafted in accordance with the rules given in GB/T 1.1-2009.
Please note that some content of this document may involve patents. The issuer of this document does not assume responsibility for identifying these patents.
This part is proposed and managed by the National Information Technology Standardization Technical Committee (SAC/TC28).
This section was drafted by. China Electronics Standardization Institute, Institute of Software, Chinese Academy of Sciences, Beijing Institute of Technology, Chinese Academy of Sciences
Institute of Psychology, Institute of Computing Technology, Chinese Academy of Sciences, Tsinghua University, Beijing University of Aeronautics and Astronautics, Lenovo (Beijing) Co., Ltd., Intel
(China) Research Center Co., Ltd., Beijing Film Academy.
The main drafters of this section. Wang Cong, Tian Feng, Dai Guozhong, Wang Yongtian, Fu Xiaolan, Chen Xilin, Shi Yuanchun, Liang Xiaohui, Wang Qianying, Song Jiqiang,
Huang Jin, Fan Xiangmin, Ma Shanshan, Song Weitao.
Information technology gesture interaction system
Part 1.General technical requirements
1 Scope
This part of GB/T 38665 specifies the general functional requirements and performance requirements for gesture interaction systems.
This section applies to the development and testing of gesture interaction systems.
2 Normative references
The following documents are essential for the application of this document. For dated references, only the dated version applies to this article
Pieces. For the cited documents without date, the latest version (including all amendments) applies to this document.
GB/T 18976-2003 Human-centered interactive system design process
GB/T 38665.2-2020 Information technology gesture interaction system Part 2.System external interface
3 Terms and definitions
The terms and definitions defined in GB/T 18976-2003 and the following apply to this document.
3.1
Gesture
The specific gestures or actions performed by the user when using the upper limbs (including hands and arms) to express their interaction intentions.
3.2
Static gesture
Gestures that express the intention of interaction in a static posture of the upper limbs.
3.3
Dynamic gesture
Gestures expressing interaction intentions with upper limb movements.
3.4
Gesture control instruction gestureinstruction
System operation instructions corresponding to gestures during the gesture interaction control process.
3.5
Gesture recognition gesturerecognition
The gesture is discriminated from the input gesture data.
3.6
Gesture interaction system
Perform gesture recognition on gesture signals with specific meaning, that is, gesture information performed by the user collected by the hardware device, and make
Response and feedback software system.
3.7
Gesture start gestureactivation
Identifies the event where the gesture starts.
3.8
Gesture end gesturecompletion
Identifies the event that the gesture ends.
3.9
Gesture cancellation gesturecancelation
Cancel gesture input during execution.
3.10
Gesture set gestureset
A collection of gestures expressing various interaction intentions.
Example. In a slide show control software, the two gestures of "waving hand to the left" and "waving hand to the right" indicate the interactive meaning of "previous page" and "next page", respectively
Figure, the set of these two gestures is the gesture set of this software.
4 Gesture interaction system framework
The gesture interaction system processes the stream of gesture signals collected by the input device, outputs gesture control instructions to the application, and the application obtains gestures
After the control instruction, the business logic is processed and the feedback instruction is issued to the gesture interaction system.Finally, the gesture interaction system outputs control to the output device
Control signals to output the processing results to the user.
The gesture interaction system provides management interfaces related to the gesture set module, gesture recognition module and interactive decision module for the application, as shown in Figure 1.
Show. The wiring in the figure represents the interoperable interface between the modules.
The arrow direction indicates the transmission direction of the gesture interaction information flow.
This section only specifies the general technical requirements for gesture interaction systems.
The gesture interaction system includes a gesture set module, a gesture recognition module, an interactive decision module, and a feedback module.
a) The gesture set module is a module used by the computer system to implement the gesture set-related functions. It provides gesture templates to the gesture recognition module
data. The gesture set module also provides an interface related to gesture set management to the application.
b) The gesture recognition module matches the gesture signal stream obtained by the input device with the gesture template provided by the gesture set module, and
The gesture signal flow is transformed into a gesture recognition result with certain semantics. At the same time, the gesture recognition module
Processing, and also get the information about the start and end of the gesture, the execution status of the gesture, and the cancellation of the gesture, which are together with the gesture recognition result
Collectively referred to as gesture recognition information, it is output to applications, interactive decision-making modules and feedback modules for further processing. Gesture Recognition
The module also provides the application with the relevant interface of the gesture recognition module management.
c) The interactive decision-making module is responsible for making interactive decisions based on the recognized gestures, and then gives gesture control instructions to the application. Interaction
The decision module also provides an interface for binding gestures and gesture control instructions to the application.
d) The feedback module is responsible for converting the feedback information provided by the gesture recognition module and the application into information that can be processed by the output device in order to optimize
Then output the processing result of the gesture interaction system to the user.
Explanation.
1 --- The interface between the user and the input device, the user's gesture information is collected by the input device through this interface;
2 --- The interface between the input device and the gesture recognition module, through which the input device outputs a gesture signal stream to the gesture recognition module;
3 --- The interface between the gesture recognition module and the gesture set module, the gesture recognition module obtains the gesture template data from the gesture set module through this interface;
4 --- The interface between the gesture recognition module and the application.The gesture recognition module outputs gesture recognition information to the application through the interface, and the application uses the interface to gesture
Identification module for configuration management;
5 --- The interface between the gesture recognition module and the interactive decision module, through which the gesture recognition module outputs gesture recognition information to the interactive decision module;
6 --- The interface between the gesture recognition module and the feedback module, through which the gesture recognition module outputs gesture recognition information to the feedback module;
7 --- The interface between the interactive decision module and the application.The interactive decision module outputs gesture control instructions to the application through the interface, and the application interacts through the interface
Decision module for configuration management;
8 --- The interface between the application and the feedback module, the application provides application-related feedback information to the feedback module through the interface;
9 --- The interface between the feedback module and the output device, through which the feedback module outputs feedback information that the hardware device can process to the output device;
10---The interface between the output device and the user, through which the output device outputs the final feedback of the gesture interaction system to the user;
11---The interface between the application and the gesture set module, the application manages the gesture set of the gesture set module through the interface.
Figure 1 Gesture interaction system framework
5 Functional requirements
5.1 Gesture set module
The functions of the gesture set module are as follows.
a) At least one gesture set should be provided, and each gesture set should contain at least two gestures;
b) The name and operation description of each gesture should be provided;
c) It is advisable to provide service functions for adding gesture sets and removing gesture sets for applications;
d) The application should provide the service functions of adding gestures and removing gestures in any gesture set.
Example. The gesture set module provides a gesture set that contains two gestures of "five-fist fist" and "single-finger click". "Five-finger fist" means calling out the dish
Single, "single finger click" means selection.
5.2 Gesture recognition module
The functions of the gesture recognition module are as follows.
a) At least one gesture collection method should be provided so that the gesture interaction system can perceive the user's gesture input behavior;
Example 1.Collect the user's gestures through the data gloves worn on the hands and convert them into the position and posture change data of the key points that the computer can handle
information.
Example 2.Collect the user's gestures through the camera and convert them into image or video data information that can be processed by the computer.
b) One or more methods for judging the start and end of gestures should be provided. These judgments can be performed manually by the user or by
Automatic computer execution, see 5.1 of ISO /IEC 30113-1.2015;
Example 3.When browsing photos using a gesture interaction system that uses data gloves as input devices, extend the right hand and swipe from right to left once and retract the right watch
Turn to the next page. The gesture interaction system considers the gesture to start when it detects the occurrence of a right-hand motion, and considers the gesture to end when it detects that the right-hand motion has disappeared.
Example 4.When moving an object in a gesture interaction system that uses a camera as an input device, it is detected that the fist is considered to be the start of the gesture, and the open hand is detected.
The gesture ends.
c) At least one method should be provided to allow gesture cancellation during input, see 5.5 of ISO /IEC 30113-1.2015;
Example 5.If the gesture input duration exceeds 5000ms, the current gesture input is automatically canceled.
Example 6.When using the camera as an input device, if the hand is quickly withdrawn from the shooting area of the camera when the gesture input is not completed, it is considered to be canceled
Current gesture input.
d) A pre-processing method of gesture input signal should be provided, which can convert the static gesture or dynamic gesture input signal input by the user into
Information form suitable for gesture recognition algorithm processing;
e) The assembly of the recognition algorithm corresponding to the gesture set should be provided, so that the system can recognize the gesture input by the user, and the recognition algorithm can
It can be local or in the cloud;
f) It is advisable to provide services for the application to add recognition algorithm, remove recognition algorithm and set current recognition algorithm for the recognition algorithm module
Features;
g) A unique, pre-defined identification result (instruction) that can be identified by the interactive decision-making module should be provided.
5.3 Interactive Decision Module
It should provide the function of binding gestures with the application's gesture control instructions in order to get the gestures input by the user in the gesture interaction system
After that, the application can be driven to complete the corresponding operation.
Example. When the "fist fist" gesture is bound to the browser's "page turning" gesture control instruction, the user can control the browser to execute the "fist fist" gesture
"Page turning" operation.
5.4 Feedback module
The feedback module functions are as follows.
a) The user should be informed of the result of the gesture recognition by at least one of visual, auditory, tactile or other feedback methods, see ISO /IEC
30113-1.5.4 of.2015;
Example 1.The user performs a "fist" gesture, and when the gesture is recognized successfully, the display shows the "fist" gesture icon.
Example 2.The user per...