Object recognition is a tag recognition interaction system based on touch screens, consisting of a touch screen and physical tag markers, as well as a software low-level recognition program and an upper-level effect program. It supports the simultaneous display of multiple markers. Markers are embedded or bonded to the bottom of the object to be recognized. When the Marker touches the touch screen, The object recognition program identifies its ID and location information and sends a TUIO message to the interactive media application, which pops up an introduction (ID& Angle) about the product or service. The latter can then execute the associated media interaction instructions based on this.

Camera: Traditional camera object recognition technology mainly relies on cameras placed under or above the table to detect and identify objects. It has requirements for the thickness of the table surface and ambient light, and has low recognition accuracy and extremely high costs, which seriously affects its large-scale application and promotion. Advantages: Simple operation. Disadvantages: Thick countertop, affected by light, low precision, high cost.

Infrared: Early - Infrared frame object recognition screens, applied in exhibition halls. However, the infrared frame is protruding on the display screen. If water or beverages are spilled on the screen, it will cause water to enter the screen and prevent it from displaying normally. Advantages: Low cost, simple operation. Disadvantages: The appearance has grooves and is not waterproof or dustproof. Capacitive: Capacitive screen object recognition is a new type of intelligent recognition technology. It can identify multiple specially designed modules on the capacitive touch screen, sense different exquisite pictures, and easily and coolly achieve human-computer interaction. Advantages: Smooth and beautiful appearance, waterproof and dustproof. Disadvantage: There are requirements for the thickness of the glass.

High signal-to-noise ratio capacitive film, a conductor that can cause the alarm point of the capacitive screen, capacitive screen. Because the signal of the touch block is much smaller than that of a normal hand, the capacitive screen board, card glass, etc. all need to be optimized in design. The identification technology seems simple on the surface, but in reality, it needs to ensure that multiple tags do not interfere with each other and that tags do not interfere with hands.

TUIO is a universal interface, but it is a one-way interface. Application software cannot communicate with the recognition system in real time as needed. Unlike the Native plugin interface, TUIO's carrier is UDP. USB hardware cannot directly issue UDP and needs to start a protocol conversion process. In terms of convenience, it is inferior to the Native interface.

The underlying program for object recognition is C++++ programming, and the upper-level application can use flash, unity, ue4, ventuz, etc. The ID number, X,Y and rotation Angle of the identified object are sent to the upper-layer application through the TUIO obj underlying standard protocol. The custom UDP communication protocol format is id1,x1,y1,angle1/ id2,x2,y2,angle2. If there are more than two, add id3 at the end, and so on. The port number can be defined freely by the upper-level program because the port number of the lower-level program can be configured.

The specific operations are as follows: 1. Install the token /Marker recognition program. 2. Combine the token with the recognized object (embed or bond). 3. Use familiar development tools for customized development. 4. Create a physical/digital integrated interactive experience

TUIO (Table-Top User Interfaces Objects) is an open-source framework that defines the open architecture of standard protocols and application programming interfaces for multi-touch screens. This protocol acquires control data from the tracking application (based on computer vision) and then sends the data to each customer application. The TUIO protocol enables the transmission of abstract descriptions on interactive surfaces, such as the transmission of the states of touched and touched objects. This protocol encodes the control data of the tracking application and transmits it to any client application that can decode it. The TUIO protocol defines two main types of messages: SET messages and ALIVE messages. SET messages are used to convey object state information, such as position, direction, and other states. A ALIVE message refers to the current Settings of an object on the screen surface, using a series of Session ids.

Tag HID (HID protocol with Angle) supports multimedia software development platforms such as Unity and ventuz through DLL Plugin native. Currently, the Native approach is mainly promoted. Tag as Touch (Hid Standard Touch Protocol), for application scenarios where information is not required, a fixed ID standard touch protocol is used to report the touch. For example: ID 1 to 80, ordinary touch point ID 100 to 120 TAG points.

Tuio Cursor & Tuio Object comply with the TUIO specification. Currently, it is the most standard protocol for angular applications, and most angular applications use this protocol. Since TUIO is a UDP protocol, USB hardware cannot directly send UDP data packets and needs to perform protocol conversion through TagPanel. The TUIO protocol of TCP is mainly used in Flash.

DLL plugins can make the hardware recognition system more flexible, just like they are written in the software UI layer. TagHID_ReadTag reads the currently recognized TAG information. Id, x, y, width, height, angle. The special API, TagHID_GetCPUID, acquires the unique serial number of the hardware board card, facilitating software vendors to perform software encryption. Unity plugin test information, Touch, still using Unity Native Touch. It's time to read the TAG message. Call the plugin API. The range of EVT: down, move, up X,Y, Width, Height coordinate systems is 0 to 32758, and Angle is 0 to 360.