KR102590257B1 - Smart interactive white board apparatus using Wi-Fi location tracking technology and its control method - Google Patents

Abstract

It learns the surrounding environment using Wi-Fi location tracking technology and pen input, and based on the learning data, presenters (people giving lectures or presentations) and participants (presenters participating in lectures, presentations, or meetings) It relates to a smart interactive whiteboard device and its control method using Wi-Fi location tracking technology that changes the contents of the interactive whiteboard according to the location and gestures of the person listening to the contents or participating in the conversation, and the surrounding environment. Check whether the surrounding environment has been learned, switch to pen input mode if the surrounding environment has not been learned, and correct the motion data through learning based on the received first and second reception signals and the location information recognized by the touch processing unit, As a result of checking for learning, if the surrounding environment has been learned, it switches to location tracking mode, and the location tracking mode is displayed on the video display. When switched to location tracking mode, it checks whether the location tracking mode is a full participation mode and allows full participation. If in mode, all movements and motions around the smart interactive whiteboard are recognized. If not in full participation mode, the presenter's movements and motions are recognized, and the content on the screen is automatically changed based on the recognized movement and motion information. Controls a smart interactive whiteboard using Wi-Fi location tracking technology.

Description

Smart interactive white board apparatus using Wi-Fi location tracking technology and its control method}

The present invention relates to a smart interactive whiteboard device using Wi-Fi location tracking technology and a control method thereof. In particular, the present invention relates to a smart interactive whiteboard device using Wi-Fi location tracking technology and pen input to learn the surrounding environment and learn data. Based on this, the contents of the interactive whiteboard can be changed according to the positions and gestures of the presenter (the person conducting the lecture or presentation) and the participant (the person who participated in the lecture, presentation, or meeting and listened to the presenter's content or participated in the conversation). This relates to a smart interactive whiteboard device using Wi-Fi location tracking technology and its control method.

A typical smart interactive whiteboard is used as a device that digitally receives user (presenter) input and outputs content to multiple participants. This is a cutting-edge system proposed to improve user convenience and lecture efficiency by converting the existing whiteboard into a digital one.

When giving a presentation or lecture using such a smart interactive whiteboard, in order for the presenter to comfortably write the content of the presentation on the smart interactive whiteboard, the presenter inputs on the part of the screen closest to the smart interactive whiteboard. The screen location written by the presenter is the location that is least visible to participants.

Therefore, research is needed on the interconnection between the smart interactive whiteboard and the presenter's location so that the screen content written by the presenter can be optimally displayed to participants.

Meanwhile, a smart interactive whiteboard that interacts with participants through a camera has been proposed as in Patent Document 1 (10-2031739).

Patent Document 1 is a technology that detects events through a camera and microphone, interacts with the user, and configures a lecture screen according to the class progress mode separately from the display screen to support real-time Internet broadcasting.

This technology can detect the presenter's situation with a camera and microphone, but since the place where a typical smart interactive whiteboard is used is a large place, high performance of the microphone is required to detect the voice of a person from a distance, and accordingly, the cost of implementing the system is high. This has the disadvantage of taking a lot of time. The camera also requires a high-performance camera with a high angle of view and image quality in order to photograph a wide area, and has the disadvantage of requiring maintenance as the screen may not be visible due to foreign substances on the camera lens. In addition, if the lighting is too bright or dark, image processing is difficult, and privacy issues may arise for participants who do not want to be filmed with a camera.

To solve this problem, the user's location can be specified through ultrasonic position sensors, LiDAR sensors, etc., but this also requires additional installation costs and high unit prices.

Additionally, in recent years, location tracking technology using WiFi radio signals has been proposed to recognize the location of presenters or participants. For example, technologies such as WiFi sensing, wi-see, and wi-vi use WiFi location tracking technology.

Surrounding activity is recognized using changes in Wi-Fi CSI (Channel State Information) data, which is a characteristic when data packets are transmitted in the 2.4Ghz, 5Ghz, 6Ghz, and 60Ghz bands, which are the reception bands of Wi-Fi radio signals.

Recently, with the development of machine learning technology, machine learning technology has been applied to process CSI data as big data to more accurately recognize the location or movement of objects.

Figure 1 is an example of a situation in which a presenter 11 writes a document close to the smart interactive whiteboard 1 in a specific space, and participants 21 and 22 are located at a distance from the presenter 110.

In this situation, if you track the location using Wi-Fi CSI, you can obtain an amplitude signal like the diagram on the left of FIG. 2, and if you process this signal using a designated signal processing method, you can get a phase like the diagram on the right.

However, Wi-Fi propagation characteristics have the characteristic of causing large errors depending on changes in the surrounding environment, so obtaining location recognition information as shown in Figure 2 has the disadvantage that it can only be implemented in a limited space where there is no change in the surrounding environment.

Republic of Korea registered patent 10-2031739 (registered on October 7, 2019) (Interactive whiteboard that supports real-time Internet broadcasting by configuring a lecture screen according to the class progress mode separately from the display screen) Republic of Korea Patent Publication No. 10-2011-0025674 (published on March 10, 2011) (3-dimensional position determination of controller using image analysis and ultrasonic communication) Republic of Korea Patent Publication No. 10-2017-0059486 (published on May 30, 2017) (camera search for presentation)

Therefore, the present invention was proposed to solve various problems that occur when tracking the location of an object using the general Wi-Fi CSI as described above, using the location tracking technology of Wi-Fi and pen input. It learns the surrounding environment, and based on the learning data, it follows the positions and gestures of the presenter (the person giving the lecture or presentation) and the participant (the person who participated in the lecture, presentation or meeting and listened to the presenter's content or participated in the conversation). The purpose is to provide a smart interactive whiteboard device and its control method using Wi-Fi location tracking technology to change the contents of the interactive whiteboard.

In order to achieve the above-mentioned purpose, the “smart interactive whiteboard device using Wi-Fi location tracking technology” according to the present invention,

A Wi-Fi transceiver that transmits a Wi-Fi signal as a first transmission signal from behind the participant facing the smart interactive whiteboard and receives a Wi-Fi signal transmitted from the front of the participant as a first reception signal;

Input pen for entering data or selecting specific content by touching the screen;

Transmit a Wi-Fi signal in front of the participant as a second transmission signal, receive the Wi-Fi signal transmitted through the Wi-Fi transceiver as a second reception signal, and receive the first and second reception signals and the input through the input pen. It features a smart interactive whiteboard that learns the surrounding environment based on location information, recognizes the locations and gestures of participants and presenters based on the learning results, and changes screen content in response to the recognized locations and gestures. do.

In the above, the smart interactive whiteboard is,

a Wi-Fi transceiver that transmits a Wi-Fi signal as a second transmission signal in front of the participant and receives the Wi-Fi signal transmitted through the Wi-Fi transceiver as a second reception signal;

a touch processing unit that recognizes the location and input information of the corresponding touched portion on the screen when the input pen touches the screen;

In the pen input mode, motion data for learning is corrected through learning based on the second reception signal received from the Wi-Fi transceiver, the first reception signal received through the Wi-Fi transceiver, and the location information recognized by the touch processing unit, and location tracking is performed. an object recognition unit that recognizes motion based on the first and second reception signals in the mode and outputs motion recognition information; and

It is characterized by including an image display unit that changes the contents of the screen according to the bus bar recognition information output from the object recognition unit.

In the above, the object recognition unit is characterized by learning about the surrounding environment by using the location information recognized by the touch processing unit as actual measurement data and correcting the bus bar data recognized through the second reception signal and the first reception signal. .

In the above, the object recognition unit is characterized in that it recognizes the motion of the tracker by combining motion information recognized through the first reception signal and motion information recognized through the second reception signal.

In the above, the object recognition unit controls the location tracking mode into presenter mode and full participation mode. In case of presenter mode, only the presenter is tracked, and in case of full participation mode, it tracks the motion of the presenter and all participants around the smart interactive whiteboard. It is characterized by:

In the above, the object recognition unit recognizes the presenter's location based on motion recognition information, and controls the video display unit to display content input by the presenter at a screen location other than the screen location obscured by the presenter.

In the above, the object recognition unit is characterized in that when the presenter approaches the screen based on the motion recognition information, the video display unit is controlled to move and display the content displayed last to a position close to the presenter.

In order to achieve the above-mentioned purpose, the “smart interactive whiteboard control method using Wi-Fi location tracking technology” according to the present invention,

(a) Check whether the surrounding environment has been learned, and if the surrounding environment has not been learned, switch to pen input mode and make motion through learning based on the received first and second reception signals and the location information recognized by the touch processing unit. correcting data;

(b) as a result of checking the learning in step (a), if the surrounding environment is in a learned state, switching to the location tracking mode and displaying the location tracking mode on the video display;

(c) When the location tracking mode is switched to the above, it is checked whether the location tracking mode is a full participation mode. If it is a full participation mode, all movements and motions around the smart interactive whiteboard are recognized, and if it is not a full participation mode, the presenter's movements and motions are recognized. Recognizing step; and

(d) changing the content of the screen based on the movement and motion information recognized in step (c).

In step (a) above,

The motion data is corrected by comparing motion information recognized through the first and second received signals with location information recognized through the touch processing unit.

In step (d) above,

The presenter's location is recognized based on the motion recognition information output from the object recognition unit, and the content input by the presenter is displayed at a screen location other than the screen location obscured by the presenter.

In step (d) above,

When the presenter approaches the screen based on the motion recognition information output from the object recognition unit, the content displayed last is moved to a position closer to the presenter and displayed.

According to the present invention, the surrounding environment is learned using location tracking technology using Wi-Fi radio signals and pen input, and the contents of the interactive whiteboard are automatically changed by recognizing the positions and gestures of the presenter and participants based on the learning data. , It has the effect of accurately recognizing location and gestures even in large places.

In addition, by utilizing location tracking technology using Wi-Fi radio signals, it is difficult to track location due to the influence of illumination when using a camera, or when using a microphone, it is difficult to accurately track location when the place is large or there is a lot of surrounding noise. At the same time as improvement, it also provides the advantage of being able to implement a smart interactive whiteboard at low cost.

Figure 1 is an example of a lecture using a conventional smart interactive whiteboard.
Figure 2 is an example diagram of the amplitude and phase of CSI using conventional Wi-Fi location tracking technology;
Figure 3 is a block diagram of an embodiment of a smart interactive whiteboard device using Wi-Fi location tracking technology according to the present invention;
4 to 6 are diagrams illustrating the Wi-Fi location tracking technology applied to the present invention;
Figure 7 is a flowchart showing a smart interactive whiteboard control method using Wi-Fi location tracking technology according to the present invention;
8A to 8D are examples of screen content display in the present invention;
Figures 9a and 9b are examples of tracking presenters and participants in full participation mode in the present invention.

Hereinafter, a smart interactive whiteboard device using Wi-Fi location tracking technology and a control method thereof according to a preferred embodiment of the present invention will be described in detail with reference to the attached drawings.

The terms or words used in the present invention described below should not be construed as limited to their usual or dictionary meanings, and the inventor may appropriately define the concept of the term in order to explain his/her invention in the best way. It must be interpreted with meaning and concept consistent with the technical idea of the present invention based on the principle that it can be done.

Therefore, the embodiments described in this specification and the configurations shown in the drawings are only preferred embodiments of the present invention and do not represent the entire technical idea of the present invention, and therefore various equivalents and It should be understood that variations may exist.

Figure 3 is a configuration diagram of a smart interactive whiteboard device using Wi-Fi location tracking technology according to a preferred embodiment of the present invention, including a Wi-Fi transceiver 100, an input pen 200, and a smart interactive whiteboard 300. can do.

The WiFi transceiver 100 transmits a WiFi signal as a first transmission signal from behind the participant facing the smart interactive whiteboard 300, and receives the WiFi signal transmitted from in front of the participant as a first reception signal. It plays a role.

This Wi-Fi transceiver 100 includes a communication module, and can transmit the received first reception signal to the smart interactive whiteboard 300 using the communication module.

The input pen 200 serves to input data or select specific content by touching the screen of the smart interactive whiteboard 300. Selection of specific content can be implemented by touching a function icon separately displayed on the screen or by touching the content displayed on the screen or the content description area. The content description area may refer to the content area of the sentence when the content consists of a sentence.

This input pen 200 may additionally include a power on/off button and a mode selection button for selecting full participation mode, presenter mode, and pen input mode in the location tracking mode. Here, the input pen 200 is equipped with a communication module and can transmit mode selection information to the smart interactive whiteboard 300.

The smart interactive whiteboard 300 transmits a Wi-Fi signal as a second transmission signal in front of the participant, receives the Wi-Fi signal transmitted through the Wi-Fi transceiver 100 as a second reception signal, and receives the Wi-Fi signal transmitted through the Wi-Fi transceiver 100 as a second reception signal. 2 Learns the surrounding environment based on received signals and location information input through the input pen 200, recognizes the locations and gestures of participants and presenters based on the learning results, and displays the screen in response to the recognized locations and gestures. It plays a role in changing the content.

Here, changing the screen content means moving the position of the content displayed on the screen or switching the screen to the previous or next screen.

This smart interactive whiteboard 300 transmits a Wi-Fi signal as a second transmission signal in front of the participant, and has a Wi-Fi transceiver 301 that receives the Wi-Fi signal transmitted through the Wi-Fi transceiver 100 as a second reception signal. ), a touch processor 302 that recognizes the location and input information of the corresponding touch part on the screen when the input pen 200 is touched, a second reception signal received from the Wi-Fi transceiver 301 in pen input mode, and The motion data for learning is corrected through learning based on the first reception signal received through the Wi-Fi transceiver 100 and the location information recognized by the touch processor 302, and the first reception signal and the second reception are received in the location tracking mode. An object recognition unit 303 that recognizes motion based on a signal and outputs motion recognition information, and an image display unit 304 that changes the contents of the screen according to the busbar recognition information output from the object recognition unit 303. It can be included.

The object recognition unit 303 uses the location information recognized by the touch processing unit 302 as actual measurement data to correct the bus data recognized through the second reception signal and the first reception signal, thereby recognizing the surrounding environment. You can learn.

In addition, the object recognition unit 303 may recognize the tracker's motion by combining motion information recognized through the first reception signal and motion information recognized through the second reception signal.

In addition, the object recognition unit 303 controls the location tracking mode into presenter mode and full participation mode. In case of presenter mode, only the presenter is tracked, and in case of full participation mode, the location tracking mode is tracked around the smart interactive whiteboard 300. All participants can be tracked.

The object recognition unit 303 recognizes the presenter's location based on the motion recognition information, and configures the video display unit 304 to display the content entered by the presenter at a screen location other than the screen location obscured by the presenter. You can control it.

In addition, when the presenter approaches the screen based on motion recognition information, the object recognition unit 303 can control the video display unit 304 to move and display the content displayed last to a position close to the presenter. .

Figure 7 is a flowchart showing a "smart interactive whiteboard device control method using Wi-Fi location tracking technology" according to the present invention. (a) Checking whether the surrounding environment has been learned, and pen input if the surrounding environment has not been learned. Switching to the mode and correcting the motion data through learning based on the received first and second reception signals and the location information recognized by the touch processing unit (S101 - S103), (b) learning of step (a) As a result of checking the presence or absence, if the surrounding environment is learned, switching to the location tracking mode and displaying the location tracking mode on the video display (S104 - S105), (c) When the location tracking mode is switched, the location tracking mode is switched to the location tracking mode. Steps (S106 - S108) of checking whether it is in full participation mode and recognizing all movements and motions around the smart interactive whiteboard if it is in full participation mode, and recognizing the presenter's movements and motions if it is not in full participation mode (S106 - S108), and (d) It may include a step (S109) of changing the content of the screen based on the movement and motion information recognized in step (c).

In step (a), motion data may be corrected through comparison of motion information recognized through the first and second received signals and location information recognized through the touch processing unit 302.

In step (d), the position of the presenter is recognized based on the motion recognition information output from the object recognition unit 303, and the content input by the presenter is displayed at a screen location other than the screen location obscured by the presenter. You can.

In step (d), when the presenter approaches the screen based on the motion recognition information output from the object recognition unit 303, the content displayed last can be moved to a position closer to the presenter and displayed.

Figure 3 according to the present invention configured as described above is a detailed explanation with reference to Figures 3 to 9b, which illustrate a smart interactive whiteboard device and its control method using Wi-Fi location tracking technology according to a preferred embodiment of the present invention. If you do so, it is as follows.

First, when driving power is supplied to the smart interactive whiteboard 300, the object recognition unit 303 checks whether the surrounding environment has been learned (S101).

Here, learning in the surrounding environment refers to the information transmitted from the Wi-Fi transceiver 100 installed behind the participant at the presentation venue (a concept that includes the lecture or meeting venue) and the Wi-Fi transceiver 301 installed on the smart interactive whiteboard 300. This means learning to accurately recognize motion data by correcting the received data based on the location information of the screen touched through the input pen 200 after receiving the Wi-Fi radio signal.

The Wi-Fi radio signal received here is called “CSI data.”

If the surrounding environment has not been learned, the accuracy of movements, gestures, locations, and distances obtained using the acquired CSI data is low.

As a result of checking whether the surrounding environment has been learned, if the surrounding environment has not been learned, the object recognition unit 303 switches to the pen input mode (S102). Then, when the screen is touched through the input pen 200 in the pen input mode, the first CSI data, which is the first received signal obtained from the Wi-Fi transceiver 100, and the second received signal obtained through the Wi-Fi transceiver 301 The first CSI data and the second CSI data are corrected through learning using the movement, gesture, position, and distance data obtained by processing the second CSI data and the screen touch location information obtained through the pen input mode as learning data (S103). . Once the first CSI data and the second CSI data are corrected, the CSI pattern change according to the user's movement and distance changes to the same pattern regardless of the surrounding environment. Afterwards, when only noise due to the surrounding environment is acquired, the user can obtain the CSI data from the CSI data. It is possible to track the exact location, pose, and distance of .

As a method of learning the surrounding environment, first CSI data, which is the first received signal received from the Wi-Fi receiver 100, is received, and second CSI data, which is the second received signal received through the Wi-Fi transmitting and receiving unit 301, is received. Here, the received first CSI data and second CSI data are processed using already known Wi-Fi location tracking technology to extract location, gesture, and distance information.

Here, the Wi-Fi location tracking technology is Fei Wang, Sanping Zhou, Stznislav Panev, Jinsong Han, and Dong Huang.2019. The location tracking technology using WiFi signals disclosed in Person-in-WiFi: Fine-grained Person Perception using WiFi/1904.00276 and Jiaqi Geng, Dong Huang, Fernando De laTorre 2022. DensePose From WiFi/2301.00250v1 can be used.

Figures 4 to 6 are explanatory diagrams of the location tracking technology using the Wi-Fi signal disclosed in the above paper. Figure 4 is an example of recognizing a person using the Wi-Fi location tracking technology, and Figure 5 shows the range of the Wi-Fi radio signal. , Figure 6 shows the principle of Wi-Fi sensing disclosed in the above paper.

Using this Wi-Fi location tracking technology, the first and second CSI data (CSI amplitude and phase data) are processed to extract the user's motion, gesture, distance, and location as motion data, which is learning data, and the input pen 200 After extracting the input screen touch location information as learning data, the motion data is corrected by learning the motion data and touch location learning data using a machine learning algorithm such as CNN. In other words, the accuracy of the motion data is improved by correcting the estimated learning motion data with the actual measurement data and the input pen touch position information. Ultimately, learning can be implemented by comparing the location of motion data and the location of input pen touch location information and correcting the difference. Difference correction is a method of correcting the position of motion data, which is tracking data, based on the position information of actual measurement data. A method of correcting the position of the motion data by the position difference can be used.

Here, learning is performed even in situations where the surrounding environment has not been learned, but even if an error occurs in location recognition during location tracking, it can also be performed by touching the screen using the user's input pen. In order to perform learning by touching the screen using the user's input pen, a learning icon can be displayed at a predetermined location on the screen and the user touches it using the input pen.

When learning about the surrounding environment is completed through this process, the object recognition unit 303 switches to the location tracking mode and displays the location tracking mode on the image display unit 304 (S104 - S105).

Here, when the location tracking mode is displayed on the image display unit 304, the user can select the type of location tracking mode using the input pen 200. In other words, the location tracking mode can be selected as full participation mode or presenter mode. Here, the location tracking mode is set to presenter mode by default.

If the user has not selected the full participation mode, the presenter's movements and motions are recognized using the Wi-Fi location tracking technology based on the set presenter mode (S107), and if the location tracking mode is the full participation mode, the Wi-Fi location tracking is performed. Using technology, all movements and motions around the smart interactive whiteboard are recognized (S108).

9A and 9B are examples of tracking the locations of all participants when the location tracking mode is the all participation mode.

If the location tracking mode is the presenter mode, the presenter's movements and motions are recognized. If the location tracking mode is the full participation mode, the movements and motions of all participants are recognized, and then the screen content is automatically changed based on the recognized movement and motion information (S109 ).

Here, in the case of full participation mode, there are cases where multiple participants in various locations may make gestures at similar times. In this case, it is assumed that movement and motion are recognized based on the movement order of the participants.

Here, if the user's movements and motions are accurately recognized, additional functions can be performed, such as detecting internal intrusions or automatically controlling the power of the smart interactive whiteboard.

Next, when movement and motion are recognized as described above, the content on the screen is automatically changed based on this.

The content on the screen can be changed when the presenter finishes inputting content at a specific location on the screen using the input pen 200 and turns around (detected by mothership recognition). The presenter's location is recognized using Wi-Fi location tracking technology, and the presenter's location is recognized. Based on recognition, the video display unit 304 is controlled to automatically move the content displayed on the screen to a location where it is not obscured by the presenter and display the content. In other words, when transmitting content data to the video display unit 304, video display position data (coordinate data) is also provided, so that the content display location can be easily determined.

This location data continuously tracks the presenter's location and gestures in real time, and automatically moves the display location of the content based on the tracked presentation location information, solving the problem of participants not being able to see the content because the content is obscured by the presenter. do.

Figure 8a is an example of preventing the content from being obscured by the presenter by displaying the content at the top of the screen based on the presenter's position, and Figure 8b shows the content on the left side of the screen (the participant's viewing angle) based on the presenter's position. This is an example of preventing the content from being obscured by the presenter by displaying the content on the basis of the presenter. Figures 8c and 8d show the content divided into left and right with the presenter at the center based on the presenter's position, so that the content is displayed in the presenter. This is an example of preventing being obscured by .

Here, the priority of the content display position is assumed to be set in advance, and if there is multiple content, the screen content can be changed by moving all content at the same time.

If it is determined that the presenter is approaching the screen using Wi-Fi location tracking technology while the presenter is inputting content while presenting, the presenter's location is recognized and the last expressed content is automatically moved to the presenter's location. This is because the presenter is most likely to change the content he last wrote, so the content is automatically moved to the presenter's location so that the presenter can conveniently change the content. When a presenter wants to create new content, he or she can use a gesture to command the current content to move to another location. When such a command gesture occurs, the object recognition unit 303 recognizes the presenter's gesture using Wi-Fi location tracking technology, and when gesture recognition occurs, it controls the video display unit 304 to move the content to another location and display it. Control. Therefore, users can conveniently create new content in the empty space on the screen.

Here, through motion recognition based on gestures, it is possible to delete or move the created content, recall the previous screen, or switch to the next screen. In full participation mode, the motion of the participant is recognized through motion recognition, making it possible to change the screen or move the content location.

As needed, various editing (input) tools required for content input can follow the presenter's position, allowing users to conveniently use various editing tools even in an environment where the smart interactive whiteboard is very large.

According to the present invention described above, the surrounding environment is learned using location tracking technology using Wi-Fi radio signals and pen input, and the contents of the interactive whiteboard are automatically updated by recognizing the positions and gestures of the presenter and participants based on the learning data. By changing it to , you can accurately recognize the location and gesture even in a large place.

In addition, by utilizing location tracking technology using Wi-Fi radio signals, it is difficult to track location due to the influence of illumination when using a camera, or when using a microphone, it is difficult to accurately track location when the place is large or there is a lot of surrounding noise. While making improvements, a smart interactive whiteboard can be implemented at low cost.

Although the invention made by the present inventor has been described in detail according to the above embodiments, the present invention is not limited to the above embodiments, and various changes can be made without departing from the gist of the invention, as is known in the art. It is self-evident to those who have it.

100: WiFi transceiver
200: input pen
300: Smart interactive whiteboard
301: WiFi transceiver
302: Touch processing unit
303: Object recognition unit
304: Video display unit

Claims (11)

A Wi-Fi transceiver that transmits a Wi-Fi signal as a first transmission signal from behind the participant facing the smart interactive whiteboard and receives a Wi-Fi signal transmitted from the front of the participant as a first reception signal;
Input pen for entering data or selecting specific content by touching the screen; and
Transmit a Wi-Fi signal in front of the participant as a second transmission signal, receive the Wi-Fi signal transmitted through the Wi-Fi transceiver as a second reception signal, and receive the first and second reception signals and the input through the input pen. It includes a smart interactive whiteboard that learns the surrounding environment based on location information, recognizes the locations and gestures of participants and presenters based on the learning results, and changes screen content in response to the recognized locations and gestures.
The smart interactive whiteboard is,
a Wi-Fi transceiver that transmits a Wi-Fi signal as a second transmission signal in front of the participant and receives the Wi-Fi signal transmitted through the Wi-Fi transceiver as a second reception signal; a touch processing unit that recognizes the location and input information of the corresponding touched portion on the screen when the input pen touches the screen; In the pen input mode, motion data for learning is corrected through learning based on the second reception signal received from the Wi-Fi transceiver, the first reception signal received through the Wi-Fi transceiver, and the location information recognized by the touch processing unit, and location tracking is performed. an object recognition unit that recognizes motion based on the first and second reception signals in the mode and outputs motion recognition information; And a smart interactive whiteboard device using Wi-Fi location tracking technology, comprising an image display unit that changes the contents of the screen according to the busbar recognition information output from the object recognition unit.
delete In claim 1, the object recognition unit learns about the surrounding environment by using the location information recognized by the touch processing unit as actual measurement data and correcting the bus data recognized through the second reception signal and the first reception signal. A smart interactive whiteboard device using Wi-Fi location tracking technology.
In claim 1, the object recognition unit combines motion information recognized through the first received signal and motion information recognized through the second received signal to recognize the tracker's motion. Wi-Fi location tracking technology. Smart interactive whiteboard device using.
In claim 1, the object recognition unit controls the location tracking mode into a presenter mode and a full participation mode. In the presenter mode, only the presenter is tracked, and in the full participation mode, the location tracking mode tracks the presenter and all participants around the smart interactive whiteboard. A smart interactive whiteboard device using Wi-Fi location tracking technology that tracks motion.
In claim 1, the object recognition unit recognizes the presenter's location based on motion recognition information and controls the video display unit to display content input by the presenter at a screen location other than the screen location obscured by the presenter. A smart interactive whiteboard device using Wi-Fi location tracking technology.
In claim 1, when the presenter approaches the screen based on motion recognition information, the object recognition unit controls the video display unit to move the content displayed last to a position adjacent to the presenter and display it. Smart interactive whiteboard device using location tracking technology.
A method of controlling a smart interactive whiteboard using a smart interactive whiteboard device using Wi-Fi location tracking technology according to any one of claims 1, 3 to 7, comprising:
(a) The object recognition unit checks whether the surrounding environment has been learned, and if the surrounding environment has not been learned, switches to pen input mode, based on the received first and second reception signals and the location information recognized by the touch processing unit. Compensating motion data through learning;
(b) as a result of checking the learning in step (a), if the surrounding environment is in a learned state, switching to the location tracking mode and displaying the location tracking mode on the video display;
(c) When the location tracking mode is switched to the above, it is checked whether the location tracking mode is a full participation mode. If it is a full participation mode, all movements and motions around the smart interactive whiteboard are recognized, and if it is not a full participation mode, the presenter's movements and motions are recognized. Recognizing step; and
(d) A smart interactive whiteboard device control method using Wi-Fi location tracking technology, comprising the step of changing screen content based on the movement and motion information recognized in step (c).
In claim 8, step (a) includes,
A smart interactive whiteboard using Wi-Fi location tracking technology, characterized in that motion data is corrected by comparing motion information recognized through the first and second received signals with location information recognized through the touch processing unit. Device control method.
In claim 8, step (d) is,
Wi-Fi location tracking, characterized in that it recognizes the presenter's location based on the motion recognition information output from the object recognition unit and displays the content entered by the presenter at a screen location other than the screen location obscured by the presenter. Smart interactive whiteboard device control method using technology.
In claim 8, step (d) is,
Smart interactive using Wi-Fi location tracking technology, characterized in that when the presenter approaches the screen based on the motion recognition information output from the object recognition unit, the content displayed last is moved to a location close to the presenter and displayed. How to control a whiteboard device.

Images