KR20200083383A - Recognition method of multi-touch of touch button on touch screen, text input method on touch screen and modifying method of object - Google Patents

Abstract

The present invention relates to a method for generating a work signal for work including character input or object transformation through operation after multi-touching in a device with a touchscreen, and more particularly, to a method for circulating and displaying characters belonging to a character group having a target related to a target button according to the number of performing multi-on&off at least once when a character is inputted by using a multi multi-tap method. Therefore, buttons or objects appearing on the touchscreen are touched to improve the speed, accuracy, and convenience of various work including character input work or object shape transformation work.

Description

Multi-touch recognition method, character input method, and object transformation method of touch buttons on touch screens.

The present invention relates to an input method, and more particularly, to a method of inputting a user command in a manner in which touch buttons displayed on a touch screen are operated after being touched.

Since the small touch button in a device having a small touch screen including a conventional mobile phone is small in size, it is very difficult or impossible to accurately and quickly multi-touch with two or more fingers in one small button area. Therefore, development of a more convenient multi-touch method for the user is required.

On the other hand, representative of the methods in which the object is enlarged or reduced on the touch screen, there is a method of "one fingering zoom" and the object is reduced or enlarged by opening or closing the thumb and index finger.

According to "one finger zoom", when an object (eg, a photo) is double-clicked or long-pressed, an upward arrow and a downward arrow are displayed on the object. At this time, the object is enlarged by dragging upward, and the object is reduced by dragging downward. The disadvantage of this method is that it requires double-clicking or long-pressing before dragging to zoom in or out on the object.

On the other hand, the way in which the object is reduced or enlarged by pinching or extending the thumb and index finger is excellent in intuitiveness, and the operation speed is fast, but it is still necessary to improve the operation speed, and it is enlarged only while maintaining the aspect ratio of the object or Since it is reduced, there is a problem in that the shape of an object including 17 aspects of object change, which is described later, implemented through a mouse, or the object is rotated cannot be implemented. And, there is a problem that it is difficult to enlarge or reduce a very small object. This is because it is very difficult or virtually impossible to multi-touch a very small object with the thumb and index finger.

And, among the methods in which a conventional object is enlarged or reduced, the most commonly used method is a method in which a mouse is usually used, and the following may be referred to as an object shape transformation method requiring an activation step of the object. There is a method by the same steps.

Step 1: The object's active area border (see Figure 39) appears around the object by a signal that activates the object, including hovering the mouse pointer anywhere on the object and clicking the left mouse button. step

(At the boundary of the active area of the object, when the mouse pointer is moved, eight zooms, such as 1 to 8 in FIG. 39, are changed by a double-headed arrow indicating the direction in which the object can be zoomed. The control point and the rotation arrow display the rotation control point as shown in Fig. 39 in which the shape of the mouse pointer changes. The eight zoom control points are the midpoint of the four sides of the border of the active area of the rectangular object and the four control points. It appears at the vertex. The rotation control point appears above the boundary of the active area of the object.)

Step 2: Hover the mouse pointer over each zoom control point to change the shape of the mouse pointer with a double-headed arrow that indicates the direction that can be zoomed in. Or move the mouse pointer over the rotation control point to rotate the mouse. Steps in which the shape of the pointer changes (see FIGS. 40, 41, 42, 43)

(Depending on the position of each zoom adjustment point, the left and right double arrows, the up and down double arrows, the left and right diagonal diagonal double arrows, or the right and left downward diagonal diagonal arrows appear.)

Step 3: Click the left mouse button

This is the step of generating a signal that the object will start to zoom in or out.

Step 4: Drag the object in the desired direction to zoom or rotate the object

In this step 4, the object is zoomed in and out in 16 aspects by a linear drag in 2 directions and a control point selected from 1 to 8 zoom points in FIG. 39 and one by a rotation adjustment point in FIG. 39. Examples of 17 object change patterns including the rotational pattern of are included.

An object zooming mode of 16 aspects by a straight drag in 2 directions and a control point selected from the zooming points 1 to 8 in FIG. 39 to be described later is proportional to the rate of change of the horizontal/vertical length of the boundary line of the active area of the object. The rate of change of the horizontal/vertical length of the object is changed, and the position of the center point of the object is also changed.

According to the method of the present application, steps 1 to 3 in the object shape transformation method requiring the activation step of the conventional object are performed only by multi-touching the object to be recognized as the target button (=target object). While producing an effect, it is also possible to perform the four steps in the object shape transformation method that requires the activation step of the conventional object, in which 17 object change patterns are implemented, through multi-touch manipulation.

For the sake of understanding, the 17 object changes described above will be described as an example.

Hereinafter, the upper horizontal side refers to a side connecting the 1st and 2nd control points among the control points on the boundary of the active area of the object shown in FIG. 39, and the lower horizontal side is among the control points on the boundary of the active area of the object. The sides connecting the 3rd and 4th control points refer to the side, and the left vertical side refers to the side connecting the 1st and 3rd control points among the control points on the boundary of the object's active area, and the right vertical side activates the object. It refers to the side connecting the 2nd and 4th control points among the control points on the area boundary.

1) When dragging upward from the 5th adjustment point on the upper horizontal side of FIG. 39, the lengths of the upper horizontal side and the lower horizontal side and the position of the lower horizontal side are unchanged, and only the lengths of the left vertical side and the right vertical side are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 27.

2) When dragging from the 5th adjustment point on the upper horizontal side in FIG. 39 in the downward direction, the length of the upper horizontal side and the lower horizontal side and the position of the lower horizontal side are unchanged, and only the lengths of the left vertical side and the right vertical side are reduced. For example, it is the degree of change from FIG. 27 to FIG. 26.

3) When dragging in the upward direction from the seventh adjustment point on the lower horizontal side of FIG. 39, the length of the upper horizontal side and the lower horizontal side and the position of the upper horizontal side are unchanged, and only the lengths of the left vertical side and the right vertical side are reduced. For example, it is the degree of change from FIG. 26 to FIG. 28.

4) When dragging from the 7th adjustment point on the lower horizontal side in FIG. 39 in the downward direction, the length of the upper horizontal side and the lower horizontal side and the position of the upper horizontal side are unchanged, and only the lengths of the left vertical side and the right vertical side are enlarged. For example, it is the degree of change from FIG. 28 to FIG. 26.

5) When dragging from the 8th adjustment point on the left vertical side of FIG. 39 to the right direction, the lengths of the left vertical side and the right vertical side are unchanged, and only the lengths of the upper horizontal side and the lower horizontal side are reduced. For example, it is the degree of change from FIG. 26 to FIG. 30.

6) When dragging from the 8th adjustment point on the left vertical side of FIG. 39 in the left direction, the lengths of the left vertical side and the right vertical side are unchanged, and only the lengths of the upper horizontal side and the lower horizontal side are enlarged. For example, it is the degree of change from FIG. 30 to FIG. 26.

7) When dragging in the right direction from the sixth adjustment point on the right vertical side of FIG. 39, the lengths of the left vertical side and the right vertical side are unchanged, and only the lengths of the upper horizontal side and the lower horizontal side are enlarged. For example, it is the degree of change from FIG. 26 to FIG. 29.

8) When dragging in the left direction from the sixth adjustment point on the right vertical side of FIG. 39, the lengths of the left vertical side and the right vertical side are unchanged, and only the lengths of the upper horizontal side and the lower vertical side are reduced. For example, it is the degree of change from FIG. 29 to FIG. 26.

9) When dragging from the adjustment point No. 1, which is the upper left vertex of FIG. 39, to the lower right direction, the position of the vertex No. 4, which is the lower right vertex, does not change, and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which dragging direction is right within the range of 90 degrees in the lower right direction. For example, it is the degree of change from FIG. 26 to FIG. 34.

10) When dragging from the adjustment point No. 1, which is the upper left vertex of FIG. 39, to the upper left direction, the position of the vertex No. 4, which is the lower right vertex, does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length varies depending on which dragging direction is left within the range of 90 degrees in the upper left direction. For example, the degree of change from FIG. 34 to FIG. 26.

11) When dragging from the lower right vertex No. 4 control point of FIG. 39 to the lower right direction, the position of the upper left vertex No. 1 vertex does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length is different depending on which right-right direction is dragged within the range of 90 degrees in the lower-right direction. For example, it is the degree of change from FIG. 26 to FIG. 33.

12) When dragging in the upper left direction from the 4th adjustment point, which is the lower right corner of FIG. 39, the position of the 1st vertex, which is the upper left corner, does not change, and the length of the 4 sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length varies depending on which dragging direction is left within the range of 90 degrees in the upper left direction. For example, it is the degree of change from FIG. 33 to FIG. 26.

13) When dragging from the control point No. 2, which is the upper right vertex of FIG. 39, to the upper right direction, the position of the lower left vertex No. 3 vertex is unchanged, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length varies depending on which right-side direction is dragged within a range of 90 degrees in the upper-right direction. For example, it is the degree of change from FIG. 26 to FIG. 31.

14) When dragging from the adjustment point 2, which is the upper right vertex of FIG. 39, to the lower left, the position of the vertex 3, which is the lower left vertex, does not change, and the length of the 4 sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length is different depending on which left-right direction is dragged within the range of 90 degrees in the left-left direction. For example, it is the degree of change from FIG. 31 to FIG. 26.

15) When dragging from the lower left corner vertex No. 3 adjustment point 3 to the upper right direction, the position of the upper vertex corner No. 2 vertex is unchanged and the length of the four sides is reduced. At this time, the reduction ratio of the horizontal length and the vertical length varies depending on which right-side direction is dragged within the range of 90 degrees in the upper-right direction. For example, it is the degree of change from FIG. 26 to FIG. 32.

16) When dragging from the lower left vertex No. 3 adjustment point 3 to the lower left direction, the position of the right upper vertex No. 2 vertex does not change, and the length of the four sides is enlarged. At this time, the enlargement ratio of the horizontal length and the vertical length is different depending on which left-right direction is dragged within the range of 90 degrees in the left-left direction. For example, it is the degree of change from FIG. 32 to FIG. 26.

17) If you drag in any of the 360-degree directions from the 9th control point, which is the rotation control point in FIG. 39, the object rotates in the drag direction.

In fact, the drag direction from the 1 to 8 control points in FIG. 39 can also be dragged in any of the 360-degree directions (especially has a practical effect at the 1 to 4 control points), but the most frequently at each control point The direction in which the dragging is merely an example in the above example. In addition, the drag length is an example assuming only the drag length in general.

The present invention has been devised to solve the above problems, the object of the present invention is the speed, accuracy of a variety of operations, including the character input operation or shape modification operation of the object by touching the buttons or objects appearing on the touch screen, It is to provide a method for improving the convenience.

[Claim 1]

In a device having a touch screen, when the touch screen is multi-touch, in the method for the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 2]

The method according to claim 1,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 3]

The method according to claim 2,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 4]

The method according to claim 2,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 5]

The method according to claim 2,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 6]

The method according to claim 2,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 7]

The method according to claim 1,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 8]

The method according to any one of claims 1 to 7,

In a device equipped with a touch screen, in a method after a multi-touch operation, a work signal for any operation including character input or object transformation is generated,

A method characterized in that the method operated after multi-touch is multi-on&off, multi-drag, multi-touch operation with open fingers.

[Claim 9]

The method according to claim 8,

The multi-on & off method is a method characterized in that any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

[Claim 10]

The method according to claim 9,

Multi multi sick all on & off method is characterized in that any one or more of the following methods.

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

[Claim 11]

The method according to claim 8,

The multi-drag method is one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

[Claim 12]

The method according to claim 11,

The method of the multi sickle all drag method is one or more of the following methods.

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

[Claim 13]

The method according to claim 8,

The method after the multi-touch operation with the open finger (= multi-touch operation with the open touch point) is one or more of the following methods.

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 14]

In a device having a touch screen, when the touch screen is multi-touched, a multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 15]

In a device equipped with a touch screen, in a method after a multi-touch operation, a work signal for any operation including character input or object transformation is generated,

A method characterized in that the method operated after multi-touch is multi-on&off, multi-drag, multi-touch operation with open fingers.

[Claim 16]

The method according to claim 15,

The multi-on & off method is a method characterized in that any one or more of the following methods.

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

[Claim 17]

The method according to claim 16,

Multi multi sick all on & off method is characterized in that any one or more of the following methods.

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

[Claim 18]

The method according to claim 15,

The multi-drag method is one or more of the following methods.

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

[Claim 19]

The method according to claim 18,

The method of the multi sickle all drag method is one or more of the following methods.

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

[Claim 20]

The method according to claim 15,

The method after the multi-touch operation with the open finger (= multi-touch operation with the open touch point) is one or more of the following methods.

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 21]

In a device equipped with a touch screen, in a method after a multi-touch operation, a work signal for any operation including character input or object transformation is generated,

After the multi-touch operation method,

A method characterized by a method in which different operations are performed according to the number of times multi-on&off is performed continuously at least once or more, that is, a multi-multi-tap method.

[Claim 22]

The method according to claim 21, When the character is input by the multi-multi-tap method,

A method characterized in that characters belonging to a target character group associated with a target button are displayed in circulation according to the number of times multi-on&off is performed continuously at least once or more.

[Claim 23]

The method according to claim 22,

After the characters are displayed in circulation, a single-touch or multi-touch so that another button is recognized as a target button, the cursor is moved, or the displayed character is entered definitely after a certain period of time (eg, 2 seconds).

[Claim 24]

The method according to claim 22,

When multi-touch when multi-tap is more detailed with n multi-touch,

According to at least one n value, that is, depending on the situation before the last operation, a specific character group is matched among the at least one character group, belonging to the matched character group, and at least one of the at least one character associated with the target button A method characterized in that the text is input without changing the text mode.

[Claim 25]

The method according to claim 24,

The "character group" is a method characterized in that any one of the following character groups.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 26]

The method according to claim 25,

The "character group" means that a character group to which other characters belong in the spelling rule is a character group of characters input in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 27]

The method according to claim 24,

The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.

In English,

If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,

If the currently set text mode is a lower case mode, it is a character group that can be entered in upper case mode

In Japanese

If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,

If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode.

[Claim 28]

The method according to any one of claims 21 to 27,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 29]

The method according to claim 28,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 30]

The method according to claim 29,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 31]

The method according to claim 29,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 32]

The method according to claim 29,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 33]

The method according to claim 29,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 34]

The method according to claim 28,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 35]

The method according to any one of claims 21 to 34,

The multi-touch,

A method characterized in that two fingers are used to recognize two multi-touches recognized by two touch points.

[Claim 36]

The method according to claim 35,

The two fingers,

The method characterized in that it is the index finger and the middle finger.

[Claim 37]

The method according to any one of claims 21 to 36,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 38]

The method according to any one of claims 21 to 37,

After multi-touch operation, characterized in that at least one of the following operations.

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

[Claim 39]

The method according to any one of claims 21 to 38,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 40]

The method according to any one of claims 21 to 39,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

[Claim 41]

Multi-touch so that the object (or the active area of the object) is recognized as the target button

And an object (or an active area of the object) is transformed according to an operation after multi-touch.

[Claim 42]

The method according to claim 41,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 43]

The method according to claim 42,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 44]

The method according to claim 43,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 45]

The method according to claim 43,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 46]

The method according to claim 43,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 47]

The method according to claim 43,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 48]

The method according to claim 42,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 49]

The method according to any one of claims 41 to 48,

The manipulation is a method of transforming an object, characterized in that it is a drag.

[Claim 50]

The method according to claim 49,

A method in which an object (or an active area of an object) is enlarged when dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when dragged in at least one second specific direction.

[Claim 51]

The method according to claim 50,

Dragging in the upward direction expands,

Method characterized in that it is reduced when dragged in the downward direction.

[Claim 52]

The method according to claim 50,

In the enlargement or reduction, the method characterized in that the ratio of the horizontal and vertical length of the object is maintained.

[Claim 53]

The method according to claim 50,

A method characterized in that the center point of the object does not move in enlargement or reduction.

[Claim 54]

The method of claim 49,

This is a method in which only the horizontal length or the vertical length of the object (or the active area of the object) is enlarged or reduced together by the drag direction determined by the device.

[Claim 55]

The method according to claim 54,

When dragged in the first specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is enlarged,

When dragged in the second specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is enlarged,

When dragged in the second specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is reduced,

When dragged in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

A method characterized in that when dragging in at least one second specific direction among diagonal directions, the horizontal length and the vertical length are reduced by the same ratio.

[Claim 56]

The method of claim 55,

When dragged to the right, the horizontal length is enlarged,

When dragged to the left, the horizontal length is reduced,

When dragging upward, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

When dragging in the upper left or upper right direction, it is enlarged in the same ratio as the horizontal length and the vertical length,

When dragging in the lower left or right lower direction, the method characterized in that it is reduced in the same ratio as the horizontal length and vertical length.

[Claim 57]

The method according to claim 54,

When dragged in the first specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is enlarged,

When dragged in the second specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is enlarged,

When dragged in the second specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is reduced,

When dragging to at least one first specific direction range among diagonal directions, the horizontal length and the vertical variation ratio are enlarged differently according to each direction within the range,

When the drag is dragged to at least one second specific direction range among the diagonal directions, the horizontal length and the vertical variation ratio are reduced differently according to each direction within the range.

[Claim 58]

The method according to claim 57,

When dragged to the right, the horizontal length is enlarged,

When dragged to the left, the horizontal length is reduced,

When dragging upward, the vertical length is enlarged,

When dragged in the downward direction, the vertical length is reduced,

When dragging in the upper left or right upper direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left range or the upper right range is dragged,

When dragging in the left-bottom or right-bottom direction, a reduction ratio of a horizontal length and a vertical length is differently reduced according to the dragging direction of the left-bottom range or the right-bottom range.

[Claim 59]

The method according to claim 54,

A method of zooming in or out, characterized in that the center point of the object is shifted or not shifted.

[Claim 60]

The method of claim 49,

Step 1: The object (or the active area of the object) is multi-touched and dragged so that it is recognized as the target button, and the specific range inside the object (or the active area of the object) is targeted by the direction of the hitting point and the dragging Step to be recognized as.

Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes depending on the recognized hitting point and the determined drag direction, the direction in which the drag starts to approach the center of the object (or the active area of the object). And if the direction is reduced, if the direction is away, the step of being enlarged.

[Claim 61]

The method according to claim 60,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper side, the lower side, the right side, or the left side,

If the determined starting direction of dragging is close to the center of the object (or the active area of the object),

The length of two sides parallel to the determined drag direction among the two horizontal sides or two vertical sides of the object (or the active area of the object) is reduced, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,

If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object),

The length of two sides parallel to the determined drag direction among the two horizontal sides or two vertical sides of the object (or the active area of the object) is enlarged, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper right, lower right, upper left, or lower left directions,

If the determined starting direction of dragging is close to the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced, and if the horizontal sides are reduced, both horizontal sides are reduced to the same length, and vertical If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of the change of the horizontal and vertical lengths can be set differently depending on which direction is dragged within a specific drag direction range determined by the device. It can be set so that the length of the horizontal and vertical are different in the same ratio regardless of the direction in which it is dragged.

If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. At this time, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, and depending on which direction is dragged within a specific drag direction range determined by the device A method characterized in that the ratio between the length and the length of the length can be set to be different, or the length of the width and length can be set to be changed at the same ratio regardless of which direction is dragged in a specific drag direction range.

[Claim 62]

The method of claim 61,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is the upper right side, the lower right side, the upper left side, and the lower left side,

-If the direction in which the determined drag starts to be close to the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the drag determined from among the three sides surrounding the recognized target range The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side does not change,

-If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and the determined dragging direction among the three sides surrounding the recognized target range The position of the side perpendicular to the is moved to enlarge, and the position of the opposite side of the side is not changed,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper right, lower right, upper left, or lower left directions,

-If the direction in which the determined dragging starts is close to the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, parallel to the dragging direction among the vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the opposite vertex of the vertex can be made unchanged,

-If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and a straight line parallel to the dragging direction among the vertices in the recognized target range A method characterized in that the vertex closest to is moved for magnification, and the position of the opposite vertex of the vertex may not be changed.

[Claim 63]

The method according to claim 62,

① It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,

The index finger to be recognized as a reference finger at a point in the (object area) or the object activation area (eg, area 5 in FIG. 45) having a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' upward, the horizontal length of the object may be enlarged without changing the horizontal length of the object. Even if only the vertical length is enlarged, the coordinate(s) with the smallest Y value in the (object area or) object activation area (e.g., the lower horizontal side) is unchanged, and the coordinate with the largest Y value in the (object or) object activation area ( Field) (e.g., the upper horizontal side) may be moved to the upper side so that only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.

If, the object within the (object area) or the object activation area (eg, area 7 in FIG. 45) having a Y value of less than the median value of Y1, Y2 (=(Y1+Y2)/2) is recognized as a reference finger. When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, when the object is'multi-all dragged', the horizontal length of the object may be reduced without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is the same. In the form of being moved upward, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 26 to FIG.

② It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area or) object's active area before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point in the (object area) or the object activation area having a Y value equal to or greater than the median value of Y1, Y2 (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. If the part is touched at any point and then'multi-all dragged' to the lower side, the horizontal length of the object can be reduced only without changing the horizontal length. Even if only the vertical length is reduced, the coordinate(s) where the Y value of the (object area) or object activation area is the smallest is unchanged, and the coordinate(s) where the Y value of the (object or) object activation area is the largest is moved to the lower side. In the form of paper, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 27 to Fig. 26 are made.

If, in the middle of the Y1, Y2 (=(Y1+Y2)/2) Y value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen and'multi-all dragging' to the lower side, the horizontal length of the object can be enlarged without changing the horizontal length. Even if only the vertical length is enlarged, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is In the form of being moved downward, only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 28 to FIG.

③ It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,

The index finger, which is to be recognized as a reference finger, is located at a point in the (object area) or the object activation area (eg, area 6 of FIG. 45) having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2). When the touch is made, and the middle finger is touched at any point on the right part of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be changed without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) having the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the (object or) object activation area has the largest X value. (S) (e.g., the right side of the right side) is moved to the right side so that only the length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG. 29 is made.

If, as an intermediate value (=(X1+X2)/2) of X1 and X2, the object within the (object area) or the object activation area (for example, area 8 of FIG. 45) having an X value less than that is recognized as a reference finger When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object activation area is unchanged, and the coordinate(s) with the smallest X value of the (object area or) object activation area is In the form of being moved to the right, only the horizontal length of the object can be reduced. Briefly explaining the above description with the drawings, an example of changing from FIG. 26 to FIG. 30 is exemplified.

④ (Multi-touch) is detected and stopped so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,

The index finger, which is to be recognized as the reference finger, is touched at a point in the (object area) or the object activation area having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After making it touch at any point of the part and'multi-all dragging' to the left, the vertical length of the object can be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinates with the smallest X value in the (object area) or object activation area are unchanged, and the objects with the largest X value in the (object or) object activation area are shifted to the left. Only the length of the horizontal can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 29 to FIG.

If, in the middle of the X1, X2 (=(X1+X2)/2) X value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen, if it is'multi-all dragged' to the left, only the horizontal length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are not changed, and the coordinates with the smallest X value of the (object area) or the object activation area are shifted to the left. It is possible to enlarge only the width of the object. Briefly explaining the above description with the drawings, it is exemplified that changes from FIG. 30 to FIG.

⑤ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area or) object activation area with an X value greater than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) For example, the index finger, which is to be recognized as the reference finger, is touched at a point in the area within the area (which may be included in area 2 of FIG. 45), and the middle finger is touched at any point on the right part of the index finger, and then the'multi-all drag 'If, the horizontal and vertical length of the object can be enlarged at the same ratio. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values in the (object area or) object activation area (e.g., the third vertex in FIG. 39) are unchanged (object or). The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates having the largest X and Y values in the object activation area (eg, vertex 2 in FIG. 39) are moved to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) After the index finger, which is to be recognized as the reference finger, is touched at a point within the object activation area (for example, an area that may be included in area 3 in FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then to the upper right When'multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even when the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The length and width of the object can be reduced in the form that the smallest value is shifted to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

⑥ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

Within the object activation area (object area) with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2). When the index finger, which is to be recognized as the reference finger, is touched at the point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical length of the object is reduced by the same ratio. can do. Even if the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the smallest. The horizontal and vertical length of the object can be reduced in the form that the largest coordinates are moved to the lower left. Briefly explaining the above description with the drawings, it is exemplified that changes from Fig. 31 to Fig. 26 are made.

If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) When the index finger, which is to be recognized as the reference finger, is touched at a point in the object activation area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical lengths of the object are the same. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The horizontal and vertical length of the object can be enlarged in such a way that the smallest value is shifted to the lower left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 32 to FIG.

⑦ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area) or object activation area with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point within the area (for example, an area that can be included in area 4 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of an object are enlarged at the same ratio, the coordinates (the object area or) of the object activation area where the X value is the smallest and the Y value is the largest (e.g., the first vertex in FIG. 39) are unchanged. Or, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value in the object activation area are moved to the lower right. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.

If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point in the active area (for example, an area that may be included in area 1 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then the ' When multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object area) or the object activation area without changing the coordinates where the X value of the object activation area is the largest and the Y value is the smallest is unchanged. The horizontal and vertical lengths of the object can be reduced in a form in which the coordinates with the smallest and largest Y value are moved to the lower right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

⑧ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area) or object activation area with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as a reference finger, is touched at an inner point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the horizontal and vertical length of the object is reduced to the same ratio. I can do it. Even when the horizontal and vertical lengths of an object are reduced by the same ratio, the X value of the (object or) object activation area is the most, without changing the coordinates of the (object area or) object activation area with the smallest X value and the largest Y value. The horizontal and vertical length of the object can be reduced in a form in which the coordinates with the smallest Y value are moved to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 33 to Fig. 26 are made.

If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as the reference finger, is touched at a point in the active area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the object's horizontal and vertical lengths are the same ratio. Can be enlarged. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the X value of the (object area) or the object activation area without changing the coordinates where the X value of the object activation area is the largest and the Y value is the smallest is unchanged. The horizontal and vertical lengths of the object can be enlarged in such a way that the coordinates with the smallest and largest Y value are shifted to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 34 to FIG.

[Claim 64]

The method of claim 61,

In the enlargement or reduction, the method characterized in that the center point of the object is moved.

[Claim 65]

The method according to any one of claims 41 to 64,

The multi-touch,

A method characterized in that two fingers are used to recognize two multi-touches recognized by two touch points.

[Claim 66]

The method of claim 65,

The two fingers,

The method characterized in that it is the index finger and the middle finger.

[Claim 67]

The method according to any one of claims 41 to 66,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 68]

The method according to any one of claims 41 to 67,

After multi-touch operation, characterized in that at least one of the following operations

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 69]

In a device having a touch screen, in the method of inputting text,

Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;

In the process of multi on and off so that a specific button is recognized as a target button,

After a multi-touch time point or after a multi-touch time point, including after a multi-touch finger is turned off (=multi-touch release),

Character input method characterized in that it comprises a; step of inputting a specific sequence of characters among the characters assigned to the button recognized as the target button.

[Claim 70]

The method of claim 69,

When multi-touch is expressed in more detail with n multi-touch,

Character input method characterized in that the specific sequence number is determined according to the n value.

[Claim 71]

The method according to claim 70,

Character input method characterized in that the n value and the numeric value corresponding to the sequence number of the specific sequence is determined to be the same.

[Claim 72]

The method according to claim 70,

If the n value is 2, that is, if it is 2 multi-touch, the character input method characterized in that the second character assigned to the button recognized as the target button is inputted.

[Claim 73]

The method according to claim 70,

If the n value is 3, that is, if it is 3 multi-touch, the third character assigned to the button recognized as the target button is inputted or processed.

If the n value is 4, that is, if it is 4 multi-touch, the character input method characterized in that the fourth character assigned to the button recognized as the target button is inputted.

[Claim 74]

The method according to claim 69 to claim 73,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 75]

The method of claim 74,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 76]

The method of claim 75,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 77]

The method of claim 75,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 78]

The method of claim 75,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 79]

The method of claim 75,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 80]

The method of claim 74,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 81]

The method according to claim 69 to claim 80,

The two multi-touch is multi-touch recognized by the touch points of the index finger and middle finger, or

The three multi-touch is multi-touch recognized by the touch points of the index finger, middle finger and ring finger, or

The method of claim 4, wherein the multi-touch is multi-touch recognized by the touch points of the index finger, middle finger, ring finger, and small finger.

[Claim 82]

The method according to any one of claims 69 to 81,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 83]

The method according to any one of claims 69 to 82,

After multi-touch operation, characterized in that at least one of the following operations

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

[Claim 84]

The method according to any one of claims 69 to 83,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 85]

The method according to any one of claims 69 to 84,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

[Claim 86]

In a device having a touch screen, in the method of inputting text,

Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;

When a multi-touch is operated so that a specific button is recognized as a target button, after a multi-touch operation starts, or after a multi-touch operation, including after the operation ends,

Character input method characterized in that it comprises a; after the multi-touch operation of the character assigned to a specific sequence number of characters assigned to the button recognized as the target button.

[Claim 87]

The method according to claim 86,

According to the operation after the multi-touch,

Character input method characterized in that the specific sequence number of the input character is determined.

[Claim 88]

The method according to claim 87,

If the drag direction is different, the character input method characterized in that it is recognized that the operation type is different after the multi-touch.

[Claim 89]

The method according to claim 87,

Depending on the situation before the final operation, a specific character group among at least one character group is matched, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Method characterized in that.

[Claim 90]

The method according to claim 89,

The "character group" is a method characterized in that any one of the following character groups.

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 91]

The method according to claim 86 to claim 90,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 92]

The method of claim 91,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 93]

The method according to claim 92,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 94]

The method according to claim 92,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 95]

The method according to claim 92,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 96]

The method according to claim 92,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 97]

The method of claim 91,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 98]

The method according to any one of claims 86 to 97,

The multi-touch,

A method characterized in that two fingers are used to recognize two multi-touches recognized by two touch points.

[Claim 99]

The method according to claim 98,

The two fingers,

The method characterized in that it is the index finger and the middle finger.

[Claim 100]

The method according to any one of claims 86 to 99,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 101]

The method according to any one of claims 86 to 100,

After multi-touch operation, characterized in that at least one of the following operations.

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 102]

The method according to any one of claims 86 to 101,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 103]

The method according to any one of claims 86 to 102,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

[Claim 104]

In a device having a touch screen, in the method of inputting text,

After the keyboard is displayed on the touch screen,

In the case of being operated after multi-touch so that a specific button is recognized as a target button,

The time at which the last operation of at least one of the last operations can be started, including nine behaviors including dragging in eight directions: off or upper, lower, left, right, upper left, lower left, upper right, and lower right. After or after the last operation starts, including after the last operation ends,

By a post-multi-touch operation including a final operation of at least one of the final operations that can include nine behaviors including multi-drags in the off or eight directions,

Among the at least one character group, while belonging to a specific character group, when a specific character is input among at least one character associated with a button recognized as a target button,

Depending on the situation before the final operation, a specific character group among at least one character group is matched, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Method characterized in that.

[Claim 105]

The method of claim 104,

The "character group" is a method characterized in that any one of the following character groups.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 106]

The method according to claim 105,

The "character group" means that a character group to which other characters belong in the spelling rule is a character group of characters input in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 107]

The method according to claim 106,

The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.

In English,

If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,

If the currently set text mode is a lower case mode, it is a character group that can be entered in upper case mode

In Japanese

If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,

If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode.

[Claim 108]

The method according to claims 104 to 107,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 109]

The method according to claim 108,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 110]

The method according to claim 109,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 111]

The method according to claim 109,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 112]

The method according to claim 109,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 113]

The method according to claim 109,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 114]

The method according to claim 108,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 115]

The method according to claim 104 to claim 114,

The multi-touch,

A method characterized in that two fingers are used to recognize two multi-touches recognized by two touch points.

[Claim 116]

The method according to claim 115,

The two fingers,

The method characterized in that it is the index finger and the middle finger.

[Claim 117]

The method according to any one of claims 104 to 116,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 118]

The method according to any one of claims 104 to 117,

After multi-touch operation, characterized in that at least one of the following operations.

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 119]

The method according to any one of claims 104 to 118,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 120]

The method according to any one of claims 104 to 119,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

[Claim 121]

In a device having a touch screen, in the method of inputting text,

After the keyboard is displayed on the touch screen,

In the case of being operated after multi-touch so that a specific button is recognized as a target button,

At least one of the final operations that can include 5 (9?) behaviors including dragging in 4 (8?) directions: off or up, down, left, right (, top left, bottom left, top right, bottom right) After the start of the last operation of one behavior, or after the start of the last operation, including after the end of the last operation,

By a post-touch operation including a final operation of at least one of the final operations that can include 5 (9?) behaviors including multi drag in the off or 4 (8?) direction,

Among the at least one character group, which belongs to a specific character group (delete?), is associated with the target button (or assigned to the target button??), and the first character, which is a specific character, of the at least one character.

A method characterized in that a second character, which is at least one specific character promised for each final operation, is additionally input regardless of the target button.

[Claim 122]

The method according to claim 121,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 123]

The method according to claim 122,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 124]

The method according to claim 123,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 125]

The method according to claim 123,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 126]

The method according to claim 123,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 127]

The method according to claim 123,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 128]

The method according to claim 122,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 129]

The method of any one of claims 121-128,

Character input method characterized in that the character assigned to the target button is displayed to the left of the additional input character.

[Claim 130]

The method according to any one of claims 121 to 129,

The second character is a character input method, characterized in that any one of vowel, consonant, half-vowel, half-consonant, or special characters.

[Claim 131]

In accordance with claim 130,

The second character, the character input method characterized in that it includes at least one of the characters corresponding to the pronunciation of the pronunciation of the English [a], [e], [i], [o], [u] .

[Claim 132]

The method according to claim 130,

The second character, A, E, I, O or character input method comprising at least one of U.

[Claim 133]

The method according to claim 130,

The second character, T, S, N, R, H, D, L or character input method characterized in that it comprises at least one of C.

[Claim 134]

The method according to claim 130,

The second character is at least one of ㅏ, ㅓ, ㅗ, ㅜ, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ, or ㅞ Character input method comprising a.

[Claim 135]

The method according to any one of claims 121 to 129,

When dragging long, the second character is a character input method, characterized in that two or more characters.

[Claim 136]

The method according to any one of claims 121 to 129,

Characterized in that the touch is maintained, when dragging in the same direction once again or dragging is changed and the dragging direction is continuously added and input characters are input; characterized in that it further comprises.

[Claim 137]

The method of any one of claims 121-128,

According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character of at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode. A method characterized by additionally being input together.

[Claim 138]

The method according to claim 137,

When either one of multi-all on & on or multi-all dragging in four directions is performed, the second character is any one of A, E, I, O, and U, or

When the manipulation of either the multi-snall reference finger on or off or the multi-snall multi-snall finger drag is performed, the second character is either W or Y, or

When any one of the four-way single drag operation is performed, the second character is one of T, S, N, and R, or

If any one of the multi-all drags is performed after a single touch in four directions, the second character is any one of H, D, L, and C.

[Claim 139]

The method according to any one of claims 121 to 138,

When there are more than two letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 140]

The method according to any one of claims 121 to 139,

When there are more than two letters assigned to the target button,

According to the situation before the final operation, the method characterized in that the first character is selected and input.

[Claim 141]

The method of claim 121-140,

The multi-touch,

A method characterized in that two fingers are used to recognize two multi-touches recognized by two touch points.

[Claim 142]

The method of claim 141,

The two fingers,

The method characterized in that it is the index finger and the middle finger.

[Claim 143]

The method according to any one of claims 121 to 142,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 144]

The method according to any one of claims 121 to 143,

After multi-touch operation, characterized in that at least one of the following operations.

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

[Claim 145]

The method according to any one of claims 121 to 144,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 146]

The method according to any one of claims 121 to 145,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

[Claim 147]

In a device having a touch screen, in the method of inputting text,

Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;

In the process of multi on and off so that a specific button is recognized as a target button,

After a multi-touch time point or after a multi-touch time point, including after a multi-touch finger is turned off (=multi-touch release),

Depending on the situation before the final operation, a specific character group among at least one character group is matched, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Character input method comprising the steps.

[Claim 148]

The method according to claim 147,

The "character group" is a method characterized in that any one of the following character groups.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

Delete less?

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

[Claim 149]

The method of claim 148,

The "character group" means that a character group to which other characters belong in the spelling rule is a character group of characters input in another character mode in the spelling rule corresponding to the currently set character mode.

[Claim 150]

The method according to claim 149,

The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.

In English,

If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,

If the currently set text mode is a lower case mode, it is a character group that can be entered in upper case mode

In Japanese

If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,

If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode.

[Claim 151]

The method of claim 147 to 150,

In the way the target button is recognized,

A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range.

[Claim 152]

The method according to claim 151,

A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

[Claim 153]

The method according to claim 152,

In the case where the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),

A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

[Claim 154]

The method according to claim 152,

When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),

A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button.

[Claim 155]

The method according to claim 152,

The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,

3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among a small order of X-coordinate values among multi-touched touch points is recognized as a target button.

[Claim 156]

The method according to claim 152,

The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,

2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,

3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi-touched touch points is recognized as the target button. How to do.

[Claim 157]

The method according to claim 151,

A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

[Claim 158]

The method according to claim 147 to 157,

The two multi-touch is multi-touch recognized by the touch points of the index finger and middle finger, or

The three multi-touch is multi-touch recognized by the touch points of the index finger, middle finger and ring finger, or

The method of claim 4, wherein the multi-touch is multi-touch recognized by the touch points of the index finger, middle finger, ring finger, and small finger.

[Claim 159]

The method according to any one of claims 147 to 158,

A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

[Claim 160]

The method according to any one of claims 147 to 159,

After multi-touch operation, characterized in that at least one of the following operations

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

[Claim 161]

The method of any one of claims 147-160,

The character that can be applied is a method characterized in that the general character representing the language is water, and also includes numbers or special characters.

[Claim 162]

The method according to any one of claims 147 to 161,

The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

As described above, according to the present invention, the buttons appearing on the touch screen are used to allow the user to operate more conveniently in the user input. In particular, a small touch button can be recognized as multi-touched without actually multi-touching it.

In addition, through various multi-touch manipulation methods, specific characters can be input in addition to the characters assigned to the target button, so that the character input speed can be improved.

And, through various multi-touch manipulation methods, it can be assigned to the currently set character mode like characters in other character modes (including special characters), but not in the currently selected character mode, but only in a late sequence (for example, the fourth or higher sequence number). Characters that could not be assigned to the currently selected text mode can be easily entered in the currently selected text mode without changing the text mode, although they cannot but be assigned to the currently selected text mode. It can also be interpreted that the character assigned to the mode is interpreted as being additionally assigned to the currently selected character mode, so that it can be easily entered in the currently selected character mode.)

In addition, through various multi-touch manipulation methods, the size of each button of the conventional QWERTY keyboard is increased by 2-3 times, and typos are prevented through the improved QWERTY keyboard where 2~3 characters are assigned to each button. The same copper wire is required so that the input speed can be improved.

In addition, while objects including pictures, pictures, browsers, and windows are being multi-touched with two or more fingers, the direction of the touch of the touched finger including the object being enlarged or reduced by pinching or unfolding two or more fingers is opposite. The shape of the object is not deformed by the method, but the shape of the object, including the object being enlarged or reduced, can be deformed through a more convenient manipulation method including dragging two or more fingers in the same direction. Thereby, the operation speed is also fast, the finger movement is small and comfortable, and even a very small object can be easily enlarged or reduced.

In addition, through the multi-touch manipulation method, an object activation step, which must be performed before the shape of the object is changed, is not performed separately, and the object is deformed by being multi-touched and dragged to become a target button.

In the object transformation, it is possible to perform a more precise operation with a finger touched on a touchpad than a mouse.

In a situation in which the mouse pointer is moved with a mouse, the mouse pointer movement distance is set to about 5 times larger than the mouse movement distance, so it is not suitable for precise work. Performing with a finger touched on the touchpad can work with the concept that the finger movement distance and the mouse pointer movement distance are the same, so it is suitable for precise work.

In addition, in the above-described effect, in a multi-touch process, the target button can be recognized even when multi-touched, and among the target button recognition methods, in particular, by the target button recognition method by the reference finger The convenience of is greatly improved, and if the multi-touch on/off method is combined among the operation methods after multi-touch, the number of possible operations and convenience are rapidly increased.

1 is a diagram showing a 5X4 keyboard on a touch screen that includes a 3X4 keyboard (also assigned to special characters),
Figure 2 is a view showing an electronic device showing a portion of the display screen with special characters assigned together with the normal characters, because the physical buttons are installed;
3 is a view showing a 5X4 keyboard that can be applied to a method of recognizing a target button by using open fingers,
4 is a diagram showing a 4X4 keyboard to which a target button recognition method by a reference finger is applicable;
5 is a diagram showing an input keyboard in a Japanese Hiragana input mode of type 3ㅧ4,
FIG. 6 is a diagram showing a state in which five characters of hiragana (see upper drawing) and katakana (see lower drawing) assigned to each button are popped up;
7 is a view illustrating a conventional English qwerty keyboard (the method of the present invention is also applicable),
8 is a view illustrating an improved English QWERTY keyboard applicable to the present invention in which two characters are assigned to one button,
9 is a view illustrating a conventional Korean qwerty keyboard (the method of the present invention is also applicable),
10 is a diagram illustrating an improved Hangul QWERTY keyboard applicable to the present invention in which two characters are assigned to one button;
11 is a diagram illustrating an improved English QWERTY keyboard applicable to the present invention in which three characters are assigned to one button,
FIG. 12 is a diagram illustrating a Cheonjiin keyboard, one of 3X4 keyboards for Hangul input;
13 is a diagram showing a state in which five vowels A, E, I, O, and U, which are additionally input together with S and S assigned to the target button, are popped up (Example of operation after touch:'Multi All On &Off'','Multi All Drag'),
14 is a view referenced to memorize the drag directions related to A, E, I, O, and U that are additionally input together with S assigned to the target button,
15 is a diagram provided to explain the process of inputting the English word "SAME";
16 is a diagram provided to explain the process of inputting the English word "BEAUTIFUL";
FIG. 17 is a diagram showing a state in which T, S, N, and R additionally inputted with S and S assigned to a target button are popped up (Example of operation after touch:'Single drag').
18 is a view for memorizing the drag direction related to T, S, N, and R, which are additionally input together with S assigned to the target button,
FIG. 19 is a view showing a state in which H, D, L, and C additionally input with the S and S assigned to the target button are popped up (Example of operation after touch:'Multi-all drag after single touch')
20 is a view referenced to memorize the drag directions related to H, D, L, and C that are additionally input together with S assigned to the target button,
21 is a diagram showing a state in which? (Question mark),. (Dot),, (comma), and! (Exclamation mark) that are additionally input together with S and S assigned to the target button are popped up (Example of operation after touch: 'Finger drag by multi-scythe all-scythe'),
22 is a diagram showing a state in which W and Y additionally input together with S and S assigned to the target button are popped up (eg, an operation example after touch:'finger drag based on multi-snull');
23 is a view referenced to memorize the drag direction related to W and Y that are additionally input together with S assigned to the target button,
24 is a drawing provided for a description of a method in which characters are additionally continuously input each time they are dragged by dragging two or more times in the same direction continuously or by changing the dragging direction;
25 is a block diagram of an electronic device to which the present invention is applicable.
26 is a view compared to FIGS. 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37;
27 is a view in which the horizontal length is unchanged and the vertical point of the object is moved upward while the vertical length is enlarged, as compared to FIG. 26;
FIG. 28 is a view in which the horizontal length is not changed and the vertical point of the object is reduced while the horizontal length is unchanged compared to FIG. 26;
29 is a view in which the vertical length is not changed and the horizontal point is enlarged while the center point of the object is moved to the right, compared to FIG. 26;
FIG. 30 is a view in which the vertical length is not changed and the horizontal point is reduced while the center point of the object is moved to the right, compared to FIG. 26,
FIG. 31 is an enlarged view of the horizontal and vertical lengths of the object as the center point of the object moves to the upper right side, compared to FIG. 26;
FIG. 32 is a view in which horizontal and vertical lengths are reduced while the center point of the object is moved to the upper right side compared to FIG. 26,
FIG. 33 is an enlarged view of the horizontal and vertical lengths of the object as the center point of the object is moved to the lower right side compared to FIG. 26;
FIG. 34 is a view in which the horizontal and vertical lengths are reduced while the center point of the object is moved to the lower right side compared to FIG. 26;
35 is a view in which the center point of the object is not moved, the horizontal length is not changed, and only the vertical length is enlarged, compared to FIG. 26;
36 is a view in which the center point of the object is not moved, the vertical length is not changed, and only the horizontal length is enlarged, compared to FIG. 26;
FIG. 37 is a view in which the vertical and horizontal lengths are enlarged without moving the center point of the object, compared to FIG. 26;
38 is an exemplary view before an object is activated
Fig. 39 is an exemplary view showing a rectangular active area boundary and 8 zoom control points and 1 rotation control point after the object is activated when the object is activated in the conventional method.
FIG. 40 is a diagram illustrating that when the object is activated by a conventional method, the mouse pointer is changed to a left and right bidirectional arrow when the mouse pointer is placed on an enlargement/reduction control point in the middle of the right and left sides of the boundary of the active area of the object;
FIG. 41 is a diagram illustrating that when the object is activated in the conventional method, the mouse pointer is changed to the up and down arrows when the mouse pointer is placed on the zoom control point in the middle of the lower horizontal side of the object's active area boundary;
FIG. 42 illustrates that when the object is activated in the conventional method, the mouse pointer is changed to a diagonal two-way arrow when the mouse pointer is placed on the zoom control point of the vertex at the lower right corner of the object's active area boundary. drawing,
FIG. 43 is a diagram illustrating that when the object is activated in the conventional method, the mouse pointer is changed to a rotation arrow when the mouse pointer is moved to a rotation control point above the boundary of the object's active area;
Figure 44 is a diagram illustrating a situation in which the index finger is recognized as a reference finger, and the button S on which the index finger is touched is multi-touched with the index finger and the middle finger so as to be recognized as the target button (the index finger touches the button S, and the index finger is touched on the index finger) Touching any point to the right of a point),
45 is a diagram illustrating that the same object or an active area of an object is subdivided into various target ranges;
46 is upper, lower, left, and right. It is a diagram exemplifying the range of the upper right, lower right, upper left, lower left, upper right, and lower right directions.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

And, unless otherwise noted, the right hand is considered to be used.

First, we introduce the table of contents of what will be described.

1. Definition of Terms

1.1. Definition of other terms

1.1.1. touch screen

1.1.2 Touch Button

1.1.3. text

1.1.4. finger

1.1.5. Qwerty keyboard

1.1.6. ON

1.1.7. OFF

1.1.8. ON&OFF

1.1.9. drag

1.1.10. X coordinate

1.1.11. Y coordinate

1.1.12. Goal button

1.1.13. Reference finger (= reference touch point)

1.1.14. Scythe (NOT) reference finger (= Scythe (NOT) reference touch point)

1.1.15. Target scope

1.1.16. Target point

1.1.17. Hitting point

1.1.18. Situation before final operation

1.1.19. Final operation,

1.1.20. After detailed touch operation

1.2 Definition of drag direction

1.2.1. Straight drag

1.2.2. Drag to return

1.2.3 Shape drag

1.3. Definition of term for drag length

1.3.1. Short drag

1.3.2. Long drag

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1..1. Single touch

1.4.2.. Definition of multi-touch

1.4.2..1. Multi touch

1.4.2..2. n Multi-touch

1.4.2..3. Multi all touch

1.4.2..4 multi sickle all touch

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

1.5. Definition of terminology after touch

1.5. After touch operation

1.5.1.. Definition of operation after single touch

1.5.1..1. Operation after single touch

1.5.1..2. Single on & off

1.5.1..3. Single drag

1.5.1..4. Single multi-tap

1.5.2.. Definition of operation after multi-touch

1.5.2..1. Multi-touch operation

1.5.2..2. Multi on & off

1.5.2..3. Multi All On & Off

1.5.2..4. Multi sickle all on & off

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

1.5.2..7. Multi drag

1.5.2..8. Multi All Drag

1.5.2..9. Multi sickle all drag

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

1.5.2..12. Multi Multitap

1.5.2..13. Definition of term after multi-touch operation with open fingers

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

1.5.2..14. Most recommended post-touch operation

1.5.2..14.1. Most recommended multi on & off

1.5.2..14.2. Most recommended multi drag

1.5.3... After single touch and after multi touch

1.6. Definition of term button recognition method

1.6.1.. Target button recognition method by reference finger (= Target button recognition method by reference touch point)

1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= target button recognition method by reference touch point according to X coordinate value order)

1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= target button recognition method by reference touch point according to Y coordinate value order)

1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number)

1.6.2.. Target button recognition method with open fingers (= Target button recognition method with open touch points)

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

1.6.3.. Target button recognition method by the range including two or more touch points

1.6.4.. Mixed

2. Synthesis

3. Text input method on the touch screen

4. How to manipulate objects

5. Electronic devices to which the present invention is applicable

Now I will go into the main subject.

1. Definition of Terms

1.1. Definition of other terms

1.1.1. touch screen

It is a concept of all screens capable of recognizing touch including a laser pad and a hologram pad as well as a general touch screen, as a virtual graphic button is displayed and selectable, rather than a keypad equipped with a physical button.

1.1.2 Touch Button

It is a concept that includes not only virtual graphic buttons appearing on the touch screen, but also all objects that appear on the touch screen including photos, pictures, browsers, and windows. When an object becomes a target button, the target button may also be referred to as a target object.

FIG. 1 shows a touch screen in which touch buttons are arranged, and FIG. 2 shows an electronic device in which the touch screen and physical buttons are arranged together. The technical idea of the present invention is applicable not only to the case where only the touch buttons are implemented as illustrated in FIG. 1, but also when the touch buttons and the physical buttons are implemented together.

1.1.3. text

It is a comprehensive concept that means everything that can be input, including characters that represent general languages, symbols or special characters including punctuation marks, and special characters including pictograms.

1.1.4. finger

The concept includes not only the finger of a person performing a touch on the touch screen, but also a tool used to touch the touch screen, such as a stylus pen.

In addition, the word finger throughout the entire contents of the present application is a concept that can include a touch point where a finger is touched from the viewpoint of a device.

so. In the entire contents of the present application, the word'finger', which is mainly used from the user's point of view, may be replaced with a'touch point where a finger is touched' or'touch point by a finger' or'touch point' from the viewpoint of the device. many. For example, the word'detection' may be interpreted only as the meaning of the word'detection', but it can be replaced by'touch point where the index finger is touched' or'touch point by the index finger' or'touch point'. There are many cases. In particular, the word finger in the term defined in the definition of the term is often the same term even if it is replaced with the word touch point.

In other words, throughout the present application including claims, the word of the finger concept including the finger or the index finger or the middle finger is mainly used and described in the user's position, and the rights are claimed, but the content of the device is as described in the description above and below. It should be regarded as being explained or claimed even if it is changed to a phrase in terms of position. In other words, the part that cannot be explained in other words or cannot be changed in other words should be regarded as above.)

So, the phrase containing the word finger is changed to a phrase containing the word touch point, which is a phrase from the standpoint of the device, and words used before or after the word finger can be changed according to the situation. It should also be considered as being described or claimed.

This is also because the device does not know which finger the person's finger touched.

for example,

The phrase'multi-touched by detection and middle finger' can be changed to the phrase'multi-touched by a certain touch load and another touch point' or'multi-touched by two touch points' or the same phrase. And

The phrase'the first touched finger is recognized as the reference finger, and the later touched finger is recognized as the sickle reference finger' is the phrase'the first touched point is recognized as the reference touch point, and the later touched point is the sickle reference touch point. Can be replaced with the phrase'recognized' or the same meaning

The phrase'when the index finger, the reference finger, is touched first, and then the stop, which is the sickle reference finger, is touched later' is the phrase'when the scythe reference touch point is touched later after touching the reference touch point first', or the same phrase Can be changed to

The phrase'touched finger' can be replaced with the phrase'(touched) touch point' or the same phrase.

The phrase'points where fingers are touched' may be changed to the phrase'(touched) touch points' or a phrase having the same meaning.

1.1.5. Qwerty keyboard

Originally, it refers to the English computer keyboard standard keyboard, which has the letter assignment in the order of Q, W, E, R, T, and Y in the English keyboard. Refers to the keyboard containing the order of text assignment in Esau. Also, the concept includes an improved QWERTY keyboard as shown in FIGS. 8, 10, and 11.

7 is an example of an English QWERTY keyboard, and FIG. 9 is an example of a Korean QWERTY keyboard.

1.1.6. ON

(Touch screen) refers to being touched, that is, touching a finger on the touch screen.

1.1.7. OFF

It means that the touch is released (at the touch point), that is, the finger falls off the touch screen.

1.1.8. ON&OFF

It refers to an operation that is not dragged after the touch point is turned on, but is immediately turned off.

1.1.9. drag

Refers to an operation in which the touch point is maintained in the'on' state and is moved to another point. There are various drags including'straight drag','return to place drag', and'shape drag', and detailed descriptions thereof will be provided later.

1.1.10. X coordinate

It is a coordinate on a horizontal axis indicating a specific point on the touch screen.

1.1.11. Y coordinate

The coordinates on the vertical axis representing a specific point on the touch screen.

1.1.12. Goal button

When a user attempts to perform a specific operation with the'post-touch operation' described later, it refers to a button directly related to the specific operation. That is, it refers to a specific button targeted by the user.

1.1.13. Reference finger (= reference touch point)

Among the multi-touch fingers, it refers to a finger that is a reference for the device to recognize the target button. In the normal case, the finger touching the target button is the reference finger.

From the perspective of the device, it refers to a touch point that is a reference for the device to recognize the target button among the multi-touched touch points.

1.1.14. Scythe (NOT) reference finger (= Scythe (NOT) reference touch point)

It refers to at least one finger except the reference finger among the multi-touch fingers.

From the viewpoint of the device, it refers to at least one touch point excluding a reference touch point among multi-touch points.

1.1.15. Target scope

A concept that is primarily needed when working with objects such as photos, pictures, and browsers,

When a user attempts to perform a specific operation with'post-touch operation' described later, a specific range within an object (or an object activation area boundary) directly related to the specific operation, that is, a specific range targeted by the user Refers to.

For example, in a single touch, a range including a point actually touched is recognized as a target range, and in a method of recognizing a target button by a reference finger, a range including a point where a base finger is actually touched is recognized as a target range.

For another example, as the center point of the object is moved, the length of the left vertical side of the object, the length of the right vertical side, and the position of the left vertical side of the object are not changed, while the position of the right vertical side of the object is changed, the upper horizontal side of the object The target range is the right range of the vertical line passing through the center point of the object (or object activation area boundary line) among the points inside the object (or object activation area boundary line) so that the length of the horizontal side and the lower horizontal side is equally enlarged to the right. It can be multi-touched and dragged to the right.

1.1.16. Target point

When a user attempts to perform a specific operation with'post-touch operation', which will be described later, a specific point within a button or object (or an object activation area boundary) directly related to the specific operation, that is, the user aims Refers to a specific point.

For example, in a single touch, it refers to a point that the user intended to touch, and in a method of recognizing a target button by a reference finger, it refers to a point that the intended finger is intended to be touched.

For another example, as the center point of the object is moved, the position of the lower left and right vertices of the object is not changed, and the lengths of the upper and lower horizontal sides, the left vertical side, and the right vertical side of the object are enlarged. , Among the internal points of the object (or the object activation area boundary line), the upper right corner of the object (or the object activation area boundary line) may be multi-touched to be recognized as a target point and dragged in the right direction.

1.1.17. Hitting point

The device is also a specific point required to recognize the target button or target range, is a specific point calculated by at least one touch point actually touched, and the range including the hitting point is to be recognized as the target range or target button. Can.

For example, in a single touch, the point at which the single-touched finger is actually touched is the hitting point, and in the method of recognizing the target button by the reference finger, the point at which the base finger is actually touched is the hitting point.

1.1.18. The situation before the final operation,

1.1.19. Final operation,

1.1.20. After detailed touch operation

Since the situation before the final operation, the final operation, and the operation after the detailed touch are closely related to each other, they will be explained at once.

The situation before the final operation refers to the situation from the (detail) touch to the operation immediately before the final operation is started.

The final operation is a process following the situation before the final operation, and is the last operation to complete the operation after (detail) touch. For example, drag in various directions including off or up, down, left, back, top left, bottom left, top right, or bottom right, two or more consecutive drags (the drag direction may change), long drag, short drag There is.

The operation after detailed touch is the sum of the situation before the final operation and the final operation. In other words, as a detail of the operation after the touch related to the target button, if the operation behavior related to the target button is not the same, the operation after the detailed touch is different. After the detailed touch, the operation may be simply expressed as a detailed operation or operation.

For a comprehensive example of the situation before the final operation, the final operation, and the operation after the detailed touch,

The five final operations of single on&off and single, single dragging in four directions of up, down, left and right, starting with a single touch, and five final operations of dragging in off or four directions are started. The situation up to the point of becoming the same is the same for all of the five detailed touch and post-operation operations, so all the five detailed touch and post-operation situations are the same operation,

2 Five touches of multi-all on & off and multi-all dragging in four directions: up, down, left, and right, starting with multi-touch. In operation, five finals: dragging in off or four directions. Since the situation up to the start of the operation is the same for all of the five detailed touch-and-after operations, all of the five detailed touch-after operations are the same operation before the final operation,

2 Five touches of multi-snall finger start & off and multi-snall standard finger drags in four directions: up, down, left, and right, starting with multi-touch. Since the situation until the end of the five final operations of dragging is the same for all of the five detailed touch-after operations, all the operations after the five detailed touches are the same operation before the final operation,

After single touch, after 2 multi touches, multi-all on & off and after 4 single touches in each of 4 directions: up, down, left, and right. Since the situation until the end of the five final operations of dragging is the same for all of the five detailed touch-after operations, all of the five detailed touch-after operations are the same operation before the final operation.

However, since multi-all on&off starting with 2 multi-touch and multi-all on&off starting with 3 multi-touch are not the same as before the final operation called off, the details before the final operation are different. It is an operation after the touch, and as a result, the operation after the age becomes different,

Since the situation of the multi-all drag in the upward direction starting with 2 multi-touch and the multi-all drag in the upward direction starting with 3 multi-touch is not the same as before the final operation of dragging upward, the situation before each final operation It is another post touch operation, and consequently, the post post count operation is different.

And, even if multi-all on&off starts with 2 multi-touch, the process of 2 multi-touch is multi-all on&off while multi-all touch and multi-all on&off while multi-all-all touch is off. Since the situation just before the start is not the same as each other, the situation before the final operation is a detailed post-touch operation, and consequently, the operation after the age is different,

And, the final operation here means the last operation that is turned off (first) or dragged in the first full-fledged operation after being touched. It doesn't mean the last operation on how to change the direction, so that each additional character is entered in succession each time it is dragged.

1.2 Definition of drag direction

1.2.1. Straight drag

Left (west), right (east), upper (north), lower (south), lower right (southeast), lower left (southwest), upper right (northeast), and left-direction (northwest) do.

1.2.2. Drag to return

A straight line refers to a drag that returns after being dragged straight in one direction and then dragged back into place without being turned off.

1.2.3 Shape drag

It refers to a drag made in several directions, not just one direction, such as a circle, a semicircle, a triangle, or a square.

1.3. Definition of term for drag length

1.3.1. Short drag

It refers to being dragged below a certain (coordinate) length. Here, the constant (coordinate) length can be set to the horizontal or vertical length of one touch button, but it can also be set differently.

1.3.2. Long drag

It refers to being dragged over a certain (coordinate) length. It should be noted that, in this specification, “drag” not specifically indicated as “long drag” means “short drag”.

1.4. Definition of terms for touch

1.4.1.. Definition of terms for single touch

1.4.1..1. Single touch

It refers to being touched so that a state in which only one finger is touched exists. In the normal case, a single touch is implemented by touching the target button with the index finger among 5 fingers.

From the standpoint of the device, it refers to being touched so that only one touch point exists.

1.4.2.. Definition of multi-touch

1.4.2..1. Multi touch

It refers to a touch in which two or more fingers are touched.

From the perspective of the device, it refers to being touched so that two or more touch points exist.

Referring to the point in time at which the device starts to judge one (unit) touch including one (unit) single touch or multi-touch, from the viewpoint of the device, the touch point touched at the point when there is no touched point is newly If it occurs and the new touch point is turned off without generating additional touch after the touch point, it can be judged that the operation has been performed after touching with only a single touch. When none of the touched touch points is turned off, that is, the touch state of all touch points touched so far is maintained, at least one new touch occurs whenever a new multi-touch method is described below. It can be used to judge multi-touch recognition.

1.4.2..2. n Multi-touch

Refers to multi-touch so that a state in which n fingers are touched exists. (From the viewpoint of a device, it refers to multi-touch so that a state in which n touch points are touched exists.)

For example,

1) 2 multi-touch is multi-touch so that two fingers are touched.

2) 3 multi-touch is multi-touch so that 3 fingers are touched.

3) 4 multi-touch refers to multi-touch so that a state in which 4 fingers are touched exists.

In the present application, n multi-touch or multi-touch means that multi-touch is performed in a multi-all touch state, which will be described later, unless there is a special mention or suggestion as to which of the various multi-touch methods described below.

1.4.2..3. Multi all touch

As a kind of multi-touch, when multi-touching, the time difference between the time at which the first touched finger is turned on and the time at which the last touched finger is turned on is multi-touched at the same time or less. Refers to multi-touch in the case.

(From the viewpoint of the device, as a type of multi-touch, when multi-touch, the time difference between the time at which the first touch point is turned on and the time at which the last touch point is turned on is less than a certain time (eg 0.1 seconds) Refers to multi-touch when multi-touch is performed almost simultaneously.)

For example, in the case of two-touch with the index finger and the middle finger, the middle finger and the index finger are simultaneously touched on the touch screen. At this time, even if the middle finger is touched on the touch screen before the index finger, if the time difference between the time when the middle finger is touched and the time when the index finger is touched is 0.1 second or less, the case where the middle finger is recognized as a multi-all touch of the middle finger is included here. .

1.4.2..4 multi sickle all touch

As a type of multi-touch, when multi-touch, the time difference between the time at which the first touched finger is turned on and the time at which the last touched finger is turned on is referred to as multi-touch. .(From the perspective of the device, as a kind of multi-touch, when multi-touch, the time difference between the time when the first touch point is turned on and the time when the last touch point is turned on is a certain time (eg 0.1 second) Refers to multi-touch exceeding.)

This includes'multi-snall reference finger touch', ``multi-snall reference finger touch'' and'multi-snall reference finger change touch', which will be described later.

For example, in the case of two-touch by detecting and stopping, when the stopping touches the touch screen before the detecting, the time when the stopping is turned on exceeds the time when the detecting is turned on (for example, 0.1 seconds) and exceeds the time. Is included here.

It is not recommended to apply a multi-all touch to a multi-all all touch when applying the method of the present application to a real device since multi-not all touch is not recommended.

1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)

As a kind of multi-sick all-touch, it refers to a case in which the reference finger is first touched and then the sickle reference finger is touched later. That is, it refers to a case in which a finger touched first is recognized as a reference finger, and a finger touched later is recognized as a sickle reference finger.

(From the standpoint of the device, it is a kind of multi-sick all-touch, and refers to a case in which the reference touch point is touched first and then the sickle reference touch point is touched later. That is, the first touch point is recognized as the reference touch point, Refers to a case where a touch point touched later is recognized as a sickle reference touch point.)

For example, when the index finger is recognized as the reference finger, and the middle finger is touched with the index finger and the middle finger to be recognized as the sickle reference finger, when the index finger as the reference finger is touched and the middle finger as the sickle reference finger is touched, the index finger is detected. This includes the case where the time difference between the time when the touch is on and the time the middle is touched exceeds a certain time (for example, 0.1 second).

1.4.2..6. Finger touch based on multi-scythe all-scythe (= touch point based on multi-scythe all-scythe)

As a kind of multi-sick all-touch, it refers to a case where the reference finger is touched first and then the reference finger is touched later. That is, it refers to a case in which the first touched finger is recognized as the sickle reference finger, and the later touched finger is recognized as the reference finger.

(From the device's standpoint, it is a kind of multi-sick all-touch, and refers to the case where the sickle reference touch point is touched first, and then the reference touch point is touched later. That is, the touch point touched first is recognized as the sickle reference touch point. , Refers to a case in which a touch point touched later is recognized as a reference touch point.)

For example, when the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger in two multi-touches with the index finger and the middle finger, after the middle finger that is the sickle reference finger is touched, the index finger that is the reference finger is touched later. This includes cases where the time difference between the time when the middle finger is touched and the time when the index finger is touched exceeds a predetermined time (for example, 0.1 second). Even if the index finger as the reference finger is touched later, the button including the touch point to which the index finger was touched retains its position as a target button.

1.4.2..7. Multi-sick all reference finger fluctuating touch (= multi-sick all reference touch point fluctuating touch)

As a kind of multi-sick all-touch, it refers to a touch when a finger touched in a predetermined sequence is recognized as a reference finger, and is actually included in the'multi-sick all-touch', and It is a concept that includes a'multi-sick all-sick reference finger touch'.

(From the standpoint of the device, it is a kind of multi-not all-touch, and refers to a touch when a touch point touched in a predetermined sequence is recognized as a reference touch point, and is actually included in the'multi-not all touch', ' It is a concept that includes'touch the touch point based on multi-sick all-all' and'touch the touch point based on multi-sick all-sick.')

For example,

1) The first touched finger is designated to be recognized as a reference finger, or

2) The second touched finger is designated to be recognized as the reference finger, or

3) The third touched finger is designated to be recognized as the reference finger, or

4) The fourth touched finger may be designated to be recognized as a reference finger.

If, in 2 multi-touch by index and middle finger, the index finger is touched before the middle finger,

1) If the first touched finger is designated to be the reference finger, the first touched index finger becomes the reference finger,

2) If the second touched finger is designated to be the reference finger, the second touched finger is the reference finger.

1.4.2..8. Definition of multi-touch term with open fingers

1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)

As a concept almost identical to the definition of the term'multi-touch',

However, when the definition of the term'multi-touch' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)

As a concept almost identical to the definition of the term'n multi-touch',

However, when the definition of the term'n multi-touch' is understood, the'target button recognition method using a spread finger', which will be described later, is only a concept applied as a target button recognition method.

1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)

As a concept almost identical to the definition of the term'multi all touch',

However, when the definition of the term'multi-all touch' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

1.4.2..8.4. Multi sickle all touch by spread fingers (= multi sickle all touch by spread touch points)

As a concept almost identical to the definition of the term'multi sick all touch',

However, when the definition of the term'multi sick all touch' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

It is not recommended to apply the multi-all-all touch by the open finger and the multi-all-all touch by the open finger when applying the method of the present application to a real device, since multi-snall touch by open fingers is not recommended.

1.4.2..8.5. Multi-snall reference finger touch by open fingers (= multi-snall reference touch point touch by open touch points)

As a concept almost the same as the definition of the term'multi-sick all standard finger touch',

However, when the definition of the term'multi-snall standard finger touch' is understood, the'target button recognition method by open fingers' described later is applied as a target button recognition method, and the'multi-snall standard finger touch' In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) is the rightmost finger. It is just a concept replaced by (= touch point).

1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers

As a concept almost the same as the definition of the term'multi-sick all-scythe finger touch',

However, when the definition of the term'multi-snall standard finger touch' is understood, the'target button recognition method by open fingers' described later is applied as a target button recognition method, and the'multi-snall standard finger touch' In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) is the rightmost finger. It is just a concept replaced by (= touch point).

1.5. Definition of terminology after touch

1.5. After touch operation

It is a term including'single-touch operation' and'multi-touch operation' which will be described later.

1.5.1.. Definition of operation after single touch

1.5.1..1. Operation after single touch

'Single On & Off','Single Drag', and'Single Multi-Tab', which will be described later, are included in the operation after a single touch.

The operation after single touch means only the operation in which subsequent movements are additionally performed after the single touch, but (in rare cases), it can be used to include the moment of single touch before any operation after single touch. It is a term that can be.

So, it can be misunderstood as a single touch after being single touched, including a single on/off after single touch or single drag after single touch, so that it can be misunderstood as a single touch. Since the description that may be misunderstood as if the occurrence occurs twice, or the claims that are claimed in the claims are only mentioned to help understanding, the single touch should be interpreted as occurring only once.

For example,

The term “single on & off after a single touch with the index finger” means that the index finger is turned off without being dragged after being single touched with the index finger, that is, it is single on & off with a single touch or starts with a single touch. The single being on & off being said,

The term “single drag on the upper side after the index finger is single touched” means that after the single touch with the index finger, the index finger is not turned off and the index finger is dragged upward while the index finger is touched. That is, it means single dragging to the upper side while being single touched or single dragging to the upper side starting with single touch.

In other words, the expression that it is operated after a single touch after a single touch is the same as saying that it is manipulated after a single touch. It is expressed.

This is because there is no need to operate a single touch twice unless it is related to'single multi-tap'.

1.5.1..2. Single on & off

Refers to an operation that does not drag after a single touch and immediately turns off.

1.5.1..3. Single drag

Refers to an operation that is dragged while the state in which the finger is touched is maintained after a single touch. (From the viewpoint of the device, it refers to an operation that is dragged while the touch point is maintained after a single touch.)

1.5.1..4. Single multi-tap

It is generally called a multi-tap method, and refers to an operation in which the same button is continuously pressed with one finger. (From the standpoint of the device, it is generally called a multi-tap method, and the same button is continuously touched with one touch point. Refers to losing manipulation.)

1.5.2.. Definition of operation after multi-touch

1.5.2..1. Multi-touch operation

The'multi drag','multi on & off' and'multi multi tap', which will be described later, are included in the multi-touch operation.

The post-multi-touch operation means only an operation in which subsequent movements are additionally performed after the multi-touch, but (in such a case, rarely,) includes the multi-touch operation until the moment of multi-touch before any operation is performed. It is a term that can be used.

So, it can be misunderstood as being operated by being multi-touched again after multi-touching, including those described as multi-all on & off after multi-touching or multi-all dragging after multi-touching. Multi-touch should be interpreted as occurring only once, since the description that may be misunderstood as if the touch occurs twice, or the claims that are claimed in the claims are only mentioned to aid understanding.

For example,

The term multi-all on & off after two multi-touch with the index finger and middle finger means that both the index finger and the middle finger are turned off at the same time, without dragging, after being multi-touched with the index finger and middle finger. It means that the multi-all is turned on and off while being multi-touched with 2, or the multi-all is turned on and off that is started with 2 multi-touch by detecting and stopping.

After two multi-touch with the index finger and middle finger, multi-all dragging upwards means that after the multi-touch with the index finger and middle finger, the index, middle finger and middle finger are not turned off, that is, both the index finger and middle finger are touched. It means that both the index finger and the middle finger are dragged upward. That is, it means that the multi-all is dragged while being multi-touched by the index and middle finger or the multi-all is dragged by the multi-touch that is started by the index and middle finger.

In other words, the expression that it is operated after multi-touch after multi-touch is just the same as the word that it is operated after multi-touch. It is expressed.

This is because there is no need to operate the multi-touch twice unless it is related to'multi-multi-tap'.

1.5.2..2. Multi on & off

As one of the multi-touched fingers that is not dragged and turned off in place,'multi all on & off' and'multi sick all on & off', which will be described later, are included here. From the standpoint, one of the multi-touched touch points is not dragged, and it is an operation to turn off all in place, including'multi all on & off' and'multi sick all on & off', which will be described later. do.)

For example, it is operated after two multi-touches with the index finger and the middle finger, and the operation to turn off the multi-touched finger with the middle finger and the index finger is not included.

1.5.2..3. Multi All On & Off

When the multi-touched fingers are multi-on & off, the multi-on allows the time difference between the time at which the first off finger is off and the time at which the last off finger is off to be less than or equal to a certain time (eg, 0.1 seconds). It refers to &off.(From the standpoint of the device, when multi-touched touch points are multi-on & off, the time difference between the time at which the first touch point is off and the time at which the touch point is turned off later is off Refers to multi-on & off that makes it less than a certain time (eg, 0.1 seconds).)

For example, when it is operated after two multi-touch by detecting and stopping, when the stopping and detecting are simultaneously turned off on the touch screen, even if the stopping is turned off on the touch screen before the detecting, the time and the detecting when the stopping is off If the time difference from the off time is less than or equal to a certain time (for example, 0.1 second), it is included here.

1.5.2..4. Multi sickle all on & off

When the multi-touched fingers are'multi on and off', the time difference between the time at which the first off finger is off and the time at which the last off finger is off exceeds a certain time (e.g. 0.1 seconds). It refers to on & off. Included herein are'multi-snall reference finger on & off' and'multi-snall reference finger on & off', which will be described later.

(From the viewpoint of the device, when the multi-touched touch points are'multi on and off', the time difference between the time when the first touch point is off and the time when the last touch point is off is a certain time (eg It refers to multi on & off exceeding :0.1 sec.,'Multi-not all reference touch point on & off' and'multi-not all sick reference touch point on & off' will be included here.)

For example, when two multi-touch operations are performed with the index finger and the middle finger, one of the middle finger and the index finger is turned off from the touch screen first, and the other is turned off later. If the time difference from the time when the finger is off exceeds a certain time (eg, 0.1 seconds), it is included.

1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)

Refers to an operation in which when the multi-snow all on & off, the scythe reference finger is turned off first, and later the reference finger is turned off. Refers to an operation in which the reference touch point is later turned off after being turned off.)

For example, the index finger is recognized as the reference finger, and the middle finger is operated after 2 multi-touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. Later, when the detection is turned off later, when the time difference between the off time when the stop is off and the off time when the detection is off exceeds a certain time (for example, 0.1 second), it is included.

1.5.2..6. Finger on & off based on multi-sick all-sick (= on and off touch points based on multi-sick all-sick)

Refers to an operation in which when the multi-snow all on & off, the reference finger is turned off first, and then the scythe reference finger is later turned off. After that, it refers to the operation in which the sickle reference touch point is turned off later.)

For example, the index finger is recognized as the reference finger, and the middle finger is operated after 2 multi-touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. When the time difference between the off time when the index finger is on and off and the off time when the stop is on and off is a certain time (for example, 0.1 second), it is included here. .

Even if the index finger, which is the reference finger, is first turned off, the button including the touch point to which the index finger was touched retains its position as a target button.

1.5.2..7. Multi drag

As a drag that proceeds while one or more fingers of the multi-touched fingers remain on,'multi all drag' and'multi sick all drag', which will be described later, are included herein.

(From the perspective of the device, one or more of the multi-touched touch points is a drag that proceeds while the on state is maintained, and'multi all drag' and'multi sick all drag', which will be described later, are included here.)

1.5.2..8. Multi All Drag

It means that none of the multi-touched fingers are turned off, and the whole starts to be dragged and dragged.(From the perspective of the device, none of the multi-touched touch points is turned off, and the whole starts to be dragged. Refers to being dragged.)

The multi-all drag is established when the multi-all dragged finger starts to be dragged in a state in which all the fingers are moving together. Dragging started at the edge of the touch screen (upper, lower, left, right or corner area), and even if one or more of the multi-all dragged fingers was turned off first because of the dragging in the direction of the edge, all of the first multi-touch If there was a point where the fingers were moving together, it is recognized as a multi-all drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after two-touch with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, both the middle finger that is the sickle reference finger and the index finger that is the reference finger are not turned off. The start of dragging together is included if the viewpoint is dragged to exist.

1.5.2..9. Multi sickle all drag

As a drag that is operated such that at least one of the multi-touched fingers is off, and at least one remaining finger that is still on starts to be dragged,'multi-all-all reference finger drag' and'multi Scythe All Scythe Standard Finger Drag' is included here.(From the perspective of the device, while at least one of the multi-touched touch points is off, only at least one remaining touch point that is still on starts to be dragged. As a drag manipulated so that a viewpoint exists,'multi-snall reference touch point dragging' and'multi-snatch reference drag point dragging', which will be described later, are included here.)

The multi-sick all drag is established when the at least one remaining finger, which has been turned on, except for the off finger being dragged with the multi-sick all drag, is started to be dragged while there is a moving point. Dragging started at the edge of the touch screen (upper, lower, left, right, or corner area), and at least one of the fingers that were still on until the start of multi-snall drag was turned off because it was dragged toward the edge. However, if there was a point in time when at least one finger, which had begun to be dragged with multi-snall, was moving together, it is recognized as multi-snall drag.

For example, when the index finger is recognized as the reference finger and the middle finger is operated after two-touch with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, either the middle finger as the sickle reference finger or the index finger as the reference finger is turned off first. In, the case where the rest of the fingers start to be dragged and dragged is included here.

1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)

Refers to a multi-snall drag in which the reference finger starts to be dragged after at least one sickle reference finger is off.(From the standpoint of the device, the reference touch point starts to be dragged after at least one sickle reference touch point is turned off. It refers to the sickle all drag.)

For example, the index finger is recognized as the reference finger and the middle finger is operated after 2 multi-touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger. This includes the case where the index finger, which is the reference finger, is started to be dragged after being turned off later.

1.5.2..11. Finger drag based on multi-sick all-sick (= drag touch point based on multi-sick all-sick)

Refers to a multi-snall drag in which at least one sickle reference finger starts to be dragged after the reference finger is off. It refers to the sickle all drag.)

For example, when the index finger is recognized as the reference finger and the middle finger is operated after two touches with the index finger and the middle finger so that the middle finger is recognized as the sickle reference finger, the index finger that is the reference finger among the middle finger and the middle finger that is the sickle reference finger is turned off first. This includes the case where the middle finger, the sickle reference finger, is started to be dragged and then dragged.

Even if the index finger, which is the reference finger, is first turned off, the button including the touch point to which the index finger was touched retains its position as a target button.

1.5.2..12. Multi Multitap

In general, the multi-tap refers to the operation of pressing the touch button several times with one finger. In comparison to the present application, it can be said that it is a single multi-tap method.

For example, among the touch buttons shown in FIG. 1, A, B and C are assigned touch buttons,

1) Press 1 to input A, or

2) Press twice to input B, or

3) It means the operation that C is input by pressing 3 times.

In contrast, multi-multi-tap refers to multi-tap operation in a multi-touch method.

Specifically, the multi-multi-tap method is

In a device equipped with a touch screen, in a method after a multi-touch operation, a work signal for any operation including character input or object transformation is generated,

After the multi-touch operation method,

The multi-on & off may be a method that may be a method of performing other tasks depending on the number of times that is performed by performing at least one or more consecutively,

In the case that a character is input by the multi-multi-tap method,

Depending on the number of times multi-on&off is performed continuously at least once, characters belonging to the target character group associated with the target button are displayed in circulation, and then single-touch or multi-touch so that other buttons are recognized as target buttons. This is a method that the displayed character can be definitively entered when the cursor is moved or after a certain time (eg, 2 seconds). It is recommended that the method of inputting characters definitively follows any one or more of the methods of inputting characters definitively in the conventional (single) multi-tap method.

As an example of using this, in the normal text mode, the following steps 1) to 3) can be performed without changing the text mode.

Among the touch buttons shown in FIG. 1, after the touch buttons to which A, B, C and !, ◆, / are assigned are multi-touched to be a target button,

1) Multi All On & Off is 1, so that the first character "!" among the characters (!, ◆, /) assigned under A, B, C, not A can be entered.

2) Multi All On & Off is done twice, so the second character "◆" among the characters (!, ◆, /) assigned under A, B, C, not B, can be entered.

3) The multi-all on&off can be done 3 times, so that the 3rd character "/" among the characters (!, ◆, /) assigned under A, B, C, not C can be entered.

In simple terms,

Of the touch buttons shown in Figure 1 A, B, C and !, ◆, / is assigned to the detection and stop so that the assigned button is the target button,

1) Multi-touch (to be precise, multi-all on & off) is 1, so that the first character "!" among the characters (!, ◆, /) assigned under A, B, C, not A can be input. And

2) Multi-touch (to be precise, multi-all on & off) is 2 times, so that the second character "◆" among the characters (!, ◆, /) assigned under A, B, C, not B can be entered. And

3) Multi-touch (to be precise, multi-all on & off) is 3 times so that the 3rd character "/" among the characters (!, ◆, /) assigned under A, B, C, not C can be entered. have.

When the multi-multi-tap method is used, a specific character is input from among at least one character associated with a button recognized as a target button while belonging to a specific character group among at least one character group. This is a method in which a specific character group is matched among one character group, and at least one character of at least one character associated with the target button belongs to the matched character group, and may be input without changing the character mode. (It can also be applied to Qwerty keyboards.)

In short, without changing the character mode, at least one character associated with the target button while belonging to a specific character group can be input. Here, the specific character group may be any one or more of the following.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Matters related to (here 1) to 5) are also covered in various parts of the present application including "3. Text Input Method on the Touch Screen" and claims to be described later. Detailed explanations, including all explanations, will be omitted.)

For example, a character group may be one of two or more different character groups classified into different series according to the spelling rule of "1)".

For example, if the current text mode is in English uppercase mode, for example, the character mode to which a specific character group belongs is lowercase and lowercase mode. For example, if the current character mode is Japanese hiragana or character mode, for example, the character mode to which a specific character group belongs is katakana. According to the spelling rule in the same character system, including the character mode, the character mode may include a character group consisting of different characters corresponding to each character belonging to the current character mode. That is, it may be a character group consisting of characters input in other character modes according to the spelling rule corresponding to the currently set character mode.

For example, if a multi-tap is performed so that a touch button assigned to A, B, or C is recognized as a target button in the English uppercase letter mode, any one of lowercase letters a, b, or c may be input even in the uppercase letter mode. .

Specifically, when multi-tap so that the touch buttons to which A, B, C and !, ◆, / are assigned as the target button are recognized, in the embodiment in which any one of !, ◆, or / is input, !, ◆, or / / instead of a, b, or c, so the format is detailed, detailed embodiments are omitted.

For example, among the characters assigned to the same button in "3)", a group of characters assigned to a specific line may be used. For example, in FIG. 1, A, B, C and !, ◆, / are assigned. "!" assigned to line 2 , It may be a character group assigned to the 2nd line of each button, including "◆", "/". As illustrated in FIG. 1, the characters assigned to the second line of the touch button are special characters, but it is possible that they are embodied as characters other than special characters.

For example, among the characters assigned to the same button in the "4)", the first specific sequence number may be a group of characters assigned to the second specific sequence number above the first specific sequence number. And !, ◆, / are assigned to the 4th to 6th of the assigned touch button "!" , It may be a character assigned to the 4th to 6th of each button including "◆", "/".

Then, when the multi-touch when multi-tapping is expressed in detail by n multi-touch, different character groups are matched according to different n values, so that characters of the corresponding character group are input without changing the character mode. You may.

1.5.2..13. Definition of term after multi-touch operation with open fingers

1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)

As a concept almost identical to the definition of the term'post-multi-touch operation',

However, when the definition of the term'after multi-touch operation' is understood, the'target button recognition method using a spread finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)

As a concept almost identical to the definition of the term'multi on & off',

However, when the definition of the term'multi on & off' is understood, the'target button recognition method with open fingers', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)

As a concept almost identical to the definition of the term'multi all on & off',

However, when the definition of the term'multi all on & off' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)

As a concept almost identical to the definition of the term'multi sick all on & off',

However, when the definition of the term'multi sick all on & off' is understood, the'target button recognition method by open fingers' described later is only a concept applied as a target button recognition method.

1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)

As a concept almost the same as the definition of the term ``multi-sick all standard finger on & off'',

However, when the definition of the term'multi-snall reference finger on & off' is understood, the'target button recognition method by open finger', which will be described later, is applied as a target button recognition method, and the'multi-snall reference finger on' In the definition of &off', the phrase reference finger (= reference touch point) is replaced with the leftmost finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) is the rightmost. It is just a concept replaced by a finger touched on (= touch point).

1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)

As a concept almost the same as the definition of the term ``multi-sick all-single-based finger on&off'' above,

However, when the definition of the term'multi-not-all-not-based finger-on&off' is understood, the'target button recognition method by open fingers', which will be described later, is applied as a target button recognition method, and the'multi-not all-not-not criteria' In the definition of the term finger on & off, the phrase reference finger (= reference touch point) is replaced with the leftmost finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) It is just a concept replaced by the finger touched at the far right (= touch point).

1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)

As a concept almost identical to the definition of the term'multi-drag',

However, when the definition of the term'multi-drag' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.8. Multi-all dragging with open fingers (= multi-all dragging with open touch points)

As a concept almost identical to the definition of the term'multi-all drag' above,

However, when the definition of the term'multi-all drag' is understood, the'target button recognition method by spread fingers', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)

As a concept almost identical to the definition of the term'multi sickle all drag' above,

However, when the definition of the term'multi-sick all-drag' is understood, the'target button recognition method by spread fingers' described later is only a concept applied as a target button recognition method.

1.5.2..13.10. Drag the multi-snall reference finger by the open fingers (= drag the multi-snall reference touch point by the open touch points)

As a concept almost the same as the definition of the term of'multi-finger all-based finger drag' above,

However, when the definition of the term'multi-snall reference finger drag' is understood, the'target button recognition method by open fingers' described later is applied as a target button recognition method, and the'multi-snall standard finger drag' In the definition of the term, the phrase reference finger (= reference touch point) is replaced by the leftmost finger (= touch point), and the phrase sickle reference finger (= sickle reference touch point) is the rightmost finger. It is just a concept replaced by (= touch point).

1.5.2..13.11. Drag the finger on the multi-sick all-scythe with open fingers (= drag the touch point with the multi-sick all-sick by the open touch points)

As a concept almost identical to the definition of the term ``multi-sick all-scythe finger drag''

However, when the definition of the term'multi-sick all-single-based finger dragging' is understood, the method of recognizing the target button by the open finger, which will be described later, is applied as a target button recognition method, and the'multi-snow all-sickness standard finger dragging' In the definition of', the phrase reference finger (= reference touch point) is replaced with the finger touched at the leftmost (= touch point), and the phrase sickle reference finger (= sickle reference touch point) touches the rightmost. It is just a concept replaced by a broken finger (= touch point).

1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points)

As a concept almost identical to the definition of the term'multi-multi-tap' above,

However, when the definition of the term'multi-multi-tap' is understood, the'target button recognition method using a spread finger', which will be described later, is only a concept applied as a target button recognition method.

1.5.2..14. Most recommended post-touch operation

1.5.2..14.1. Most recommended multi on & off

As the most convenient multi-on&off operation for the user, it refers to the'multi-all on&off' that is performed by the index and stop, which are the examples in the definition of'multi-all on&off', and the index finger is recognized as a reference finger. When the middle finger and the index finger are turned off at the same time, the middle finger is turned off before the index finger, even if the middle finger is turned off before the index finger. It refers to the operation in which multi-all on and off is performed so that the time difference between the off time and the time when the detection is off is equal to or less than a certain time (eg, 0.1 seconds).

1.5.2..14.2. Most recommended multi drag

This is the most convenient multi-drag operation for the user. It refers to the'multi-all drag' that is performed with the index and middle finger, which are examples of the multi-all drag definition, and the index finger is recognized as the reference finger, and the middle finger is recognized as the reference finger. It is operated after two multi-touches with the index finger and the middle finger as much as possible, and both the middle finger and the index finger, which are the sickle reference fingers, start to be dragged together (without being turned off).

1.5.3... After single touch and after multi touch

After the target button is single-touched, after the single-touch state is maintained for a certain period of time (e.g., 0.1 seconds), another at least one finger is additionally touched to become a multi-touch state (after multi-touch). Refers to. (From the standpoint of the device, after the target button is single-touched, after the single-touch state is maintained for a certain period of time (e.g., 0.1 seconds), another at least one touch point is additionally touched to become a multi-touch state (multi After touch) refers to the operation in which the operation is performed.)

'After multi-touch operation after single touch' includes'multi-all on & off after single touch' and'multi-all drag after single touch'.

For example,'Multi-all on & off after a single touch',

After the index finger is single-touched on the target button, the middle finger is held for more than a certain period of time (e.g., 0.1 seconds), the middle finger is touched additionally, and the multi-touch is touched by the index finger and the middle finger. This is not the case. To put the above example in simple terms, it refers to a case in which a single touch is first performed with the index finger, then the middle finger is additionally touched to become a multi-touch state, and then multi-all on & off.

In the example of'Multi-all drag after single touch',

After the index finger is single-touched on the target button, the middle finger is touched for a certain period of time (e.g., 0.1 seconds), and the middle finger is touched additionally. This includes when dragged. To put the above example in simple terms, it refers to a case in which a single touch is first performed with the index finger, then the middle finger is additionally touched to become a multi-touch state and then multi-all dragging.

In addition to'multi-all on & off after single touch' and'multi-all drag after single touch', various'multi-touch and post-touch operation' can be made by substituting various post-multi-touch operations after single touch.

1.6. Definition of term button recognition method

Before entering the definition of the term, when referring to the point of view of determining the target button from the viewpoint of the device, at least one touched so far, including a touch point in a single touch state, within a time when one (unit) multi-touch is recognized. In a state in which any one of the touch points is not turned off or started to be dragged, the target button may be determined (updated) whenever a new touch occurs.

1.6.1.. How to recognize the target button by the reference finger

(=How to recognize target button by reference touch point)

The method of recognizing a target button by a reference finger is a method in which one of the multi-touch fingers is recognized as a reference finger, and a touch button including a point where the reference finger is touched is recognized as a target button. (From the viewpoint of the device, in the method of recognizing the target button by the reference touch point, any one touch point among the multi-touched touch points is recognized as the reference touch point, and the touch button including the reference touch point is recognized as the target button This is how it works.)

1.6.1..1 How to recognize the target button by the reference finger according to the X-coordinate value order

(= How to recognize target button by reference touch point according to X coordinate value order)

It is a method in which a touch button including a point having a value of a specific order among X-coordinate value order among multi-touched finger touch points is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a specific order value among the order of X coordinate values is recognized as a target button.

For example, there is a method in which the touch button including the leftmost point among the points touched by the multi-touched fingers, that is, the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button.

For a more detailed example, the index finger is touched on the button 5 on the keyboard of the arrangement as shown in FIGS. 1, 3, and 4, and the middle finger is touched on the index finger, including button 3 or button 6 (or even button 9 or button #). When touched at any one of the right points of a point, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and the button is the button that contains the point the index finger recognized as the reference finger is touching. 5 is recognized as the target button.

Even when the index finger is touched on the left part inside button 5 and the middle finger is touched on the right part inside button 5, the index finger touching the leftmost point on the touch screen is recognized as the reference finger, and button 5 is the target. It is recognized as a button.

In this case, when the reference finger is recognized, only the X coordinates of the multi-touched fingers are considered, and the Y coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to multi-touch by detecting and stopping so that button 5 is recognized as a target button, buttons 5 are touched by detecting and buttons including points where the X coordinate value is greater than button 5 or button 5 by stopping. (Ex: Button 3, Button 6, Button 9, or Button#).

Since the touch button including the point of the specific order among the order of X coordinate values among the points where the multi-touched fingers are touched is recognized as the target button, unlike the above example, the reference finger is recognized in the following way, It is also possible that the touch button including the point where the base finger is touched is recognized as the target button.

For example,

1) The finger touched at the second point from the left may be set to be recognized as a reference finger,

2) The finger touched at the third point from the left may be set to be recognized as a reference finger,

3) The finger touched at the fourth point from the left may be set to be recognized as a reference finger.

1.6.1..2 Target button recognition method with reference finger according to Y coordinate value order

(= Recognition method of target button by reference touch point according to Y coordinate value order)

This is a method in which a touch button including a point having a value in a specific order among the order of Y coordinate values among points in which multi-touched fingers are touched is recognized as a target button.

That is, among the multi-touched touch points, a touch button including a point having a specific order value among the order of Y coordinate values is recognized as a target button.

This is possible because the fingers have different lengths. Since the middle finger is usually longer than the index finger, the following is assumed and given as an example. So, when two-touch with right-hand index and middle finger, when the index finger touches button 5, the stop is not touched by button 6, which is the right button of button 5, but touched by button 3, which is the top of button 6. Is holding. If the index finger is a person longer than the middle finger, the index finger is bent and the middle finger is extended to make the shape as if the middle finger is longer than the index finger, and an example described later can be applied.

For example, a touch button including a point having the first Y-coordinate value among the smallest order of Y-coordinate values among the touched points of the multi-touched fingers is recognized as a target button.

For a more detailed example, in the keyboard of the arrangement as shown in Figs. 1, 3, and 4, the index finger is touched on button 5, and the middle finger is above the point where the index finger touched button 3 (or even button 1 or button 2). When touched at any point among the points, the index finger touching the lowest point on the touch screen is recognized as the reference finger, and the button 5, which is the button containing the point where the index finger recognized as the reference finger is touching, is the target button. Is recognized as.

Even when the index finger touches the lower portion inside the button 5 and the middle finger touches the upper portion inside the button 5, the index finger touching the lowermost point on the touch screen is recognized as the reference finger, and the button 5 is the target. It is recognized as a button.

In this case, when the reference finger is recognized, only the Y coordinates of the multi-touched fingers are considered, and the X coordinates of the multi-touched fingers are not considered.

Therefore, from the user's point of view, to multi-touch by detecting and stopping so that button 5 is recognized as a target button, buttons 5 are touched by detecting and buttons including points where the Y coordinate value is greater than button 5 or button 5 by stopping. (Ex: Button 1, Button 2, or Button 3).

Since the touch button including the point of a specific order among the order of Y coordinate values among the points where the multi-touched fingers are touched is recognized as the target button, unlike the above example, the reference finger is recognized in the following way, It is also possible that the touch button including the point where the base finger is touched is recognized as the target button.

For example,

1) The finger touched at the second point from the bottom may be set to be recognized as a reference finger,

2) The finger touched at the third point from the bottom may be set to be recognized as a reference finger,

3) The finger touched at the fourth point from the bottom may be set to be recognized as a reference finger.

On the other hand, if the reference finger recognition method is applied here, a multi-teach in which both hands are used while alternating between the right and left hands is possible. This is because the same rule can be applied to both the left and right hands. In more detail, for example, the touch button including the lowest point among the points touched by the multi-touched fingers, that is, the point having the first Y coordinate value among the smallest order of Y coordinate values, is the target button. When the recognition method is applied, the index finger of the both hands touched to the lower touch point among the multi-touched touch points, whether the right hand or the left hand, becomes a standard finger when the index finger and the middle finger are alternated using the index finger and the middle finger alternately. This is because the button including the point where the index finger of both hands recognized as the reference finger is touched is recognized as the target button.

However, by using the target button recognition method by the reference finger according to the X-coordinate value order, multi-teaching in which both hands are alternately used is virtually impossible. This is because the same rules cannot be applied to both the left and right hands.

For a more specific example, the touch button including the leftmost point among the points touched by the multi-touched fingers, that is, the point having the first X coordinate value among the smallest order of the X coordinate values, is used as the target button. When the recognition method is applied, when two hands are alternately touched by two-touch with the index and middle finger of both hands, the middle finger will be recognized as the reference finger when the two-touch with the index and middle finger of the left hand, and the index and middle finger of the right hand This is because the index finger will be recognized as a reference finger when it is multi-touched with.

1.6.1..3 How to recognize the target button by the reference finger according to the X-coordinate value order according to the multi-touched number

(=How to recognize target button by reference touch point according to X coordinate value order according to the number of multi-touch)

According to the n-value in the n-touch situation, a specific order to be set in the order of the X-coordinate values in which the reference finger is recognized is determined in the'target button recognition method by the reference finger according to the X-coordinate value order.' From the standpoint of, the specific order to be set in the order of the X coordinate values recognized by the reference touch point is determined in the'Method of Recognizing the Target Button by the Reference Touch Point according to the X Coordinate Value Order' according to the n value in the n multitouch situation. It works.)

For example,

1) When multi-touch, the finger touched at the 1st point from the left is recognized as the reference finger,

2) When multi-touch, the finger touched at the second point from the left is recognized as the reference finger,

3) When the multi-touch is performed, a finger touched at the third point from the left may be set to be recognized as a reference finger.

For a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 2 is single-touched with index finger, the first character assigned to button 2 is input,

2) When button 2 is touched with the index finger and button 3, which is the right button of the button touched with the index finger, becomes a multi-touch that is touched by middle finger, the index finger, which is the finger touched at the 1st point from the left, is recognized as the reference finger, The button 2 touched by the index finger as the reference finger is recognized as the target button, so that the second character assigned to the target button Button 2 is input,

3) When button 1 is touched with index finger, button 2 which is the right button of the button touched by index finger is touched by middle finger, and button 3, which is the right button of button touched by middle finger, is 3 multi-touch that is touched by ring finger, left In the second point, the middle finger, the middle finger, is recognized as the reference finger, and the second finger, the middle finger, is touched as the target button, so that the third character assigned to the target button button 2 can be input. have.

1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number

(=How to recognize target button by reference touch point according to Y coordinate value order according to the number of multi-touch)

According to the n-value in the n-touch situation, specific procedures to be set in the order of Y-coordinate values in which the reference finger is recognized in the'target button recognition method by the reference finger according to the order of Y-coordinate values' are determined. From the standpoint of, the specific order to be set in the order of Y coordinate values recognized by the reference touch point is determined in the'target button recognition method by the reference touch point according to the Y coordinate value order' according to the n value in the n multi-touch situation. It works.)

For example,

1) When multi-touch, the finger touched at the 1st point from the bottom is recognized as the reference finger,

2) When multi-touch, the finger touched at the second point from the bottom is recognized as the reference finger, or

3) When the multi-touch is performed, a finger touched at a third point from the bottom can be set to be recognized as a reference finger.

For a more specific example, in the keyboard of FIG. 3 or 4 and the arrangement,

1) When button 5 is single-touched with index finger, the first character assigned to button 5 is input,

2) When button 5 is touched with the index finger and button 2, the upper button of the button touched by the index finger, becomes a multi-touch that is touched by the middle finger, the index finger, which is the finger touched at the first point from the bottom, is recognized as the reference finger, The button 5 touched by the index finger as the reference finger is recognized as the target button, so that the second character assigned to the target button Button 5 is input,

3) When button 8 is touched with index finger, button 5, which is the upper button of the button touched by index finger, is touched by middle finger, and button 2, which is the upper button of button touched by middle finger, is 3 multi-touch that is touched by ring finger. In the second point, the middle finger, which is the finger touched, is recognized as the reference finger, and the button 5, which is touched by the reference finger, the middle finger, is recognized as the target button, so that the third character assigned to the target button button 5 can be input. have.

1.6.2.. Target button recognition method with open fingers

(=How to recognize target button by open touch point)

The'target button recognition method using spread fingers' is a method in which a touch button including a new point determined based on points touched by multi-touch fingers is recognized as a target button. The following five methods are included in this. (From a device's point of view, the'target button recognition method by open touch points' includes a touch including a new point determined based on multi-touched touch points. This is how the button is recognized as the target button.)

1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)

A new X-coordinate determined based on the X-coordinates of the points where the multi-touched fingers are touched, and a touch button including a point composed of a new Y-coordinate determined based on the Y-coordinates of the points where the multi-touched fingers are touched. It is also possible to recognize it as a target button.(From the device's point of view, a new X coordinate determined based on the X coordinates of the multi-touched touch points, and a new determination determined based on the Y coordinates of the multi-touched touch points. A method in which a touch button including a point consisting of a Y coordinate is recognized as a target button is also possible.)

For example, a touch button including a point consisting of a new X coordinate that is the center of the X coordinates of the points where the multi-touched fingers are touched, and a new Y coordinate that is the center of the Y coordinates of the points where the multi-touched fingers are touched, It can also be recognized as a target button.

For a specific example, if the touch point of the detection is (X1, Y1) and the touch point of the middle is (X2, Y2), multi-touched by the index and middle finger, X3 (=(X1), which is an intermediate coordinate between X1 and X2. A touch button including a point (X3, Y3) consisting of +X2)/2) and Y3 (=(Y1+Y2)/2), which are intermediate coordinates of Y1 and Y2, is recognized as a target button.

For a more specific example, in the case of the keyboard of the arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used to perform two-touch,

If the index finger is touched on button 4 and the stop is touched on button 6, button 5 is recognized as a target button, and even if the index finger is touched on button 7 and stop is touched on button 3, button 5 is recognized as a target button. .

1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)

A new X-coordinate determined based on the X-coordinates of the points where the multi-touched fingers are touched, a point consisting of a Y-coordinate paired with a specific sequence of X-coordinates in the X-coordinate value size order of the points where the multi-touched fingers are touched. It is also possible to recognize a touch button including a target button as a target button.(From the viewpoint of a device, new X coordinates determined based on X coordinates of multi-touched touch points, and X coordinate values of multi-touched touch points. It is also possible to recognize a touch button including a point consisting of Y coordinates paired with X coordinates of a specific order in the size order.)

For example, a new X-coordinate that is the center of the X-coordinates of the points where the multi-touched fingers are touched, and a Y paired with the X-coordinate of the first order among the small-order of the X-coordinate values of the points where the multi-touched fingers are touched. It is also possible that a touch button including a point composed of coordinates, that is, a Y coordinate paired with the smallest X coordinate, is recognized as a target button.

For a specific example, when the touch point of the index finger is (X1, Y1) and the touch point of the index finger is (X2, Y2) by multi-touching with the index finger and the middle finger, X3 (=(X1) is an intermediate coordinate between X1 and X2. The touch button including the (X3, Y1) point consisting of +X2)/2) and Y1 is recognized as the target button. Since the value will be touched at a smaller point, the X-coordinate of the first order of the smallest order of the X-coordinate value is the X-coordinate X1 of the point where the index finger is touched, and the Y-coordinate paired with the X1 is Y1.)

For a more specific example, in the case of the keyboard of the arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used to perform two-touch,

When the index finger is touched on button 4 and the stop is touched on button 6, button 5 is recognized as a target button, and even if the index finger is touched on button 4 and stop is touched on button 3, button 5 is recognized as a target button. .

1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)

A new X-coordinate determined based on the X-coordinates of the points where the multi-touched fingers are touched, and a touch button including a point consisting of a Y-coordinate of a specific order among the Y-coordinate value size order of the points where the multi-touched fingers are touched. It is also possible to recognize it as a target button.(From the viewpoint of the device, a new X coordinate determined based on the X coordinates of the multi-touched touch points and a Y sequence value size order of the multi-touched touch points in a specific order A method in which a touch button including a point consisting of a Y coordinate is recognized as a target button is also possible.)

For example, a new X-coordinate that is the center of the X-coordinates of the points where the multi-touched fingers are touched, and a point consisting of the Y-coordinate of the first order among the small order of the Y-coordinate values of the points where the multi-touched fingers are touched It is also possible that the touch button to be recognized is a target button.

For a specific example, when the touch point of the index finger is (X1, Y1) and the touch point of the index finger is (X2, Y2) by multi-touching with the index finger and the middle finger, X3 (=(X1) is an intermediate coordinate between X1 and X2. A touch button including a point (X3, Y1) consisting of +X2)/2) and Y1 is recognized as a target button. (Usually, since the index finger is shorter than the middle finger, the index finger is lower than the middle finger, that is, Since the Y-coordinate value will be touched at a smaller point, the Y-coordinate of the first order of the small order of the Y-coordinate value is Y1, which is the Y-coordinate of the point where the index finger is touched.)

For a more specific example, in the case of the keyboard of the arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used to perform two-touch,

If the index finger is touched on button 4 and the stop is touched on button 3, button 5 is recognized as the target button, and even if the index finger is touched on button 4 and the stop is touched on button 6, button 5 is recognized as the target button. .

1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)

A new Y-coordinate determined based on the Y-coordinates of the points where the multi-touched fingers are touched, a Y-coordinate value of the points where the multi-touched fingers are touched, a point consisting of an X-coordinate paired with a Y-coordinate in a specific order of size order It is also possible to recognize a touch button including a target button as a target button. (From the viewpoint of the device, a new Y coordinate determined based on the Y coordinates of the multi-touched touch points and a Y coordinate value of the multi-touched touch points. It is also possible to recognize a touch button including a point consisting of X coordinates paired with Y coordinates of a specific order in the size order.)

For example, a new Y coordinate that becomes the center of the Y coordinates of the points where the multi-touched fingers are touched, and an X paired with the Y coordinate of the first order among the small order of the Y coordinate values of the points where the multi-touched fingers are touched. It is also possible that a touch button including a coordinate, that is, a point composed of an X coordinate paired with the smallest Y coordinate is recognized as a target button.

For a specific example, if the touch point of the index finger is (X1, Y1) and the touch point of the finger is (X2, Y2), the multi-touch is performed with the index finger and the middle finger, Y3 (=(Y1), which is an intermediate coordinate between Y1 and Y2. A touch button that includes the points (X1, Y3) consisting of +Y2)/2) and X1 is recognized as the target button (usually, regardless of whether the index finger is shorter than the middle finger, if the right hand is counterclockwise) In the state rotated 90 degrees in the direction, since the index finger will be touched at a point lower than the middle stop, that is, the Y coordinate value is smaller, the Y coordinate of the first order among the small order of Y coordinate values is the Y of the point where the index finger is touched. The coordinate is Y1, and the X coordinate paired with that Y1 is X1.)

For a more specific example, in the case of the keyboard of the arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used to perform two-touch,

With the right hand turned 90 degrees counterclockwise, if the index finger touches button 8 and the stop touches button 1, button 5 is recognized as the target button, even the index finger touches button 8 and the stop button 2 Even if touched, button 5 is recognized as a target button.

1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method)

A new Y-coordinate determined based on the Y-coordinates of the points where the multi-touched fingers are touched, and a touch button including a point consisting of an X-coordinate of a specific order among the X-coordinate value size order of the points where the multi-touched fingers are touched. It is also possible to recognize it as a target button.(From the device's point of view, the new Y coordinate determined based on the Y coordinates of the multi-touched touch points and the X coordinate value size order of the multi-touched touch points in a specific order A method in which a touch button including a point consisting of X coordinates is recognized as a target button is also possible.)

For example, a new Y-coordinate that becomes the center of the Y-coordinates of the points where the multi-touched fingers are touched, and a point consisting of the X-coordinate of the first order among the large order of the X-coordinate values of the points where the multi-touched fingers are touched It is also possible that the touch button to be recognized is a target button.

For a specific example, if the touch point of the index finger is (X1, Y1) and the touch point of the finger is (X2, Y2), the multi-touch is performed with the index finger and the middle finger, Y3 (=(Y1), which is an intermediate coordinate between Y1 and Y2. The touch button including the (X1, Y3) point consisting of +Y2)/2) and X1 is recognized as the target button. (In the normal case, the index finger is shorter than the middle finger. In the turned state, since the index finger will be touched at the right point (albeit at the bottom) than the middle finger, anyway, the X-coordinate value will be touched at the larger point, so the X-coordinate of the first order of the large X-coordinate value is the point at which the index finger is touched. X coordinate of X1.)

For a more specific example, in the case of the keyboard of the arrangement as shown in FIG. 3 or 4, when the index finger and the middle finger are used to perform two-touch,

With the right hand turned 90 degrees counterclockwise, if the index finger touches button 8 and the stop touches button 1, button 5 is recognized as the target button, even the index finger touches button 8 and the stop button 2 Even if touched, button 5 is recognized as a target button.

1.6.3.. Target button recognition method by the range including two or more touch points

As the most traditional method for a device to recognize a target button when multi-touch, it is a method of recognizing a range including two or more touch points as a target button or a target range. This method is a method in which the target range or the target button must be considerably wide. Since the button to which the character for text input is assigned is small, it is very difficult for two fingers to touch the same button. It can be said that it is actually very difficult to recognize, and since objects including pictures or pictures are large enough to accommodate two fingers, in this way, most of the target buttons can be recognized. However, if the object is too small, it can be said that it is actually very difficult to recognize the target button in this way. Since the object may be too small, the target button recognition method using the reference finger is most recommended.

Here, when the target button recognition method based on the range including two or more touch points is applied as the target button recognition method, the method for the device to recognize the hitting point can be variously set. For example, any one of the hitting point recognition methods for various target button recognition methods described in the above "1.6 Definitions of Target Button Recognition Method" can be selected and set.

1.6.4.. Mixed

It is also possible that the above-mentioned'target button recognition method by open fingers' and'target button recognition method by reference fingers' are mixed to recognize the target button. For example, when the distance between fingers to be multi-touched is greater than a certain distance and less than a predetermined distance, the distance can be mixed.

Specifically, in the keyboard of the arrangement as shown in Figure 1 or 3 or 4,

When you want to enter any character from A, B, or C from the button assigned to the touch button to which ABC is assigned,

1) A, the first character, is entered when the button is'Operated after single touch'.

2) When the multi-touch is multi-touched so that the distance between the touched fingers is less than a certain distance, when the'target button recognition method by the reference finger' is set among the various methods of recognizing the target button, it is caused by the detection and stoppage. The second character, B, is input when two touches are touched by detecting and stopping so that the button assigned with ABC is the target button so that the distance between the touch points is less than a certain distance.

3) When the multi-touch is multi-touched so that the distance between the multi-touched fingers is greater than a certain distance, when the'target button recognition method by open fingers' is set among the various methods of recognizing the target button, it is caused by the detection and stoppage. When the touch button is operated after two touches with the index and middle finger so that the button assigned with the ABC becomes the target button so that the distance between the touch points is equal to or greater than a certain distance, the third character, C, can be made.

2. Synthesis

As explained in the next section,

After the multi-touch operation is used, a general situation in the process of inputting text and transforming the shape of an object will be described.

In operation after multi-touch,

The main hand is the right hand,

Mainly used n multi-touch is 2 multi-touch where index and middle finger are used,

The method of recognizing the target button mainly used is the leftmost point among the points touched by the multi-touch fingers among the target button recognition methods by the reference finger according to the X coordinate value order among the target button recognition methods by the reference finger, that is, X This is a method in which a touch button including a point having a smallest X-coordinate value in the first order of coordinate values, that is, the X-coordinate value, is recognized as a target button.

And, the multi-touch mainly used is a multi-all touch among various multi-touch methods mentioned in the definition of terms for multi-touch. In other words, it is a touch method in which multi-touched fingers are touched simultaneously.

In addition, the pre-touch operation methods mainly used are multi-all on&off and multi-all drag methods.

In simple terms, with the index and middle finger of the right hand, there are two multi-touch, and in multi-touch, the index finger is touched on the target button, and the middle finger is touched anywhere on the right side of the index finger, so that the index finger and middle finger are turned off at the same time. This means that the index and middle finger are manipulated so that both the index finger and middle finger are dragged while the touch state of the index finger and middle finger are maintained. At this time, the index finger is recognized as the reference finger, and the middle finger is recognized as the sickle reference finger.

And, in the entire contents of the present application, including the embodiments to be described later,

Unless otherwise specified, the hand used in the multi-touch operation, the multi-touch method, the target button recognition method and the post-touch operation method may be regarded as embodiments in which the above-mentioned mainly used methods are applied.

In addition, what is described in a manner that a button is operated after multi-touch may be regarded as being operated while being multi-touched so that a button can be recognized as a target button, unless otherwise specified.

And, in the operation after a single touch, unless otherwise specified, the finger mainly used is the index finger, and the target button is touched with the index finger, and it may be regarded as an embodiment in which a method of turning off or dragging is applied later.

However, it should be borne in mind that this is an example for convenience of explanation, and the used hand, n multi-touch method, reference finger setting and target button recognition method, and operation method after touch are different from the frequently used methods and embodiments mentioned above. It should be noted that the implementation is also included in the technical spirit of the present invention.

For example, the left hand may be used, and the method of recognizing the reference finger may be a method in which the finger touched at the point where the Y coordinate value of the touched point is the smallest among the multi-touched fingers, or the target button recognition method is open. Of course, a method of recognizing a target button by fingers may be applied.

And, if the technique introduced in a specific part of the present application can be applied to other parts, it is natural that it can be applied to other parts.

In addition, the keyboard to which the method of the present application is applicable is not limited to the form described for example herein, but can be applied to various types of conventionally developed or newly developed types.

In the following embodiments, the target button recognition method by the reference finger is mainly assumed as the target button recognition method, because this method is convenient for the user. The method of recognizing the target button by the reference finger,

1) Unlike the method of recognizing the target button by the open fingers, the user does not need to open the fingers intentionally,

2) In order to use the'target button recognition method by spread fingers' when all the buttons of the 3ㅧ4 type keyboard are multi-touched to be the target button, as shown in FIG. 3, one column to the left of the first column Since this should be added and one column is added to the right of the third column, 5X4 keyboard is required as a result, whereas in the'How to recognize the target button by the reference finger', it is added to the reference finger according to the order of the X coordinate values. According to one of the embodiments of the target button recognition method by the multi-touched fingers, the leftmost point, that is, the first of the smallest order of the X coordinate value, that is, the X coordinate value has the smallest X coordinate value. When a method in which a touch button including a point is recognized as a target button is used and 2 multi-touch in which the right hand index and middle finger are used is used, as shown in FIG. 4, only one column needs to be added to the right side of the third column, resulting in Since only the 4X4 keyboard is needed, the button for entering text takes up less space on the touchpad,

3) In order to be single-touched with index finger, middle finger, ring finger, and small finger must be closed, whereas in multi-touch with index finger and middle finger, only finger ring and small finger need to be closed, so the finger may be more comfortable than a single touch.

On the other hand, the difference between the spatial positional relationship (=relative distance) at the moment of multitouch and the spatial positional relationship (=relative distance) of the fingers holding the touch must be kept below a certain threshold in the course of manipulation after multi-touch. Good is self-evident.

For example, it means that it is difficult for the fingers, which are kept in touch in the process of being operated, to be pinched or extended more than a certain reference value in comparison with a multi-touched moment.

3. Text input method on the touch screen

Hereinafter, a method of inputting characters on a touch screen will be described in detail by applying various manipulations described above.

First, in a device having a touch screen, in a method for inputting characters,

A keyboard with buttons assigned to a plurality of characters is displayed on the touch screen.

When a multi-touch is operated so that a specific button is recognized as a target button, after a multi-touch operation starts, or after a multi-touch operation, including after the operation ends,

Let's look at a method that can be a method of inputting a character in a specific sequence among characters assigned to a button recognized as a target button by multi-touch operation.

Additionally,

According to the operation after the multi-touch, a specific sequence number of input characters may be determined,

In the above, if the drag direction is different, it can be recognized that the type of operation after the multi-touch is different,

Among the at least one character group, while belonging to a specific character group, a specific character among the at least one character associated with the button recognized as the target button is input. The character groups are matched and belong to the matched character groups, and at least one character of at least one character associated with the target button may be input without changing the character mode.

Thus, a specific character group different from the character group input by the operation type before the final operation and the operation method after a single touch is matched, so that the characters of the matched character group. It can be entered without changing the text mode.

In addition, the "specific character group" may be any one of the following character groups.

1) A group of characters assigned to a specific line among characters assigned to the same button.

2) Among the characters assigned to the same button, a group of characters assigned to the second specific sequence number from the first specific sequence number to the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

3) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

If it expands further, it can be extended to 4) and 5) below.

4) Any character group among two or more different character groups classified into different series according to the spelling rule.

5) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

4 is a view showing a pad including a conventional 3X4 keyboard. In the pad illustrated in FIG. 4, buttons in the fourth column on the far right may be omitted. In the pad shown in FIG. 4, English characters are assigned as follows.

1) ABC is assigned to button 2,

2) Button 3 is assigned a DEF,

3) GHI is assigned to button 4,

4) JKL is assigned to button 5,

5) MNO is assigned to button 6,

6) PQRS is assigned to button 7,

7) Button 8 is assigned a TUV,

8) WXYZ is assigned to button 9,

9) English characters are not assigned to buttons 1, *, 0, and #.

Of the buttons provided on the telephone button pad shown in FIG. 1, four buttons (W, X, Y, and Z) are assigned to buttons 9 which are assigned the most characters.

In this embodiment, 10 to 6 lowercase letters and special characters are additionally assigned to the buttons, and if it is assumed that 10 letters are assigned to the buttons, the 1st to 5th characters are operated after'single touch. ', and the 6th to 10th characters can be input with'multi-touch operation'.

for example,

1) The first character assigned to each button can be entered by turning each button on and off with the index finger,

2) The second character assigned to each button can be entered by dragging the button upwards (= north) after each button is single touched with the index finger,

3) The 3rd character assigned to each button can be entered by dragging in the right (=east) direction after each button is single touched with the index finger,

4) The fourth character assigned to each button can be input by dragging the button downwards (=south) after each button is single touched with the index finger,

5) The fifth character assigned to each button can be entered by dragging the button to the left (= west) after each button is single touched with the index finger,

6) The sixth character assigned to each button can be input after being multi-touched by detecting and stopping so that each button is recognized as a target button, and then being'multi all on and off'.

7) The 7th character assigned to each button can be input by multi-touching it with the index finger and middle finger so that each button is recognized as the target button and then'multi-all dragging' in the upward direction (=north).

8) The 8th character assigned to each button can be input by multi-touching it with the index finger and middle finger so that each button is recognized as the target button and then'multi-all dragging' in the right (=east) direction.

9) The ninth character assigned to each button can be entered by multi-touching it with the index finger and middle finger so that each button is recognized as a target button and then'multi-all dragging' in the downward direction (=south).

10) The tenth character assigned to each button may be input as'multi-all drag' in the left (= west) direction after multi-touching with the index finger and middle finger so that each button is recognized as a target button.

If the sixth character assigned to button 5 is assumed to be a question mark "?",

a) When button 5 is touched with the index finger and any point on the right side of the index finger (that is, the X coordinate value is greater than the index finger, and the Y coordinate is an irrelevant point, for example, button 6 or button 3), touch with the middle finger , The index finger becomes the reference finger, and Button 5 is recognized as the target button.

b) In this state, if'multi all on & off' (i.e., when the detection and stop are released simultaneously (= off)), the question mark "?" is entered.

And, assuming the 7th character assigned to button 5 is a heart "♥",

a) Button 5 is touched with the index finger and touched at any point on the right side of the index finger to recognize that button 5 is the target button.

b) In this state, when multi-all dragging in the upward direction (=North) (i.e., when the index finger and middle finger are touched and dragged as they are on the touch screen), a heart "♥" is input.

On the other hand, when the 6th character is input, it is also possible to use'multi sickle all on & off' instead of'multi all on & off', and more specifically,'multi sickle all standard finger on & off' is used. It is possible.

For example, in order to input the question mark "?", the sixth character assigned to button 5, after button 5 is multi-touched to be recognized as the target button, the stop, which is the'scythe finger', is first turned off and then for a certain period of time ( Example: after 0.1 seconds), the index finger, the reference finger, is turned off.

In addition, when inputting the 7th to 10th characters, it is also possible to use'multi-sick all-drag' instead of'multi-all drag', and more specifically,'multi-snall standard finger drag' can be used.

For example, in order to input the heart "♥", the seventh character assigned to button 5, after button 5 is multi-touched to be recognized as a target button, the index finger, which is the reference finger, with the stop, which is the sickle reference finger, is turned off. It is attached to the touch screen, and the finger is dragged with the multi-snall all the way up (= north).

On the other hand, as a method of recognizing a target button, a method of recognizing a target button by spread fingers is set aside, and among the'recognition of a target button by reference fingers', a method of recognizing a target button by a reference finger according to the X-coordinate value order. The leftmost point among the points touched by the multi-touch fingers, which is one of the embodiments, that is, the first button among the smallest order of the X coordinate value, that is, the touch button including the point having the smallest X coordinate value. Even if only the method recognized by this target button is used, and only the two multi-touches using the right hand index and middle finger are used, as the operation method, even if only the following three operation methods are applied, 15 characters including special characters in one button Even if it is assigned, characters can be entered quickly and easily without changing the character mode, or characters assigned to different character modes on the same button can be easily and quickly entered without changing the character mode.

1)'Single on & off','Single drag' in 4 directions,

2)'Multi All On & Off','Multi All Drag' in 4 directions,

3) ``Finger on and off fingers based on multi-sick all'', ``Dragging fingers based on multi-sick all''

Now, in a device having a touch screen, in a method of inputting text, after a keyboard is displayed on the touch screen, when a specific button is operated after multi-touch so as to be recognized as a target button,

The final operation of one of the final operations, which can include nine behaviors including dragging in each direction: off or up, down, left, right (, top left, bottom left, top right, bottom right) After the point in time or after the point in time when the last operation starts, including after the end of the last operation,

By a post-multi-touch operation including a final operation of at least one of the last operations that can include nine behaviors including multi-drags in the off or eight directions,

Among the at least one character group, while belonging to a specific character group, when a specific character is input among at least one character associated with a button recognized as a target button,

Depending on the situation before the final operation, a specific character group is matched among at least one character group, and while belonging to the matched character group, at least one character of at least one character associated with the target button is input without changing the character mode. Let's see how it can be done.

Additionally, the "specific character group" may be any one of the following character groups.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

To expand further, it can be extended to the following cases 3), 4), and 5).

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

When the above method is applied, Japanese characters will be described as an example in which characters assigned to different character modes on the same button can be easily and quickly input without changing the character mode.

Although Japanese is a character with the same pronunciation as uppercase and lowercase letters in English, it is divided into different types of characters such as'Hiragana' and'Katagana'.

Therefore, in Hiragana text mode, without changing text mode

1)'Single On & Off' and'Single Drag' in 4 directions are used to input 5 hiragana characters,

2)'Multi All On & Off' and'Multi All Drag' in 4 directions are used to input 5 characters of katakana,

3)'Multi sickle all standard finger on & off' and 4 directions'multi sickle all standard finger drag' are used to input 5 special characters.

Naturally, even in katakana mode, hiragana characters and special characters may be input without changing the character mode.

The above embodiment will be described in more detail.

Fig. 5 shows a Japanese input keyboard of type 3'4. In the input keyboard shown in FIG. 5, five Japanese characters are assigned to each button, and only one representative character is displayed among the five characters assigned.

5 is a Japanese input keyboard in hiragana character mode.

First, to explain how hiragana is input in hiragana mode as an example,

When a button is'single touch' (in the following method 1, it is possible to turn off after a single touch), the 5 hiragana characters assigned to the single touched button as shown in the upper drawing of FIG. All pop up.

1. After the single-touched finger is turned off, a desired hiragana may be input by a method in which one of the hiragana characters popped up is touched (for example, a single touch). As a result, it is a method that requires two touches to input desired characters.

2. The single touched finger is not turned off, and the desired hiragana character can be input by single dragging in the direction in which the desired hiragana character is located. If the desired hiragana character is located at the center, the finger may be turned off without dragging, and the hiragana character at the center may be input. That is, five hiragana characters can be input by single on&off and single dragging in four directions.

Now, for example, to explain how the katakana characters are input without changing the character mode in hiragana mode,

When a button is'multi-touched' to be recognized as a target button (in the following method 1, the condition of turning off after multi-touch is also possible), as shown in the lower drawing of FIG. , All 5 katakana characters assigned to the'multi-touch' button to be recognized as the target button are popped up.

1. The desired katakana character may be input in such a way that one of the katakana characters popped up after the multi-touched finger is simultaneously turned off is touched (eg, a single touch). As a result, it is a method that requires two touches to input desired characters.

2. The multi-touched finger is not turned off, and all fingers are multi-drag in the direction in which the desired katakana character is located, so that the desired katakana character can be input. If the desired katakana character is located at the center, the multi-touched fingers are simultaneously turned off without dragging, and the centered katakana character can be input. That is, five katakana characters may be input by multi-all on&off and multi-all dragging in four directions.

In addition, the above method can be applied to a conventional qwerty plate as shown in FIG. 7. For example, if the current character mode is English lowercase mode,

1) Single on&off is used to input lowercase letters in English,

2) Even though the current text mode is English lowercase mode by using multi on & off, uppercase English letters are input without changing the text mode. That is, without changing the character mode, characters in other character modes corresponding to the current character mode can be input.

For example, if the current text mode is English lowercase mode,

When the button S is single on & off, the small letter s is input, and when the button S is multi-all on and off so that it is recognized as the target button, the capital letter S can be input even though the current text mode is the English small letter mode.

Now, in a device having a touch screen, in a method of inputting text, among a process of multi-on&off so that a specific button is recognized as a target button,

After a multi-touch time point or after a multi-touch time point, including after a multi-touch finger is turned off (=multi-touch release),

Let's look at a method that may be a method of inputting a specific sequence of characters from among the characters assigned to the button recognized as the target button.

Additionally, when multi-touch is expressed in more detail with n multi-touch, the specific sequence number may be determined according to the n value, or may be determined such that the numeric value corresponding to the sequence value of the n value and the specific sequence number is the same. have.

Particularly, as in the case of a QWERTY keyboard in a state where a smartphone is standing, the size of a button is small, and the target button is not accurately pressed, and the surrounding button is often pressed incorrectly. As a result, as shown in FIG. Compared to the buttons illustrated in FIG. 7, after the button is made larger, two or more characters are assigned to one button, and then input can be made without a typo by the following embodiment method.

1) When'Single On&Off' is used, the first character of each button is entered,

2) If'multi on & off' is used, the second character of each button recognized as the target button can be entered.

More specifically, using the button to which'QW' in FIG. 8 is assigned as an example,

1) If the button to which'QW' is assigned is'Single On & Off' after a single touch, that is, when a single on & off that starts with a single touch, for example, the button to which'QW' is assigned is touched with the index finger. When it is turned off immediately,'Q', the first character of the button to which'QW' is assigned, is entered,

2) If the button to which the'QW' is assigned is multi-touched after being multi-touched to be recognized as the target button, that is, if it is'multi-all on & off', that is, multi-all on & off starting with multi-touch, for example,'QW' When the assigned button is touched with the index finger and the middle finger is touched at any point on the right side of the index finger, both the index finger and the middle finger are turned off at the same time, so that'QW', the second character of the assigned button, is inputted.

According to this, the second character assigned to each button can also be directly input by one touch action. Even if it is a multi-touch, the wrist or elbow is a type that is used only once, so it can be called a single touch action. Nevertheless, since the buttons in FIG. 8 have a larger button size than the buttons in FIG. 7, a typo rarely occurs.

On the other hand, in the case of the Hangul keyboard as shown in FIG. 10, which is an improvement of the conventional Hangul QWERTY keyboard as shown in FIG. 9, the principle of the input method described above may be applied. You will be able to understand enough without detailed explanation.

In addition, the input method described above can be applied even when three characters are assigned to one button, as shown in FIG. 11. Specifically,

1) The first character assigned to each button is entered as single on&off after single touch,

2) The second character assigned to each button is input as multi-all on & off after 2 multi-touch so that each button is recognized as the target button.

3) The third character assigned to each button may be input as multi-all on & off after three multi-touches so that each button is recognized as a target button.

For a more specific example,

1) When a button assigned with'QWE' is single-touched and turned off after single-touching, that is, when a single on-off starting with single-touching, for example, a button assigned with'QWE' is touched with the index finger immediately When off,'Q', the first character of the button to which'QWE' is assigned, is entered,

2) If the multi-all is on and off after two multi-touch so that the button to which the'QWE' is assigned is recognized as the target button, that is, when the multi-all is on and off starting with the two multi-touch, for example,'QWE' is When the assigned button is touched with the index finger and the middle finger is touched at any point on the right side of the index finger, when both the index finger and the middle finger are turned off at the same time,'QWE' is the second character of the assigned button,'W' is input,

3) When multi-all on & off after 3 multi-touch so that the button to which'QWE' is assigned is recognized as a target button, that is, when multi-all on & off starting with 3 multi-touch, for example,'QWE' If the assigned button is touched with the index finger and the middle finger and the index finger are touched at any point on the right side of the index finger and multi-touched, then all of the index finger, middle finger and ring finger are turned off at the same time, the'QWE' is the third character of the assigned button. It can be implemented such that'E' is input.

According to this, the third character assigned to each button can be directly input by one touch action. 3 Even if it is a multi-touch, the wrist or elbow is a type used only once, so it can be said to be a single touch action. Nevertheless, since the buttons of FIG. 11 have a larger button size than those of FIGS. 7 and 8, no typo is generated.

In the method of inputting the third letter in FIG. 11, at least one button of the keyboard as shown in FIG. 8 in which two characters are assigned to each button, additionally assigned one special character including a punctuation mark. By applying to a keyboard (not shown) in the form of a button with three characters assigned to it, it is also possible to apply the special character assigned to the third button quickly and easily without changing the character mode. This seems to be much more useful than Figure 11.

On the other hand, in order to input'Z' in the keyboard layout as shown in FIG. 4, when multi-all on & off after 4 multi-touch so that the button to which'WXYZ' is assigned is recognized as a target button, that is, 4 multi-touch When multi-all on & off is started, for example, button 9 with'WXYZ' assigned to it must be touched with the index finger. When the, pause, ring finger, and possession are all off at the same time, the fourth character'Z' of button 9 may be input. In this case, the fourth character assigned to each button can be directly input by one touch action.

In addition, the above method can be applied to a conventional qwerty plate as shown in FIG. 7.

If the multi-touch is expressed in detail by n multi-touch, the specific sequence number is not determined as described above according to the n value, but according to the n value, that is, according to the situation before the final operation, among at least one character group. A specific character group is matched, and while belonging to the matched character group, at least one character of at least one character associated with the target button may be input without changing the character mode.

For example, if the current character mode is English lowercase mode,

1) Single on&off is used to input lowercase letters in English,

2) Even though the current text mode is English lowercase mode by using multi on & off, uppercase English letters are input without changing the text mode. That is, without changing the character mode, characters in other character modes corresponding to the current character mode can be input.

For example, if the current text mode is English lowercase mode,

When the button S is single on & off, the small letter s is input, and when the button S is multi-all on and off so that it is recognized as the target button, the capital letter S can be input even though the current text mode is the English small letter mode.

In addition, the "specific character group" may be any one of the following character groups.

1) Any character group among two or more different character groups classified into different series according to the spelling rule.

2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.

To expand it further, it can be extended to the following cases.

3) A group of characters assigned to a specific line among characters assigned to the same button.

4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).

5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button.

Hereinafter, a method in which predetermined characters are additionally input together with a character assigned to a target button by a touch after operation, and a method of inputting two or more characters by a single touch operation will be described.

In a device having a touch screen, in the method of inputting text,

In the case where the keyboard is displayed on the touch screen and then operated after multi-touch so that a specific button is recognized as a target button

The final operation of at least one of the final operations, which can include nine behaviors including dragging in each direction: off or up, down, left, right (, top left, bottom left, top right, bottom right) starts After the point in time or after the point in time when the last operation begins, including after the end of the last operation,

By a post-multi-touch operation including a final operation of at least one of the final operations that can include nine behaviors including multi-drags in the off or eight directions,

Belonging to a specific character group among at least one character group,

The first character, which is a specific character, of at least one character associated with (or assigned to) the target button

Regardless of the target button, the method may be a method in which a second character, which is at least one specific character promised for each final operation, is additionally input.

Additionally, according to the situation before the final operation, a specific character group among at least one character group is matched, and at least one character among at least one character belonging to the matched character group is assigned to the target button without changing the character mode. It can be additionally entered with text. In addition, when there are two or more letters assigned to the target button,

Depending on the situation before the final operation, the first character may also be selected.

First, an example of application to an English keyboard will be described. In FIG. 7, an English Qwerty keyboard is illustrated, and it can be confirmed that only one character is displayed per button.

After the touch is used on the English Qwerty keyboard shown in FIG. 7, two or more characters may be simultaneously input in one operation.

In more detail, one character including a specific vowel or a semi-vowel (or a semi-consonant) or a consonant, along with the character assigned to the target button, is additionally input, or includes the current suffix ING and the past suffix ED. More than one character can be implemented to be input in addition to the character assigned to the target button.

Hereinafter, in English character input, it is assumed that the target button is the button S, and the button S is touched (single-touch or multi-touch) to be recognized as the target button, and then drag or off in four directions (up, down, left, right). As an example in which other characters are additionally input together with S through the operation being performed, it will be described that specific characters are additionally input together with the characters assigned to the target button.

First, in the case of multi-on&off or multi-all dragging in four directions, an explanation will be given, for example, of inputting A, E, I, O, and U in addition to the characters assigned to the target button.

(When the method of this application is applied to characters other than English, it corresponds to the pronunciation of [a], [e], [i], [o], [u] in English phonetic symbols instead of A, E, I, O, U It is recommended that it be replaced with a letter.)

When the button S is multi-touched, as shown in the left figure of FIG. 13, all five'S+ vowels' are popped up, and SA, SI, SE, SU, or by multi-all on-off or multi-all dragging in 4 directions. One of the SOs can be input.

In more detail, in a state in which all five'S+vowels' are popped up by multi-touch, a desired'S+vowel' can be input by multi-all dragging in the direction in which the desired'S+vowels' are located. If the desired'S+ vowel' is located at the center, all fingers are turned off without dragging, and as a result, the multi-all on & off'S+ vowel' located at the center can be input.

At this time, instead of SE, SI, SO, and SU as shown in the right figure of FIG. 13, it is also possible to implement such that only E, I, O, and U are displayed as shown in the right figure of FIG. 13.

As a specific example, as shown in FIG. 13, after the button S is multi-touched by detecting and stopping so that the button S is recognized as the target button,

1) When'Multi All On & Off', A is additionally input along with S assigned to the target button, that is, SA is input,

2) When'multi-all dragging' upward, I is additionally input with S assigned to the target button, that is, SI is input,

3) When'multi-all dragging' to the right, E is additionally input along with S assigned to the target button, that is, SE is input,

4) When'multi-all dragging' to the lower side, U is additionally input along with S assigned to the target button, that is, SU is input,

5) When'multi-all dragging' to the left, it is possible to additionally input O along with S assigned to the target button, that is, input SO.

On the other hand, two touches may be inputted in a required manner. In a method not recommended, when the button S is multi-touched, all five'S+ vowels' pop up as shown in the left drawing of FIG. 13, First, all the fingers are turned off, and in the state, a desired'S+ vowel' is selected as a touch (eg, a single touch), so that one of SA, SI, SE, SU, or SO can be input. At this time, it is also possible to implement such that only E, I, O, and U are displayed as shown in the right figure of FIG. 13 instead of SE, SI, SO, and SU as shown in the right figure of FIG. 13.

Of course, a method of notifying what character is additionally input according to the on&off and drag directions is possible other than the pop-up method shown in FIG. 13, and the user is not informed what additional input character is. You can only rely on memorization.

In the method in which specific characters are additionally input together with the characters assigned to the target button in the present application including the above-described embodiments, the viewpoint that the additional input characters are not assigned to the target button is mainly described, and the target button is described. It can also be described from the point of view of being assigned. However, this is only a matter of perspective, and has nothing to do with understanding the principles of the present application. For example, A, E, I, O, and U, which are additionally input together with the S assigned to the target button Button S in the above, include those considered to be the 2-6th characters assigned to the button S. It can be said that one of the 2nd to 6th characters is additionally input together with the 1st character assigned to each button by the operation after one touch. The same applies to embodiments described below, in which specific characters are additionally input together with characters assigned to the target button.

On the other hand, the method used in almost all QWERTY keyboards, which is a method of inputting only the characters assigned to the target button by single ON&OFF, is not recommended because it is not applied.

In the case of single on&off or single dragging in four directions, an explanation will be given, for example, of inputting A, E, I, O, and U in addition to the characters assigned to the target button.

When all five'S+ vowels' are popped up by a single touch, the desired'S+ vowels' may be input by dragging in the direction in which the desired'S+vowels' are located. If the desired'S+collection' is located at the center, the finger is turned off without dragging and the'S+collection' located at the center can be input.

For a specific example, after the button S is single-touched with the index finger (to be recognized as a target button),

1) When single ON&OFF, A is additionally input along with S assigned to the target button, that is, SA is input, that is, SA is input,

2) When'single dragging' upward, I is additionally input with S assigned to the target button, that is, SI is input,

3) When'single dragging' to the right, E is additionally input along with S assigned to the target button, that is, SE is input,

4) When'single dragging' to the lower side, U is additionally input along with S assigned to the target button, that is, SU is input,

5) When'single dragging' to the left, it is possible to additionally input O along with S assigned to the target button, that is, SO.

On the other hand, it is not recommended because it is a method that can confuse the user because the number of multi-touched fingers in the on&off method and the drag method do not match, but it is not recommended. As an embodiment to which multi-on&off is applied,

1) With all four'S+collections' popped up by a single touch, the desired'S+collections' are input by dragging in the direction in which the desired'S+collections' are located,

2) If the desired'S+ vowel' is located at the center, it can be input as multi all on & off.

To give a specific example,

1) When multi-all on & off after 2 multi-touches by detecting and stopping so that button S is recognized as the target button, A is additionally input along with S assigned to the target button, that is, SA is input,

2) After the button S is single-touched with the index finger and'single-drag' upward, I is additionally input with S assigned to the target button, that is, SI is input,

3) After the button S is single-touched with the index finger and'single-drag' to the right, E is additionally input together with the S assigned to the target button, that is, SE is input,

4) After the button S is single-touched with the index finger and is'single dragged' to the lower side, U is additionally input together with the S assigned to the target button, that is, SU is input,

5) After the button S is single-touched with the index finger and is'single-drag' to the left, it is possible to additionally input O with the S assigned to the target button, that is, SO.

For reference, I will introduce three methods to make it easy to memorize the allocation positions for A, E, I, O, and U that are additionally input with S. Other methods are possible.

As a first method, the method referred to in FIG. 14 will be described.

This method is the most recommended memorization method and is also a method applied to the above-described embodiments.

1) A is the most used vowel, so it is assigned to the center,

2) Since I is a vertically standing shape, it is assigned to the top,

3) E is assigned to the right because the right side of the letter is open,

4) Since U is the first spelling of the word Under, U is assigned to the bottom (or, since I with one vertical line is at the top, U with 2 vertical lines is assigned to the bottom),

5) Since O is the shape of a human mouth, it can be assigned to the left side.

However, since this is only an example, the positions of A, E, I, O, and U that are additionally input together with S may be assigned differently from the above. The same applies to the following method.

For example, O is likely to be in the middle, so it is possible to be assigned to the bottom and U to the left.

In the second method, in another example, in the order of pronunciation in the order of pronunciation, in the order of A, E, I, O, U 1) Once A is assigned to the center, 2) clockwise from the top, E to the top, right To I, O to the bottom and U to the left can be assigned.

As a third method, which is not recommended,

1) Since O is likely to be in the middle, it is assigned to the center,

2) I is assigned to the upper side for the same reason as the first method,

3) E is assigned to the right for the same reason as the first method,

4) U is assigned to the bottom for the same reason as the first method,

5) The remaining A can be assigned to the left.

As a fourth method, which is not recommended,

1) Since O is likely to be in the middle, it is assigned to the center,

2) I is assigned to the upper side for the same reason as the first method,

3) E is assigned to the right for the same reason as the first method,

4) A with a shape like a pedestal or pointed tower that can balance the right and left is assigned to the bottom,

5) The remaining U can be assigned to the left.

Hereinafter, processes for inputting, for example, real words will be described in detail.

15 is a diagram provided to explain the process of inputting the English word "SAME". The input of the English word "SAME" is possible by sequentially entering "SA" and "ME".

For example,

1) If the button S is multi-touched by detecting and stopping to be recognized as the target button and then'multi-all on and off', A is additionally input along with the S assigned to the target button, that is, SA is input,

2) If the button M is multi-touched by detecting and stopping to be recognized as the target button and then'multi-all dragged' to the right, E along with the M assigned to the target button may be additionally input, that is, ME may be input.

16 is a diagram provided to explain the process of inputting the English word "BEAUTIFUL". The input of the English word "BEAUTIFUL" is possible by sequentially entering "BE", "AU", "TI", "FU", and "L".

For example,

1) If the button B is multi-touched by detecting and stopping to be recognized as the target button and then'multi-all dragged' to the right, E is additionally input along with B assigned to the target button, that is, BE is input,

2) If the button A is multi-touched by detecting and stopping so that it is recognized as the target button and then'multi-all dragged' to the lower side, U is additionally inputted with A assigned to the target button, that is, AU is input,

3) If the button T is multi-touched by detecting and stopping to be recognized as the target button and then'multi-all dragged' upward, I is additionally input with the T assigned to the target button, that is, TI is input,

4) If the button F is multi-touched by detecting and stopping to be recognized as the target button and then'multi-all dragged' to the lower side, U is additionally input along with the F assigned to the target button, that is, FU is input,

5) Button L is single on & off, so L can be input.

15 and 16, according to the character input method according to the present embodiment that allows representative vowels A, E, I, O, and U to be input simultaneously with characters assigned to the target button, the input speed is You can guess that it can be significantly faster.

In addition, in the above, A, E, I, O, and U have been described as being additionally input together with characters assigned to the target button, but this is only an example for convenience of description, and thus may be implemented differently. .

That is, in addition to vowels, characters other than A, E, I, O, and U, including semi-vowels, semi-consonants, and consonants, can be implemented to be additionally input together with the characters assigned to the target button.

If there are fewer buttons than all the alphanumeric numbers used, such as a 3X4 type, 4X4 type, or 5X4 type keyboard, the frequently used alphabets are displayed on the touch buttons. It can also be entered together.

On the other hand, after multi-touch operation, a vowel is additionally input together with the character assigned to the target button by operation, and it is possible to realize that a consonant is used together with the character assigned to the target button by operation after single touch. It is preferable that other consonants input together by operation after a single touch are composed of consonants with high frequency.

T, S, N, R, H, D, L, and C are the most frequently used consonants in the order of frequency.

And, for example, as in the above-described embodiment

In the case of'Multi All On & Off' and'Multi All Drag', A, E, I, O, and U are input together with the characters assigned to the target button.

In the case of'single drag', T, S, N, and R are input together with the characters assigned to the target button.

In the case of multi-all dragging after a single touch, H, D, L, and C are input along with the characters assigned to the target button.

When the multi-sick all standard finger is dragged, W and Y are input together with the character assigned to the target button.

Multi Sick All Scythe Standard When a finger is dragged, it is possible to input? (Question mark),. (Dot),, (comma), and! (Exclamation mark) along with the character assigned to the target button without changing the device settings. .

That is, it is possible to change the operation method after the touch and change the input character group together with the character assigned to the target button without changing the device settings.

In other words, it can be said that a specific character group that is additionally input according to the situation before the final operation is matched without changing the character mode.

That is, according to the situation before the final operation, a specific character group is matched among at least one character group, so that the characters of the matched character group. It can be said to be an input method without changing the text mode.

First, in the case of'single drag', T, S, N, and R will be additionally input in addition to the characters assigned to the target button.

For example, as shown in Figure 17, after the button S is'single touch' with the index finger,

1) When the index finger is'single dragged' to the left, T is additionally input along with S assigned to the target button, that is, ST is input,

2) When the index finger is'single dragged' to the lower side, S is additionally input along with S assigned to the target button, that is, SS is input,

3) When the index finger is'single dragged' upward, N is additionally input along with S assigned to the target button, that is, SN is input,

4) When the index finger is'single dragged' to the right, R may be additionally input together with S assigned to the target button, that is, SR may be input.

When the content shown in FIG. 18 is reminiscent, it is easy to memorize how the characters additionally input together with the characters assigned to the target button change according to the drag direction.

Now, in the case of multi-all dragging after a single touch, a description will be given of an example in which H, D, L, and C are additionally input in addition to the characters assigned to the target button.

For example, as shown in FIG. 19, after the button S is'single-touched' with the index finger to be the target button, the index finger is maintained in a state where the touch state of the index finger is maintained for a predetermined time (eg, 0.1 seconds) or more. After touching the middle of the touched part anywhere with the middle finger, the button S is multi-touched so that it is recognized as the target button.

1) When the index and middle finger are multi-all dragged upwards, H is additionally input together with S assigned to the target button, that is, SH is input,

2) When the index and middle finger are multi-all dragged to the right, D is additionally input along with S assigned to the target button, that is, SD is input,

3) If the index and middle finger are multi-all dragged to the lower side, L is additionally input together with S assigned to the target button, that is, SL is input,

4) If the index and middle finger are multi-all dragged to the left, C may be additionally input together with S assigned to the target button, that is, SC may be input.

When the content shown in FIG. 20 is reminiscent, it is easy to memorize how the characters additionally input together with the characters assigned to the target button change according to the drag direction.

Now, when a finger is dragged based on a multi-snall, a description will be given, for example, of inputting W and Y together with the character assigned to the target button.

For example, when it is multi-touched with the index finger and the middle finger of the right hand, the index finger is recognized as the reference finger, and the middle finger is assumed to be the reference finger,

As shown in Fig. 22, after the button S is multi-touched with the index finger and the middle finger to be recognized as the target button, only the middle finger, which is the sickle reference finger, is turned off, and the touch state of the index finger is maintained,

1) When the index finger is dragged to the right, Y is additionally input together with S assigned to the target button, that is, SY is input,

2) When the index finger is dragged to the left, W may be additionally inputted with S assigned to the target button, that is, SW may be inputted.

When the contents shown in FIG. 23 are reminiscent, it is easy to memorize how the characters additionally input together with the characters assigned to the target button change according to the drag direction.

Now, when a finger is dragged based on a multi-sick all-sick, the frequently assigned special characters "? (question mark),. (Dot),, (comma), and! (Exclamation point)" are entered along with the character assigned to the target button. I will explain with an example.

For example, when it is multi-touched with the index finger and the middle finger of the right hand, the index finger is recognized as the reference finger, and the middle finger is assumed to be the reference finger,

As shown in Fig. 21, after the multi-touch with the index finger and the middle finger so that the button S is recognized as the target button, only the index finger, which is the reference finger, is turned off, and the touch state of the stop, which is the sickle reference finger, is maintained,

1) When the middle finger is dragged to the upper side,? (Question mark) is additionally input along with S assigned to the target button, that is, S? is input,

2) When the middle finger is dragged to the right, .(dot) is additionally inputted with S assigned to the target button, that is, S. is input,

3) When the middle finger is dragged to the left, an additional (, comma) is entered along with S assigned to the target button, that is, S, is entered,

4) When the index finger is dragged to the lower side, an! (Exclamation point) may be additionally input along with S assigned to the target button, that is, S! may be input.

On the other hand, after multi-touch operation including'drag after single touch' or'drag after multi touch' is used, the number of characters that are additionally input together with the character assigned to the target button in the'target button' is not 1 It is also possible to implement more than one dog.

For example, depending on whether the touch before dragging is single or multi, it is possible to be implemented such that the number of characters additionally input together with the characters assigned to the target button is determined.

For a more specific example, in the case of'drag after single touch', the number of characters additionally input together with the character assigned to the target button is 1, and in the case of'drag after multi-touch', the character assigned to the target button The number of additional input characters together is two or more, and each can be implemented.

On the other hand, if a short drag is made after touch, the number of characters entered with the character assigned to the target button is 1, and if touched and long dragged, the number of characters input with the character assigned to the target button is 2 when touched and dragged long. It is also possible to implement each.

For example, after the button S is multi-touched with the index and middle finger to be recognized as the target button,

1-1) When multi-all dragging shortly to the upper side,'I' is additionally input with S assigned to the target button, that is, SI is input,

1-2) When multi-all dragging upwards,'II' (or'ING') is additionally input with S assigned to the target button, that is, SII (or SING) is input,

2-1) If the multi-all drag is short to the right,'E' is additionally input with S assigned to the target button, that is, SE is input,

2-2) When multi-all dragging to the right,'EE' or'ED' (past suffix) is additionally input together with S assigned to the target button, that is, SEE (or SED) is input,

3-1) If the multi-all drag is short to the left,'O' is additionally input with S assigned to the target button, that is, SO is input,

3-2) When multi-all dragging to the left,'OO' (or'ON') is additionally input along with S assigned to the target button, that is, SOO (or SON) is input,

4-1) When a short multi-all drag to the lower side,'U' is additionally input with S assigned to the target button, that is, SU is input,

4-2) When multi-all dragging to the lower side,'UU' (or'US') may be additionally input along with S assigned to the target button, that is, SUU (or SUS) may be input.

On the other hand, it may be dragged two or more times in a short time in the same direction continuously, or the drag direction may be changed, so that each time the characters are dragged, additional characters may be continuously input.

For example, in a case in which a character additionally input along with a character assigned to a target button according to a drag direction is the same as in FIG. 13, as illustrated in FIG. 24,

1) After multi-touch by detecting and stopping so that button S is recognized as a target button, when the detecting and stopping are multi-all dragged to the right,'SE' is input as shown in [1] of FIG. 24,

2) Even after'SE' is input, if the index and stop are not turned off and multi-drag once more to the right,'E' is additionally input, resulting in'SEE' as shown in [3] of FIG. And

3) After the'SE' is input, if the index and stop are not turned off and multi-drag to the left,'O' is additionally input, resulting in'SEO' as shown in [4] of FIG. 24,

4) After'SE' is input, if the index and middle are not turned off and multi-all dragged to the lower side and then multi-all dragged to the left,'U' and'O' are additionally input, and [2] of FIG. Likewise, it can be implemented to input'SEUO'.

Meanwhile, as in a keyboard including a 3X4 keyboard arrangement as shown in FIG. 3 or 4, when multiple characters are assigned to the same button, other characters (eg, A, E, I) with characters assigned to the target button , O, U) is additionally input,

Depending on the operation method, it is also possible to determine what character is assigned to the target button input with other characters (eg, A, E, I, O, U).

For example, in the case of a button in which'J, K, L'is assigned to button 5 of FIG. 4,

Button 5 with'J, K, L'assigned can be recognized as the target button.

1) With single on&off and single drag in 4 directions, A, E, I, O, and U can be additionally input with J assigned first to the target button in a similar principle to the above embodiments.

2) With multi-all on & off and multi-all dragging in 4 directions, A, E, I, O, and U can be additionally input along with K assigned to the target button in a similar manner to the above embodiments. and,

3) Multi-sick all-sequence Finger on & off and multi-screw all standard four-screw finger drag, A, E, I, O, U with L assigned to the target button in the same way as in the above embodiments. You can also have additional input.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, so that the characters of the matched character group. It can be said to be an input method without changing the text mode.

On the other hand, it is also possible to implement a button that induces a combination with other buttons, such as a shift button, a control button, and an alt button, to exert the effect of being combined with such buttons without being used.

For example, after 2 multi-touches by detecting and stopping so that button S is recognized as a target button,

1) When the index and middle finger is'multi-all dragged' upward,'Control+S' is input, that is, the effect of pressing the button S while pressing the control button is exerted.

2) When the index finger and middle finger are'multi-all dragged' to the right,'ALT+S' is input, that is, the effect of pressing the button S while pressing the ALT button is exerted,

3) When the detection and middle finger are'multi-all dragged' to the lower side,'shift+S' is input, that is, the effect of pressing button S while pressing the shift button can be exhibited.

In Korean, it can be implemented such that it is operated after single-touch or multi-touch so that it is recognized as any target button, and additional characters (eg vowels) are input along with the characters (eg consonants) assigned to the target button.

For example, in a keyboard in which one letter is assigned to each button in each of the same character modes including the conventional Korean QWERTY keyboard as shown in FIG. 9, after a single touch with the index finger to recognize the button'ㅈ' as a target button,

1) When single dragging upwards,'ㅗ' is additionally input with'ㅈ' assigned to the target button, resulting in'Joe',

2) When single dragging to the right,'ㅏ' is additionally input along with'ㅈ' assigned to the target button, resulting in'Rule',

3) When single dragging to the lower side,'ㅜ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'week' is input,

4) When single dragging to the left,'ㅓ' is additionally input with'ㅈ' assigned to the target button so that'low' can be inputted as a result.

And, for example, in the conventional Hangul QWERTY keyboard as shown in FIG. 9, after the button'ㅈ' is recognized as a target button and is multi-touched by detecting and stopping 2,

5) When multi-all dragging to the upper side,'ㅛ' is additionally input with'ㅈ' assigned to the target button, resulting in'Joe',

6) When multi-all dragging to the right,'ㅑ' is additionally input with'ㅈ' assigned to the target button, resulting in'ja',

7) When multi-all dragging to the lower side,'ㅠ' is additionally input with'ㅈ' assigned to the target button, resulting in'ju',

8) When multi-all dragging to the left,'ㅕ' is additionally input along with'ㅈ' assigned to the target button, and as a result,'low' can be input.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, so that the characters of the matched character group. It can be said to be an input method without changing the text mode.

On the other hand, even when a number of characters are assigned to the same button, as in the conventional Korean 3X4 keyboard, as shown in FIG. 'ㅗ,ㅏ,ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ' can be additionally input with each consonant assigned to.

That is, when multiple characters are assigned to the same button, other characters (eg,'ㅗ,ㅏ,ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ') are added together with the characters assigned to the target button. In input,

Depending on the number of fingers and the operation method when touching, it is determined what character is assigned to the target button inputted with other characters (eg,'ㅗ,ㅏ,ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ') You may.

For example, in the case of a keyboard to which the Korean input method, which is heaven and earth, as shown in FIG. 12 is applied, only'ㅈ, ㅊ'is displayed on button 9, but even'ㅉ', which is not indicated, is assigned'ㅈ, ㅊ, ㅉ' It is done. In the case of a button in which'ㅈ, ㅊ, ㅉ'is assigned together, so that a button in which'ㅈ, ㅊ, ㅉ'is assigned together can be recognized as a target button.

1) As a single drag in 4 directions and a multi-old rag in 4 directions, 8 vowels'ㅗ,ㅈ,ㅜ,ㅜ,ㅛ,ㅑ,ㅠ,ㅕ' are added together with'ㅈ' as in the above embodiment. To be

2) After dragging the finger on the multi-snall in the 4-way and dragging the finger on the multi-snall after the 4-touch single touch, '8' along with '8','ㅏ,ㅏ,ㅜ,ㅓ,ㅛ,ㅑ,ㅠ,ㅕ' Additional vowels are entered,

2) Finger drag by multi-sick all-screw in 4 directions and finger touch by multi-sick all-sick after 4-touch single touch, and'ㅗ,ㅏ,ㅜ,ㅜ,ㅛ,ㅑ,ㅠ,ㅕ' 8 vowels may be input additionally.

Here, according to the situation before the final operation, a specific character group is matched among at least one character group, so that the characters of the matched character group. It can be said to be an input method without changing the text mode.

In addition, another manipulation method including a manipulation in which a Korean vowel other than the above 8 vowels out of 21 is long-draged is used, so that the consonant assigned to the target button and another vowel can be inputted together.

For example, when'long dragging', when'short dragging', a vowel vowel in which'ㅣ' is added is added to an additional input vowel. Specifically,

1) When single dragging to the right is short,'ㅏ' is input, and if single dragging to the right is long,'ㅐ' is additionally input along with the consonant assigned to the target button.

2) '싱글' is briefly dragged left to the left,'ㅔ' is singled dragged to the left, and additionally input with the consonant assigned to the target button.

3)'ㅗ' is briefly dragged to the upper side and'ㅚ' is singled to the upper side, and additionally input with the consonant assigned to the target button.

4)'TT' for single dragging to the lower side,'ㅟ' for single dragging to the lower side, and additional input with the consonant assigned to the target button.

5)'ㅑ' when multi-all dragging to the right shortly,'ㅒ' when multi-all dragging to the right long, additional input with the consonant assigned to the target button,

6) When the multi-all is dragged shortly to the left,'ㅕ' can be input, and when the multi-all is dragged long to the left,'ㅖ' can be additionally input together with the consonant assigned to the target button.

In addition, in the previous English input example, a method in which two or more characters are continuously dragged two or more times in the same direction, or the dragging direction is changed, so that characters are additionally continuously input each time it is dragged may also be applied to Hangul.

For example, after the consonant button is recognized as the target button, it is possible that two manipulations are combined so that two vowels are input together.

For a more specific example, if the button'ㅈ' is single touched with the index finger to be recognized as the target button, or after two multi touches with the index and middle stop (in the case of single dragging in the following, it is considered as single touched, and multi dragged) You can consider it as multi-touch.),

1) After'single drag' to the upper side and'ㅗ' is selected, the finger is not turned off and continues on the spot,'single drag' to the right and'ㅏ' is selected. Additional input, resulting in'left' input,

2) After'single drag' is selected to the lower side and'TT' is selected, the finger is not turned off and continues on the spot, so'single drag' to the left and'ㅓ' is selected. Additional input, resulting in'Give',

3) After'single drag' to the upper side and'ㅗ' is selected, the finger is not turned off and continues on the spot,'single drag' to the right and'ㅐ' is selected, and the vowel'ㅙ' together with'ㅈ' Is input additionally, and'좨' is inputted as a result,

4) After'single drag' is selected to the lower side and'TT' is selected, the finger is not turned off and continues on the spot,'single drag' to the left and'ㅔ' is selected. May be additionally input, resulting in'줴' being input.

The Korean vowels are 10 basic vowels (ㅏ ㅑ ㅓ ㅕ ㅗ ㅛ ㅜ ㅠ ㅡ ㅣ) and 11 vowels (ㅐ ㅒ ㅔ ㅖ ㅚ ㅟ ㅝ ㅝ ㅢ ㅙ ㅞ), a total of 21.

In the previous embodiments, among the total of 21 vowels, the rest of the vowels except'ㅡ','ㅣ', and '알아보' were examined to be input together with the consonant assigned to the target button.

In case'ㅡ','ㅣ' and'ㅢ' are input, separate buttons for'ㅡ' and'ㅣ' are prepared separately, and the combination of'ㅡ','ㅣ' and ('ㅡ','ㅣ' Phosphorus) It is also possible to input'ㅢ', but it is also possible to assign a separate operation method for inputting'ㅡ','ㅣ','ㅢ'.

For example, in the example of Hangul input so far, only the drag is used, and the on&off is not used.

For example, after the multi-touch is performed by detecting and stopping so that the consonant button'ㅈ' is recognized as the target button,

1) In the case of'Multi All On & Off', the vowel'ㅡ' is additionally input together with'ㅈ' assigned to the target button, and as a result,'Z' is input,

2) In the case of'Multi-sick All Standard Finger On & Off', the vowel'ㅣ' is additionally input together with'ㅈ' assigned to the target button, resulting in'ji'

3) In the case of'on/off finger based on multi sickle all sickle', the vowel'ㅢ' is additionally input together with'ㅈ' assigned to the target button, and as a result,'??' can be inputted.

The character input method described so far is applicable to other types of languages than those mentioned. For example, it is applicable to Greek/Roman, Cyrillic, Arabic, Southeast Asian, Indian characters, Thai character modes, Vietnamese character modes, and English, French, German, Spanish, etc.

In the above embodiments, in the drag direction, only four directions of up, down, left, and right have been described. In the case of subdividing the direction, more work is possible. For example, when adding a drag in the lower right (southeast), lower left (southwest), upper right (northeast), upper left (northwest) direction, more characters are assigned to a single button, and various operations may be performed.

As well as,

Depending on the length of the drag, drag is shortly divided into long drags,

Depending on the drag direction, the drag is subdivided into a straight drag, a return to place drag, and a shape drag.

If you use a variety of manipulation methods, including finger-on/off based on multi-sick all-sick and finger drag on multi-sick all-snow, more work is possible.

4. How to manipulate objects

So far, it has been described that a character is input by a touch operation. Hereinafter, a method used in a text input method is used, and a method of operating an object such as a picture, a picture, a browser, and a window will be described in detail.

In the embodiment here, among various manipulation methods after multi-touch, a target button recognition method using a reference finger is used, but a finger located at the leftmost (= 1st from left) of the multi-touch fingers is a'reference finger'. I will use the method determined by. More specifically, it is assumed that the multi-touch is performed using the index finger and the middle finger, and a method in which the index finger is recognized as a'reference finger' is assumed.

According to the method to be described later, it is difficult to predict the exact position of the active area boundary of the object when the object is activated, such as a star, rather than the case where the active area boundary line is formed in the same range as the shape such as a square or an object Even if the finger is too small to multi-touch only inside the object area, after the object (or the object's active area) is multi-touched to be the target button, the object shape can be transformed, including zooming, without the need to activate the object. Do.

Conventionally, after the thumb and index finger are multi-touched on the object, there is a method in which the object becomes smaller when the thumb and index finger move in the direction in which the thumb and index finger retract, and the object becomes larger when the thumb and index finger move in the direction where the thumb and index finger open. This method is a method commonly used in smartphones including Apple's iPhone, but has the disadvantage that the size of the object is enlarged or reduced only while the ratio of the object's width to height is maintained.

If you want to change only the length of the object or the length of the object without maintaining the ratio between the object's width and height, it is necessary to activate the object as a preparation step for transforming the shape of the object by clicking with the mouse. .

However, according to the present application, after the object (or the active area of the object) is multi-touched to be the target button, the shape of the object may be deformed by'manipulating after multi-touch', so there is no need to activate the object, the touch screen In multi-touch, the shape of the object can be changed.

The phrase "active area of the object" is used herein.

Although the method of the present application does not require a process for the object to be activated, such a phrase is used. As used herein, the phrase “active area of an object” does not mean an area within the boundary of an active area of an object in an active state of an object, but reminiscent of a method in which the shape of an object is deformed after the object is activated as in the related art. It means the area within the boundary of the active area when the object is activated, that is, the area within the active area boundary of the object when the object is assumed to be activated.

And, the term "object area" refers to the area occupied by the object. The size of the object area will be less than or equal to the size of the active area of the object, unless there is variation. Referring to FIG. 39, it can be said that the object area exists in the active area of the object.

And, in many cases, the object area may be abbreviated as an object.

So, even if the point outside the object area and still inside the object's active area is multi-touched, in order to change the shape of the object without the need to activate the object, even if the object is not activated, the expected object's activation area The object is set to be activated even when it is multi-touched to be recognized as a target button, so that the object is recognized by the device as being multi-touched so that the object is deformed by the user, and the shape of the object must be deformed by subsequent manipulation. . When the object area is multi-touched to be recognized as a target button, of course, the shape of the object must be recognized by the device as being multi-touched by the user to be deformed, and the shape of the object must be changed by a subsequent operation.

The multi-touch signal required for implementing the method of the present application is different from the conventional method, and thus may be used in parallel with the conventional method. And, because the size of the object is too small, it is not possible to actually multi-touch the object, so an object that cannot be enlarged or reduced by the conventional multi-touch zooming method cannot actually be multi-touched. , The object can be multi-touched so that it can be recognized as a target button so that the object can be enlarged or reduced. And, because the size of the object is too small, by the conventional method of expanding the object after being activated by the mouse, it cannot be directly enlarged in the diagonal direction, but only after it is enlarged in the horizontal or vertical direction. Objects that could have been made can be enlarged in a diagonal direction immediately by the method of the present application.

Some concepts of the direction mentioned below will be described. (Here, the concept description of the direction is the same as in the section "3. Text input method on the touch screen" and the field to which the present application is applied, or modified or partially It can be selected and applied.)

When referring to the vertical direction including the upper side and the lower side which are words used in the following description, even if the user tries to drag in the perfect vertical direction including the perfect upper side and the perfect lower side, there is no user capable of dragging the same. From the perspective of the device, when recognizing the user's intended dragging direction, the trajectory actually dragged by the user is close to a straight line within a set predetermined curvature range, and is perfectly parallel to, or perfectly parallel to, a vertical line (= straight line parallel to the Y axis). If not, but if it is parallel within the set range, it is judged by the device that the user tried to drag in the perfect vertical direction including the perfect upper side and the perfect lower side, and the drag performed by the user is determined to be the perfect vertical direction including the perfect upper side and the perfect lower side. It means the vertical direction including the upper side and the lower side judged when it becomes possible.

When referring to the horizontal direction including the left and right words used in the following description, even if the user tries to drag in the perfect horizontal direction including the perfect left and perfect right, there is no user capable of dragging the same. From the perspective of the device, when recognizing the user's intended drag direction, the trajectory actually dragged by the user is close to a straight line within a predetermined curvature range, and is not perfectly parallel to, or not completely parallel to, the horizontal line (= straight line parallel to the X axis). However, if it is parallel within the set predetermined range, it is judged by the device that the user tried to drag in the perfect horizontal direction including the perfect left and perfect right, and the drag performed by the user is judged to be the perfect vertical direction including the perfect top and bottom. Refers to the vertical direction including the upper and lower sides judged at the time.

When referring to the diagonal directions including the upper left, lower left, upper right, and lower right words used in the following description, when the device recognizes the drag direction intended by the user, the determined direction is the upper side and the lower side. It means the direction, not the left and right. So, the diagonal direction does not mean only one exact one direction, such as upper, lower, left, and right, but a range that is a collection of directions that are not upper, lower, left, and right. For example, even if it is only the upper right side, the direction of the upper right side of the various angles within 0 to 90 degrees is 10 degrees, 30 degrees, 45 degrees, 60 degrees, 80 degrees with the X axis. Is judged. So, there can be no perfect upper left, perfect lower left, perfect upper right, and perfect lower right.

However, depending on the setting, the diagonal direction can be set to mean only one exact one direction, such as upper, lower, left, and right. For example, the right-side direction determined by the device may be set to mean that the angle with the X-axis is 45 degrees only. That is, even if the direction dragged by the user is any right-side direction among the right-side directions in a predetermined range, the device may be set to determine the angle with the X-axis as the right-side direction at 45 degrees. In this case, there may be a perfect upper left, a perfect lower left, a perfect upper right, and a perfect lower right. However, from the user's point of view, even if the user tries to drag in a perfect diagonal direction including the perfect upper left, perfect lower left, perfect upper right, and perfect lower right, there is no user capable of dragging, so from the viewpoint of the device, the user intends When recognizing the dragging direction, the trajectory actually dragged by the user is close to a straight line within a predetermined curvature range, and the angle with the horizontal line (= straight line parallel to the X axis) is a perfectly 45 degree angular direction, or a perfectly 45 degree angular direction If not, it is determined by the device that the user attempted to drag in the direction of the perfect line, including the perfect upper left, perfect lower left, perfect upper right, and perfect lower right, if the angle is 45 degrees within the set range. Refers to the diagonal direction including the determined upper left, lower left, upper right, and lower right sides when the determined drag is judged to be the perfect diagonal direction including the perfect upper left, perfect lower left, perfect upper right and perfect lower right.

The upper, lower, right, left, upper left, lower left, upper right, and lower right ranges in the above may be considerably small or quite large depending on the currently determined number of determined directions.

In the description of the "1)" method described later, a method in which only the upper and lower directions are divided and judged is exemplified. In this embodiment, there is no need to cover the left and right as well as the upper left and right upper sides. As shown in the drawing (c) of FIG. 46, a predetermined range determined to be the upper side may be set to 180 degrees to the upper side based on the hitting point, and a predetermined range determined to the lower side may be set to a 180 degree range to the lower side based on the hitting point. .

Among the descriptions of the "2)" and "3)" methods described below, a method of determining the upper, lower, left, right, upper left, lower left, upper right, and lower right sides is exemplified. In the case, when the diagonal direction does not mean only one exact one direction, such as upper, lower, left, and right, but is set to mean a range that is an aggregate of directions other than upper, lower, left, and right, FIG. ) As shown in the drawing, it is recommended that the angular range is set small (e.g., in 10 degree increments) in the upper, lower, left, and right directions, and in the diagonal direction including the upper left, lower left, upper right, and lower right sides. For a certain range, it is recommended that the angle be set large (for example, in 80-degree increments). If the diagonal direction is set to mean only one correct one direction, such as the upper, lower, left, and right sides, for example, even if the direction dragged by the user is any upper-right direction among a certain range of upper-right directions, the device is X-axis. When the angle of the set is determined to be determined in the upper right direction of 45 degrees, as shown in FIG. 46(b), the upper, lower, left, right, upper left, lower left, upper right, and lower right ranges are all It is recommended to be set to divide the 360-degree direction by making the 45-degree angle range.

(For reference, in the "2)" method, which is referred to as a blurring method, the upper, lower, left, right and diagonal directions need only be judged separately, and in the diagonal direction, the upper left, lower left, upper right, and lower right sides are required. There is a case in which there is no need, but the upper, lower, left, and right sides must be classified, and as a result, the diagonal direction should also be divided into the upper left, lower left, upper right, and lower right sides.),

If only the upper, lower, left, and right directions need to be distinguished and judged, the diagonal direction including the upper left, lower left, upper right, and lower right may not need to be distinguished. When the direction determined by is set to mean only one correct one direction, such as upper, lower, left, and right, for example, even if the direction dragged by the user is the upper direction among the upper directions in a certain range, the device is parallel to the Y axis. When it is set to judge in the upward direction, it is recommended that the predetermined ranges of the upper, lower, left, and right sides be all 90 degrees, as shown in FIG.

The method of modifying various objects by the method of the present application will be described with examples of the following three methods 1), 2), and 3).

1) After multi-touching so that the (object or) object's activation area becomes the target button (=target object or target activation area), if it is dragged in at least one first specific direction, it is enlarged, and at least one second specific direction It is a way to collapse when dragged.

For example, after the index finger is recognized as a reference finger, and the index and middle finger are used to multi-touch so that the (object or) object's activation area is the target button (=target object or target activation area),

When the index and middle finger are multi-all dragged in the upward direction, as in the case of the change from FIG. 26 to FIG. 37, when the ratio of the horizontal and vertical lengths of the object is enlarged, and the index and middle finger are multi-all dragged in the downward direction , As shown in FIG. 37 to FIG. 26, it may be possible to implement such that the ratio of the horizontal and vertical length of the object is reduced while being maintained. (Of course, in the above embodiment, the upper side is replaced with the right side, and the lower side is It may be implemented to be replaced with the left side, and the upper side may be mixed to have the same result as the right side, and the lower side may be mixed to have the same result with the left side.)

And, it is a method that can be enlarged or reduced while the position of the center point of the object is not changed.

2) The object (or the active area of the object) is multi-touched to be recognized as a target button and then dragged, only the horizontal length or the vertical length or horizontal of the object (or the active area of the object) by the drag direction determined by the device. It is a method in which the length and the length are enlarged or reduced together.

To be more specific,

When the object (or the active area of the object) for which the shape is desired to be transformed is multi-touched to be recognized as a target button, the dragging direction (determined by the device), that is, the drag direction intended by the user is upper and lower. In the case where it is determined that it is one of the right, left, and right directions,

When dragged in the first specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is enlarged,

When dragged in the second specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,

When dragged in the first specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is enlarged,

When dragged in the second specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is reduced,

When the object (or the active area of the object) for which the shape is desired to be transformed is multi-touched to be recognized as a target button, the dragging direction (determined by the device), that is, the dragging direction intended by the user, is on the upper right side. If it is determined to be one of the diagonal directions, including the lower right, upper left, and lower left,

In the first way,

When dragged in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,

When dragging in at least one second specific direction among diagonal directions, there is a method in which the horizontal length and the vertical length are reduced by the same ratio,

In the second way,

When dragged in at least one first specific direction range among the diagonal directions, the variation ratios of the horizontal length and the vertical length are differently expanded according to each direction within the range,

When dragging to at least one second specific direction range among the diagonal directions, there is a method in which the variation ratios of the horizontal length and the vertical length are reduced differently according to each direction within the range.

And, it is a method that can be enlarged or reduced while the position of the center point of the object is not changed.

To explain the method described above as an example,

After the index finger is recognized as the reference finger, and the object and the object's active area is the target button, the index finger and the middle finger are used and two-touched,

When the index finger and middle finger are multi-all dragged upward in the vertical direction, the shape of the object is deformed such that only the vertical length is large without changing the horizontal length of the object, as in the case of changing from FIG. 26 to FIG. 35, and the index finger and middle finger are in the vertical direction. When multi-all dragging in the middle-lower direction, the shape of the object is deformed such that the horizontal length of the object becomes smaller without changing the horizontal length, as shown in FIG. 35 to FIG.

When the index and middle finger are multi-all dragged in the right direction among the horizontal directions, the shape of the object is deformed such that the vertical length of the object is increased without changing, as in the case of changing from FIG. 26 to FIG. 36, and the index and middle finger are in the horizontal direction. When multi-all dragging to the left of the middle, the shape of the object is deformed such that only the horizontal length of the object is reduced without changing the vertical length of the object, as shown in FIG. 36 to FIG.

When the determined drag direction is diagonal,

As an embodiment of the first method,

Even if the index finger and middle finger are multi-all dragged in any of the various right-side directions in the diagonal direction or in any of the various left-right directions, the ratio of the horizontal and vertical lengths of the object is changed as shown in FIGS. 26 to 37. Even if it is enlarged while being maintained, and the index finger and middle finger are multi-all dragged in any of the various right and left directions or in the various left and right directions, the length of the object is changed as shown in FIG. 37 to FIG. 26. It may be possible to implement such that the ratio of and length is reduced while being maintained.

As an embodiment of the second method,

Depending on whether the index and middle finger are multi-all dragged in the diagonal direction, in the upper right direction or in the various upper left direction, in the upper right direction or in the upper left direction, the ratio between the horizontal and vertical length of the object is enlarged to be different. It is possible to implement so that the ratio of the horizontal and vertical lengths of the object is reduced by differently depending on whether the middle and the middle are multi-all dragged in the various right-lower directions or various left-right directions among the diagonal directions. You may.

3) In the background section, "According to the method of the present application, steps 1 to 3 in the object shape transformation method requiring the activation step of the above-mentioned conventional object only by multi-touching the object to be recognized as the target button (= target object). While having the same effect as the steps being performed, it is also possible to perform the four steps in the object shape transformation method that requires the step of activating a conventional object, in which 17 aspects of object change are implemented, through multi-touch manipulation. It is a method including the method mentioned above.

And, it is a method that can be enlarged or reduced as the position of the center point of the object changes.

In more detail, it can be said that the following steps are used.

Step 1: The object (or the active area of the object) is multi-touched and dragged so that it is recognized as the target button, and the specific range inside the object (or the active area of the object) is targeted by the direction of the hitting point and the dragging Step to be recognized as.

Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes depending on the recognized target range and the determined drag direction, the direction in which the drag starts is close to the center of the object (or the active area of the object). In the direction of losing, it is reduced, and in the direction that it is away, it is enlarged. (The center of the object may be moved in the direction of the determined drag.)

Depending on the implementation method, the target scope itself may be the object or the entire active area of the object. This will usually be the way the object's center point does not move. In the method of moving the center point, it is recommended that some range of the object or the active area of the object is recognized as the target range.

That is, enlargement or reduction is determined according to the recognized target range or the hitting point as well as the direction in which the drag is started determined by the device, and optionally, if the center point is moved, the direction of movement of the center point can also be determined. It is a way.

(Above, the center of the object (or the active area of the object) is a straight line passing through the center of the object (or the active area of the object) perpendicular to the determined drag direction, or an object (or object) perpendicular to the determined drag direction. The result may be the same even if it is replaced with the concept of a straight line dividing an object (or an object activation area) into two while passing through the center of the active area).)

From the user's point of view, the target range is determined first, and any point within the target range is selected as the target point, and multi-touch is performed to become the target point and then dragging is started. Likewise, it is possible to enable the user to determine which range was considered as the target range by two factors, the hitting point and the direction in which the drag starts.

In the above, there is a part expressed as a direction in which a drag has started, not as a drag direction. To explain the reason, the object is centered when dragging downward, for example, in the range 5 in FIG. 45. Although it is close to the direction of the object, if it is dragged to the lower side beyond the horizontal line passing through the center of the object, it becomes the direction away from the center of the object from that point onwards. From the moment when it shrinks and crosses the horizontal line, the direction away from the center of the object is not dragged downward as much as the length of the vertical side of the object, because the object should not be enlarged immediately. This is because the object needs to be continuously reduced until it is dragged downward by the length of the vertical side.

Adding a little technique to the method is as follows.

① The specific range inside the object (or the active area of the object) is multi-touched and started to be dragged so that the object (or the active area of the object) that wants to transform the shape is recognized as the target button. To be recognized as the target scope,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper side, the lower side, the right side, or the left side,

If the determined starting direction of dragging is close to the center of the object (or the object's active area), 2 parallel to the determined drag direction among two horizontal sides or two vertical sides of the object (or the object's active area). The length of the two sides is reduced, and the length of the two sides perpendicular to the determined drag direction is unchanged (in addition, as the center of the object moves in the determined drag direction, the determined drag among the three sides surrounding the recognized target range) The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side may not be changed.),

If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), two parallel sides parallel to the determined drag direction among two horizontal sides or two vertical sides of the object (or the active area of the object). The length of the side is enlarged, and the lengths of the two sides perpendicular to the determined drag direction are unchanged (in addition, as the center of the object moves in the determined drag direction, the determined drag direction among the three sides surrounding the recognized target range) The position of the side perpendicular to the side is moved for enlargement, and the position of the opposite side of the side may not be changed.)

The contents of the method "①" here are 1 to 8) of the 17 object change patterns in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section. It describes a method that may be implemented by the method of.

② The specific range inside the object (or the active area of the object) is multi-touched and dragged so that the object (or the active area of the object) that wants to transform the shape is recognized as the target button, and the direction of the hitting point and dragging starts. To be recognized as the target scope,

If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper right, lower right, upper left, or lower left,

If the determined starting direction of dragging is close to the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced, and if the horizontal sides are reduced, both horizontal sides are reduced to the same length, and vertical If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of the change in the horizontal and vertical lengths can be set differently depending on which direction is dragged within a specific drag direction range determined by the device. It can be set so that the length of the width and the length are different in the same ratio regardless of the direction in which it is dragged. (In addition, as the center of the object moves in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among the vertices in the recognized target range is moved for reduction, and the position of the vertex facing the vertex May be left unchanged.)

If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. At this time, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, and depending on which direction is dragged within a specific drag direction range determined by the device The change ratio of the length and the length may be set differently, or the length of the width and the length may be set to be changed at the same ratio regardless of which direction is dragged in a specific drag direction range. (In addition, as the center of the object moves in the determined drag direction, the vertex closest to the straight line parallel to the drag direction among the vertices in the recognized target range is moved for enlargement, and the position of the vertex facing the vertex May not change.)

As for the "②" method here, 9)~16) of the 17 object changes in the 4th step in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is the method of the present application It describes a method that may be implemented as.

For a more specific example,

The target is a specific range inside the object (or the active area of the object) by multi-touch and dragging so that the object (or the active area of the object) that wants to deform is recognized as the target button, and by the direction of the hitting point and dragging. In order to be recognized as a range, the index finger and the middle finger are two-touched to be recognized as a reference finger.

1) The multi-all drag is performed after two multi-touches so that the fifth range is touched with the index finger as the reference finger so that the fifth range in the drawing (a) of FIG. 45 is recognized as the target range. The "1)" aspect of the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background art section is implemented.

2) The multi-all drag is performed after two multi-touches so that the fifth range is touched with the index finger as the reference finger so that the fifth range in the drawing (a) of FIG. 45 is recognized as the target range. The aspect of "2)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background art section is implemented.

3) In multi-all drag after 2 touches so that the 7th range is touched with the index finger as the reference finger so that the 7th range of FIG. 45(a) is recognized as the target range. The aspect "3)" of the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

4) The multi-all drag is performed after two multi-touches so that the seventh range is touched with the index finger as the reference finger so that the seventh range of FIG. 45(a) is recognized as the target range. The aspect of "4)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

5) The multi-all drag is performed after multi-touching so that the 8th range is touched with the index finger as the reference finger so that the 8th range of FIG. 45B is recognized as the target range. The aspect of "5)" among the 17 object change modes in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

6) The multi-all drag is performed after two multi-touches so that the eighth range is touched with the index finger as the reference finger so that the eighth range of FIG. 45(b) is recognized as the target range. In the object shape transformation method, which requires the step of activating the conventional object mentioned in the background section, "6)" of the seventeen object changes in step 4 is implemented.

7) The multi-all drag is performed after two multi-touches so that the sixth range is touched with the index finger as the reference finger so that the sixth range of FIG. 45(b) is recognized as the target range. In the object shape transformation method requiring the step of activating the conventional object mentioned in the background section, the aspect of "7)" is implemented among the 17 object change aspects in step 4.

8) The multi-all drag is performed after two multi-touches so that the sixth range is touched with the index finger as the reference finger so that the sixth range of FIG. 45(b) is recognized as the target range. The aspect of "8)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background art section is implemented.

9) In the multi-all drag after the first multi-touch is touched so that the first range is touched with the index finger as the reference finger so that the first range of FIG. 45(b) is recognized as the target range. The aspect of "9)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

10) In the multi-all drag after the first multi-touch is touched so that the first range is touched with the index finger as the reference finger so that the first range of FIG. 45(b) is recognized as the target range. The aspect of "10)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

11) In the multi-all drag after 2 touches so that the 4th range is touched with the index finger as the reference finger so that the 4th range of FIG. 45(b) is recognized as the target range. The aspect of "11)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

12) In multi-all dragging after the second multi-touch is performed so that the fourth range is touched with the index finger as the reference finger so that the fourth range of FIG. 45(b) is recognized as the target range. The aspect of "12)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

13) In the case where the second range of FIG. 45(b) is touched with the index finger as the reference finger so that the second range of the drawing is recognized as the target range, the multi-all is dragged. The aspect of "13)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

14) In the multi-all drag after the second multi-touch is touched so that the second range is touched with the index finger as the reference finger so that the second range in the drawing (b) of FIG. 45 is recognized as the target range, when it starts to be dragged to the lower left and is completed, The aspect of "14)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

15) In multi-all dragging after the multi-touch is performed so that the third range is touched with the index finger as the reference finger so that the third range of the drawing (b) of FIG. 45 is recognized as the target range. The aspect of "15)" among the 17 object change patterns in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented.

16) In the multi-all drag after the multi-touch is performed so that the third range is touched with the index finger as the reference finger so that the third range of the drawing (b) of FIG. 45 is recognized as the target range. The aspect of "16)" among the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background art section is implemented.

17) Regardless of any drawing (a), (b), (c), or (d) of FIG. 45, any range of the object (or the active area of the object) is recognized as the target range, that is, at any point In multi-all dragging after being multi-touched to be touched with the index finger as the reference finger, the object (or the active area of the object) rotates when the drag trajectory is not a locus close to a straight line within a certain curvature range, but a curve trajectory.

Expressed in a technical language as above, it seems a bit complicated. From the user's point of view, according to intuition, if a target button recognition method using a reference finger is used as a target button recognition method, a touch point to which a reference finger should be touched is determined and touched, and then dragged in a desired direction to be reduced or Just enlarge it.

In the method of transforming the shape of an object that requires the activation step of a conventional object, place the mouse pointer on only the zoom control point on the side or vertex where the zoom in or out starts, and then hold the left mouse button and drag in the desired direction. Zoomed in or out,

In the multi-touch method of the present application, referring to the point where the reference finger should be touched, the method of the present application does not require the activation of the object, but the object activation area boundary is assumed when the object activation area boundary line appears as in the prior art. It may be extended to the inner zoom point of the zoom control point or to or near the object. Then, the drag direction is the same as the conventional method.

Let me explain a more specific example.

In the following examples of (a), (b), (c), (d),

The concept of an object's activation area does not require activation of an object in the method of the present application, but assuming when an object is activated as in the prior art, it is assumed that an object activation area boundary appears only in the head. Please keep in mind.

So is the concept of the boundary of the active area of an object.

In addition, the target point can be applied not only to the zoom control point on the object activation area boundary line in the conventional method, but also to a point within the boundary line adjacent to the control point, and to an external point of the object or a point within the object adjacent to the control point. It is recommended to do so. Of course, in order to recognize an object as a target object even when the object is in multi-touch with the reference finger as well as the zoom control point on the boundary of the object activation area, as well as a point within the boundary line adjacent to the control point, in advance, it is recognized as such. It should be set as much as possible.

(a) For example, by multi-touching the reference finger to touch the zoom point on the object's left/right active area boundary or the inner point of the object near or around the boundary, for example, the index finger is the reference After two multi-touch with the index finger and middle finger to be recognized as a finger, the touch state of the index finger and middle finger is dragged left/right while the vertical length of the object is not changed, and the horizontal length of the object may be enlarged or reduced.

The contents of the method of 5) to 8) among the 17 object change modes in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. It refers to an example.

(The method described above after activating the object with a single touch, etc., if it is difficult to predict the position of the area boundary to be activated of the object, such as a star shape, is not the case where the activation area boundary line is formed in the same range as the shape. It can also be enlarged or reduced by dragging after multi-touch, as in 2) or 3) below.)

(b) For example, by multi-touching the reference finger to touch the zoom point on the object's upper/lower active area boundary or at or near the inner point of the object, for example, the index finger is the reference After 2 multi-touch with the index finger and middle finger to be recognized as a finger, the touch state of the index finger and middle finger is dragged up and down while the horizontal length of the object is not changed, and the vertical length of the object can be enlarged or reduced.

The contents of the method of 1) to 4) among the 17 object change patterns in step 4 in the object shape modification method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. It refers to an example.

(c) For example, by multi-touching the reference finger to touch the zoom point on the object activation area boundary vertex or the inner point of the object near or around it, for example, the index finger becomes the reference finger. After two multi-touch with the index finger and middle finger to be recognized, the touch state of the index finger and middle finger is maintained and dragged diagonally, so that the horizontal and vertical lengths of the object can be enlarged or reduced. Of course, the ratio of the horizontal and vertical lengths to be enlarged/reduced may vary depending on the dragging direction.

Here, the contents of 9) to 16) among the 17 object change modes in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section are implemented by the method of the present application. It refers to an example.

(d) For example, by multi-touching the reference finger to touch the inside point of the object inside the object activation area boundary line, for example, after two multi-touches with the index finger and the middle finger so that the index finger is recognized as the reference finger. As the touch state is maintained, the object may be rotated by dragging the curve over a certain curvature.

Herein, reference is made to an example of how the 17th aspect of the 17 object change aspects in step 4 in the object shape transformation method requiring the activation step of the conventional object mentioned in the background section is implemented by the method of the present application. It is done.

The following ①~⑧ examples will make it easier to understand.

The following examples ① to ⑧ are included in the above concept, and when the dragging is performed in a direction that approaches the straight line passing through the center of the object perpendicular to the dragging direction, it is reduced and the center of the object forming a right angle to the dragging direction is reduced. It may be said that the dragging progresses in a direction away from the passing straight line, which is enlarged.

In the following ① to ⑧ examples, when dragged in the diagonal direction, only the case where the horizontal and vertical lengths are enlarged or reduced at the same ratio is given, but it is natural that it can be set to be enlarged at different ratios depending on the drag direction.

① It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,

The index finger to be recognized as a reference finger at a point in the (object area) or the object activation area (eg, area 5 in FIG. 45) having a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' upward, the horizontal length of the object may be enlarged without changing the horizontal length of the object. Even if only the vertical length is enlarged, the coordinate(s) with the smallest Y value in the (object area or) object activation area (e.g., the lower horizontal side) is unchanged, and the coordinate with the largest Y value in the (object or) object activation area ( Field) (e.g., the upper horizontal side) may be moved to the upper side so that only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.

If, the object within the (object area) or the object activation area (eg, area 7 in FIG. 45) having a Y value of less than the median value of Y1, Y2 (=(Y1+Y2)/2) is recognized as a reference finger. When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, when the object is'multi-all dragged', the horizontal length of the object may be reduced without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is the same. In the form of being moved upward, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 26 to FIG.

② It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area or) object's active area before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,

The index finger to be recognized as the reference finger is touched at a point in the (object area) or the object activation area having a Y value equal to or greater than the median value of Y1, Y2 (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. If the part is touched at any point and then'multi-all dragged' to the lower side, the horizontal length of the object can be reduced only without changing the horizontal length. Even if only the vertical length is reduced, the coordinate(s) where the Y value of the (object area) or object activation area is the smallest is unchanged, and the coordinate(s) where the Y value of the (object or) object activation area is the largest is moved to the lower side. In the form of paper, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 27 to Fig. 26 are made.

If, in the middle of the Y1, Y2 (=(Y1+Y2)/2) Y value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen and'multi-all dragging' to the lower side, the horizontal length of the object can be enlarged without changing the horizontal length. Even if only the vertical length is enlarged, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is In the form of being moved downward, only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 28 to FIG.

③ It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,

The index finger, which is to be recognized as a reference finger, is located at a point in the (object area) or the object activation area (eg, area 6 of FIG. 45) having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2). When the touch is made, and the middle finger is touched at any point on the right part of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be changed without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) having the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the (object or) object activation area has the largest X value. (S) (e.g., the right side of the right side) is moved to the right side so that only the length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG. 29 is made.

If, as an intermediate value (=(X1+X2)/2) of X1 and X2, the object within the (object area) or the object activation area (for example, area 8 of FIG. 45) having an X value less than that is recognized as a reference finger When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object activation area is unchanged, and the coordinate(s) with the smallest X value of the (object area or) object activation area is In the form of being moved to the right, only the horizontal length of the object can be reduced. Briefly explaining the above description with the drawings, an example of changing from FIG. 26 to FIG. 30 is exemplified.

④ (Multi-touch) is detected and stopped so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,

The index finger, which is to be recognized as the reference finger, is touched at a point in the (object area) or the object activation area having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After making it touch at any point of the part and'multi-all dragging' to the left, the vertical length of the object can be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinates with the smallest X value in the (object area) or object activation area are unchanged, and the objects with the largest X value in the (object or) object activation area are shifted to the left. Only the length of the horizontal can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 29 to FIG.

If, in the middle of the X1, X2 (=(X1+X2)/2) X value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen, if it is'multi-all dragged' to the left, only the horizontal length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are not changed, and the coordinates with the smallest X value of the (object area) or the object activation area are shifted to the left. It is possible to enlarge only the width of the object. Briefly explaining the above description with the drawings, it is exemplified that changes from FIG. 30 to FIG.

⑤ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area or) object activation area with an X value greater than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) For example, the index finger, which is to be recognized as the reference finger, is touched at a point in the area within the area (which may be included in area 2 of FIG. 45), and the middle finger is touched at any point on the right part of the index finger, and then the'multi-all drag 'If, the horizontal and vertical length of the object can be enlarged at the same ratio. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values in the (object area or) object activation area (e.g., the third vertex in FIG. 39) are unchanged (object or). The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates having the largest X and Y values in the object activation area (eg, vertex 2 in FIG. 39) are moved to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) After the index finger, which is to be recognized as the reference finger, is touched at a point within the object activation area (for example, an area that may be included in area 3 in FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then to the upper right When'multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even when the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The length and width of the object can be reduced in the form that the smallest value is shifted to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

⑥ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

Within the object activation area (object area) with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2). When the index finger, which is to be recognized as the reference finger, is touched at the point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical length of the object is reduced by the same ratio. can do. Even if the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the smallest. The horizontal and vertical length of the object can be reduced in the form that the largest coordinates are moved to the lower left. Briefly explaining the above description with the drawings, it is exemplified that changes from Fig. 31 to Fig. 26 are made.

If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) When the index finger, which is to be recognized as the reference finger, is touched at a point in the object activation area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical lengths of the object are the same. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The horizontal and vertical length of the object can be enlarged in such a way that the smallest value is shifted to the lower left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 32 to FIG.

⑦ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area) or object activation area with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point within the area (for example, an area that can be included in area 4 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of an object are enlarged at the same ratio, the coordinates (the object area or) of the object activation area where the X value is the smallest and the Y value is the largest (e.g., the first vertex in FIG. 39) are unchanged. Or, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value in the object activation area are moved to the lower right. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.

If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point in the active area (for example, an area that may be included in area 1 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then the ' When multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object area) or the object activation area without changing the coordinates where the X value of the object activation area is the largest and the Y value is the smallest is unchanged. The horizontal and vertical lengths of the object can be reduced in a form in which the coordinates with the smallest and largest Y value are moved to the lower right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.

⑧ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)

(Object area) or object activation area with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as a reference finger, is touched at an inner point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the horizontal and vertical length of the object is reduced to the same ratio. I can do it. Even when the horizontal and vertical lengths of an object are reduced by the same ratio, the X value of the (object or) object activation area is the most, without changing the coordinates of the (object area or) object activation area with the smallest X value and the largest Y value. The horizontal and vertical length of the object can be reduced in a form in which the coordinates with the smallest Y value are moved to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 33 to Fig. 26 are made.

If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as the reference finger, is touched at a point in the active area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the object's horizontal and vertical lengths are the same ratio. Can be enlarged. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the X value of the (object area) or the object activation area without changing the coordinates where the X value of the object activation area is the largest and the Y value is the smallest is unchanged. The horizontal and vertical lengths of the object can be enlarged in such a way that the coordinates with the smallest and largest Y value are shifted to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 34 to FIG.

For reference, in a situation in which an object including a figure, a picture, a browser, and an object including a window is changed, rather than a button to which a letter is assigned, in the case of a device such as a mobile phone or a smartphone equipped with a small display device, In most cases, since only one object is displayed and used in many cases, it is not important which of the multi-touched fingers is determined as the'reference finger'.

That is, when one or more fingers touch any object, the object needs to be recognized by the device as a target button, and in that state, the object may be reduced or enlarged through various manipulations including multi-all dragging as described above. The shape may change.

Even on a dedicated screen where the shape of the object is changed, even if there is no finger touched on the object among the multi-touched fingers, the object is recognized as the target button even if the screen is multi-touched by itself, as in the above state. Through various manipulations including multi-all dragging, the shape of the object may be changed, including the object being reduced or enlarged.

In addition, when a specific button is touched with a finger, a button desired to be touched is also touched, but the finger may be thick, and there may be a case where a desired button is touched. It can be recognized as being.

5. Electronic devices to which the present invention is applicable

25 is a block diagram of an electronic device to which the present invention is applicable. As shown in FIG. 25, an electronic device to which the present invention is applicable includes a touch screen 110, a function block 120, a control unit 130, a storage unit 140, and a communication unit 150.

The touch screen 110 is a means used to display the above-described touch buttons, and to touch a touch button desired by a user with a finger.

The function block 120 performs the original function of the electronic device. If, 1) the electronic device is a mobile phone, the function block 120 performs a mobile phone function, 2) if the electronic device is a mobile computer, the function block 120 performs a computing function, and 3) the electronic device If it is a mobile multimedia player, the function block 120 performs a multimedia playback function, and 4) if the electronic device is a general notebook or PC, the function block 120 performs a computing function.

The storage unit 140 provides a storage space in which programs and data used to perform functions of electronic devices and generate a GUI screen composed of the above-described touch buttons are stored, and multimedia files are stored.

The control unit 130 executes a program stored in the storage unit 140 to control function execution by the function block 120 and displays a GUI composed of touch buttons on the touch screen 110. In addition, the controller 130 performs character input, object adjustment, and function execution according to a user's manipulation input using touch buttons displayed through the touch screen 110.

The communication unit 150 is connected to communicate with other electronic devices, and performs data communication.

In addition, although the preferred embodiments of the present invention have been illustrated and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

110: touch screen
120: function block
130: control unit
140: storage
150: communication unit

Claims (162)

In a device having a touch screen, when the touch screen is multi-touch, in the method for the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 1,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 2,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 2,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 2,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 2,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 1,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to any one of claims 1 to 7,
In a device equipped with a touch screen, after the multi-touch operation, in the method of generating a work signal for any operation including character input or object deformation,
The method that is operated after multi-touch is multi-on&off, multi-drag, multi-touch operation with open fingers. The method according to claim 8,
The multi-on & off method is a method characterized in that any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off The method according to claim 9,
Multi multi sick all on & off method is characterized in that any one or more of the following methods.
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe The method according to claim 8,
The multi-drag method is one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag The method according to claim 11,
The method of the multi sickle all drag method is one or more of the following methods.
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe) The method according to claim 8,
The method after the multi-touch operation with the open finger (= multi-touch operation with the open touch point) is one or more of the following methods.
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) In a device having a touch screen, when the touch screen is multi-touched, a multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers In a device equipped with a touch screen, after the multi-touch operation, in the method of generating a work signal for any operation including character input or object deformation,
The method that is operated after multi-touch is multi-on&off, multi-drag, multi-touch operation with open fingers. The method according to claim 15,
The multi-on & off method is a method characterized in that any one or more of the following methods.
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off The method according to claim 16,
Multi multi sick all on & off method is characterized in that any one or more of the following methods.
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe The method according to claim 15,
The multi-drag method is one or more of the following methods.
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag The method according to claim 18,
The method of the multi sickle all drag method is one or more of the following methods.
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe) The method according to claim 15,
The method after the multi-touch operation with the open finger (= multi-touch operation with the open touch point) is one or more of the following methods.
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) In a device equipped with a touch screen, after the multi-touch operation, in the method of generating a work signal for any operation including character input or object deformation,
After the multi-touch operation method,
A method characterized by a method in which different operations are performed according to the number of times multi-on&off is performed continuously at least once or more, that is, a multi-multi-tap method. The method according to claim 21, When the character is input by the multi-multi-tap method,
A method characterized in that characters belonging to a target character group associated with a target button are displayed in a circular manner according to the number of times multi-on & off is performed continuously at least once or more. The method according to claim 22,
After the characters are displayed in circulation, a single touch or multi-touch so that another button is recognized as a target button, the cursor is moved, or the displayed character is input definitely after a certain period of time (e.g., 2 seconds). The method according to claim 22,
When multi-touch when multi-tap is expressed in more detail with n multi-touch,
According to at least one value of n, that is, depending on the situation before the last operation, a specific character group is matched among at least one character group, belonging to the matched character group, and at least one of at least one character associated with the target button A method characterized in that the text is input without changing the text mode. The method according to claim 24,
The "character group" is characterized in that any one of the following character groups.
1) Any one character group among two or more character groups classified into different series according to the spelling rule.
2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.
3) A group of characters assigned to a specific line among characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method according to claim 25,
The "character group" means that a character group to which other characters belong according to the spelling rule is a character group of characters input in another character mode on the spelling rule corresponding to the currently set character mode. The method according to claim 24,
The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.
In English,
If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,
If the currently set character mode is a lower case mode, it is a character group that can be entered in upper case mode,
In Japanese
If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,
If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode. The method according to any one of claims 21 to 27,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 28,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 29,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 29,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 29,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 29,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 28,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to any one of claims 21 to 34,
The multi-touch,
A method characterized in that the two fingers are used to be two multi-touch recognized by two touch points. The method according to claim 35,
The two fingers,
The method characterized in that it is the index finger and the middle finger. The method according to any one of claims 21 to 36,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 21 to 37,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points) The method according to any one of claims 21 to 38,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 21 to 39,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say. Multi-touch so that the object (or the active area of the object) is recognized as the target button
And an object (or an active area of the object) is transformed according to an operation after multi-touch. The method according to claim 41,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 42,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 43,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 43,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 43,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 43,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 42,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to any one of claims 41 to 48,
The manipulation is a method of transforming an object, characterized in that it is a drag. The method according to claim 49,
A method in which an object (or an active area of an object) is enlarged when dragged in at least one first specific direction, and an object (or an active area of an object) is reduced when dragged in at least one second specific direction. The method according to claim 50,
Dragging in the upward direction enlarges,
Method characterized in that it is reduced when dragged in the downward direction. The method according to claim 50,
In the enlargement or reduction, the method characterized in that the ratio of the horizontal and vertical length of the object is maintained. The method according to claim 50,
A method characterized in that the center point of the object does not move when zooming in or out. The method of claim 49,
A method characterized in that only the horizontal length or the vertical length of the object (or the active area of the object) is enlarged or reduced together by the drag direction determined by the device. The method according to claim 54,
When dragged in the first specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is enlarged,
When dragged in the second specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,
When dragged in the first specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is enlarged,
When dragged in the second specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is reduced,
When dragging in at least one first specific direction among the diagonal directions, the horizontal length and the vertical length are enlarged at the same ratio,
A method characterized in that when dragging in at least one second specific direction among diagonal directions, the horizontal and vertical lengths are reduced by the same ratio. The method of claim 55,
When dragging to the right, the horizontal length is enlarged,
When dragged to the left, the horizontal length is reduced,
When dragging upward, the vertical length is enlarged,
When dragged in the downward direction, the vertical length is reduced,
When dragging in the upper left or right upper direction, it is enlarged in the same ratio as the horizontal length and the vertical length,
When dragging in the lower left or right lower direction, the method characterized in that it is reduced in the same ratio as the horizontal length and vertical length. The method according to claim 54,
When dragged in the first specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is enlarged,
When dragged in the second specific direction in the horizontal direction, the vertical length is unchanged, the horizontal length is reduced,
When dragged in the first specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is enlarged,
When dragged in the second specific direction in the vertical direction, the horizontal length is unchanged, the vertical length is reduced,
When dragging to at least one first specific direction range among diagonal directions, the horizontal length and the vertical variation ratio are enlarged differently according to each direction within the range,
A method in which a horizontal length and a vertical variation ratio are reduced differently according to each direction within a range when dragging in at least one second specific direction range among diagonal directions. The method according to claim 57,
When dragging to the right, the horizontal length is enlarged,
When dragged to the left, the horizontal length is reduced,
When dragging upward, the vertical length is enlarged,
When dragged in the downward direction, the vertical length is reduced,
When dragging in the upper left or right upper direction, the enlargement ratio of the horizontal length and the vertical length is enlarged differently depending on which direction of the upper left range or the upper right range is dragged,
When dragging in the left-bottom or right-bottom direction, a reduction ratio of a horizontal length and a vertical length is differently reduced according to the dragging direction of the left-bottom range or the right-bottom range. The method according to claim 54,
A method of zooming in or out, characterized in that the center point of the object is shifted or not shifted. The method of claim 49,
Step 1: The object (or the active area of the object) is multi-touched and dragged so that it is recognized as the target button, and the specific range inside the object (or the active area of the object) is targeted by the direction of the hitting point and the dragging Step to be recognized as (delete??).
Step 2: As the horizontal or vertical length of the object (or the active area of the object) changes depending on the recognized hitting point and the determined drag direction, the direction in which the drag starts to approach the center of the object (or the active area of the object). And if the direction is reduced, if the direction is away, the step of being enlarged. The method according to claim 60,
If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper side, the lower side, the right side, or the left side,
If the determined starting direction of dragging is close to the center of the object (or the active area of the object),
The length of two sides parallel to the determined drag direction among the two horizontal sides or two vertical sides of the object (or the active area of the object) is reduced, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,
If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object),
The length of two sides parallel to the determined drag direction among the two horizontal sides or two vertical sides of the object (or the active area of the object) is enlarged, and the lengths of the two sides perpendicular to the determined drag direction are unchanged,
If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper right, lower right, upper left, or lower left directions,
If the determined starting direction of dragging is close to the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are reduced, and if the horizontal sides are reduced, both horizontal sides are reduced to the same length, and vertical If the sides are reduced, both vertical sides are reduced to the same length, and the ratio of the change of the horizontal and vertical lengths can be set differently depending on which direction is dragged within a specific drag direction range determined by the device. It can be set so that the length of the horizontal and vertical are different in the same ratio regardless of the direction in which I was dragged.
If the determined starting direction of dragging is a direction away from the center of the object (or the active area of the object), the lengths of the horizontal and vertical sides are enlarged. At this time, if the horizontal side is enlarged, both horizontal sides are enlarged to the same length, and if the vertical side is enlarged, both vertical sides are enlarged to the same length, and depending on which direction is dragged within a specific drag direction range determined by the device A method characterized in that the ratio between the length and the length of the length can be set to be different, or the length of the width and length can be set to be changed at the same ratio regardless of which direction is dragged in a specific drag direction range. The method of claim 61,
If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is the upper right side, the lower right side, the upper left side, and the lower left side,
-If the direction in which the determined drag starts to be close to the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the drag determined from among the three sides surrounding the recognized target range The position of the side perpendicular to the direction is moved for reduction, and the position of the opposite side of the side does not change,
-If the direction in which the determined drag starts to be distant from the center of the object (or the active area of the object), the center of the object moves in the determined drag direction, and the determined drag direction among the three sides surrounding the recognized target range The position of the side perpendicular to the is moved to enlarge, and the position of the opposite side of the side does not change,
If it is determined that the direction in which the drag is started (determined by the device), that is, the drag direction intended by the user is one of the upper right, lower right, upper left, or lower left directions,
-If the determined starting direction of dragging is close to the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, parallel to the dragging direction among the vertices in the recognized target range. The vertex closest to the straight line is moved for reduction, and the position of the opposite vertex of the vertex may not be changed.
-If the determined dragging direction is away from the center of the object (or the active area of the object), the center of the object moves in the determined dragging direction, and a straight line parallel to the dragging direction among the vertices in the recognized target range A method characterized in that the vertex closest to is moved for magnification, and the position of the opposite vertex of the vertex may not be changed. The method according to claim 62,
① It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area or) object's active area before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,
The index finger to be recognized as a reference finger at a point in the (object area) or the object activation area (eg, area 5 in FIG. 45) having a Y value equal to or greater than the median value of Y1 and Y2 (=(Y1+Y2)/2) When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' upward, the horizontal length of the object may be enlarged without changing the horizontal length of the object. Even if only the vertical length is enlarged, the coordinate(s) with the smallest Y value in the (object area or) object activation area (e.g., the lower horizontal side) is unchanged, and the coordinate with the largest Y value in the (object or) object activation area ( Field) (e.g., the upper horizontal side) may be moved to the upper side so that only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.
If, the object within the (object area) or the object activation area (eg, area 7 in FIG. 45) having a Y value of less than the median value of Y1, Y2 (=(Y1+Y2)/2) is recognized as a reference finger. When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, when the object is'multi-all dragged', the horizontal length of the object may be reduced without changing the horizontal length of the object. Even if only the vertical length is reduced, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is the same. In the form of being moved upward, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 26 to FIG.
② It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest Y value in the (object area or) object's active area before the shape transformation of the object are (X1, Y1), and the smallest Y value is (X2, Y2). time,
The index finger to be recognized as the reference finger is touched at a point in the (object area) or the object activation area having a Y value equal to or greater than the median value of Y1, Y2 (=(Y1+Y2)/2), and the middle finger is the right side of the index finger. If the part is touched at any point and then'multi-all dragged' to the lower side, the horizontal length of the object can be reduced only without changing the horizontal length. Even if only the vertical length is reduced, the coordinate(s) where the Y value of the (object area) or object activation area is the smallest is unchanged, and the coordinate(s) where the Y value of the (object or) object activation area is the largest is moved to the lower side. In the form of paper, only the vertical length of the object can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 27 to Fig. 26 are made.
If, in the middle of the Y1, Y2 (=(Y1+Y2)/2) Y value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen, if it is'multi-all dragged' to the lower side, the horizontal length of the object can be enlarged without changing the horizontal length. Even if only the vertical length is enlarged, the coordinate(s) having the largest Y value of the (object area or) object activation area is unchanged, and the coordinate(s) having the smallest Y value of the (object area or) object activation area is In the form of being moved downward, only the vertical length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that it is changed from FIG. 28 to FIG.
③ It is two-touched by detecting and stopping so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,
The index finger, which is to be recognized as a reference finger, is located at a point in the (object area) or the object activation area (eg, area 6 of FIG. 45) having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2). When the touch is made, and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be changed without changing the vertical length. Even when only the horizontal length is enlarged, the coordinate(s) having the smallest X value of the (object area or) object activation area (for example, the left vertical side) is unchanged, and the (object or) object activation area has the largest X value. (S) (e.g., the vertical side on the right) may be moved to the right, so that only the horizontal length of the object can be enlarged. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG. 29 is made.
If, as an intermediate value (=(X1+X2)/2) of X1 and X2, the object within the (object area) or the object activation area (for example, area 8 of FIG. 45) having an X value less than that is recognized as a reference finger When the scheduled index finger is touched and the middle finger is touched at any point on the right side of the index finger, and then'multi-all dragged' to the right, the vertical length of the object may be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinate(s) with the largest X value of the (object area or) object activation area is unchanged, and the coordinate(s) with the smallest X value of the (object area or) object activation area is In the form of being moved to the right, only the horizontal length of the object can be reduced. Briefly explaining the above description with the drawings, an example of changing from FIG. 26 to FIG. 30 is exemplified.
④ (Multi-touch) is detected and stopped so that the (object or) object activation area becomes the target button. 2 In multi-touch, the coordinates with the largest X value in the (object area) or the active area of the object before the shape transformation of the object are (X1, Y1), and the smallest X value is (X2, Y2). time,
The index finger, which is to be recognized as the reference finger, is touched at a point in the (object area) or the object activation area having an X value equal to or greater than the median value of X1, X2 (=(X1+X2)/2), and the middle finger is the right side of the index finger. After making it touch at any point of the part and'multi-all dragging' to the left, the vertical length of the object can be reduced without changing the vertical length. Even if only the horizontal length is reduced, the coordinates with the smallest X value in the (object area) or object activation area are unchanged, and the objects with the largest X value in the (object or) object activation area are shifted to the left. Only the length of the horizontal can be reduced. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 29 to FIG.
If, in the middle of the X1, X2 (=(X1+X2)/2) X value of less than (object area or) object activation area, the index finger to be recognized as the reference finger is touched, and the stop is detected After making it touch at any point on the right side of the screen, if it is'multi-all dragged' to the left, only the horizontal length of the object can be enlarged without changing the vertical length. Even when only the horizontal length is enlarged, the coordinates having the largest X value of the (object area) or the object activation area are not changed, and the coordinates with the smallest X value of the (object area) or the object activation area are shifted to the left. It is possible to enlarge only the width of the object. Briefly explaining the above description with the drawings, it is exemplified that changes from FIG. 30 to FIG.
⑤ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)
(Object area or) object activation area with an X value greater than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) For example, the index finger, which is to be recognized as the reference finger, is touched at a point in the area within the area (which may be included in area 2 of FIG. 45), and the middle finger is touched at any point on the right part of the index finger, and then the'multi-all drag 'If, the horizontal and vertical length of the object can be enlarged at the same ratio. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the coordinates with the smallest X and Y values in the (object area or) object activation area (e.g., the third vertex in FIG. 39) are unchanged (object or). The horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates having the largest X and Y values in the object activation area (eg, vertex 2 in FIG. 39) are moved to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.
If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) After the index finger, which is to be recognized as the reference finger, is touched at a point within the object activation area (for example, an area that may be included in area 3 in FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then to the upper right When'multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even when the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The length and width of the object can be reduced in the form that the smallest value is shifted to the upper right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.
⑥ It is 2 multi-touch by detecting and stopping so that the (object or) object activation area becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)
Within the object activation area (object area) with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than or equal to the median value of Y1, Y2 (=(Y1+Y2)/2). When the index finger, which is to be recognized as the reference finger, is touched at the point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical length of the object is reduced by the same ratio. can do. Even if the horizontal and vertical lengths of the object are reduced at the same ratio, the X and Y values of the (object or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the smallest. The horizontal and vertical length of the object can be reduced in the form that the largest coordinates are moved to the lower left. Briefly explaining the above description with the drawings, it is exemplified that changes from Fig. 31 to Fig. 26 are made.
If there is an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) (object area or) When the index finger, which is to be recognized as the reference finger, is touched at a point in the object activation area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the left and right, the horizontal and vertical lengths of the object are the same. It can be enlarged in proportion. Even when the horizontal and vertical lengths of the object are enlarged at the same ratio, the X and Y values of the (object area or) object activation area are unchanged, without changing the coordinates where the X and Y values of the object activation area (object area or) are the largest. The horizontal and vertical length of the object can be enlarged in such a way that the smallest value is shifted to the lower left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 32 to FIG.
⑦ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)
(Object area) or object activation area with an X value greater than or equal to the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point within the area (for example, an area that can be included in area 4 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, When dragged, the horizontal and vertical lengths of the object can be enlarged at the same ratio. Even when the horizontal and vertical lengths of an object are enlarged at the same ratio, the coordinates (the object area or) of the object activation area where the X value is the smallest and the Y value is the largest (e.g., the first vertex in FIG. 39) are unchanged. Or, the horizontal and vertical lengths of the object may be enlarged in such a way that the coordinates (eg, vertex 4 in FIG. 39) having the largest X value and the smallest Y value in the object activation area are moved to the lower right. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 26 to FIG.
If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) After the index finger, which is to be recognized as the reference finger, is touched at a point in the active area (for example, an area that may be included in area 1 of FIG. 45), the middle finger is touched at any point on the right part of the index finger, and then the ' When multi-all dragged', the horizontal and vertical lengths of objects can be reduced by the same ratio. Even if the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object area) or the object activation area without changing the coordinates where the X value of the object activation area is the largest and the Y value is the smallest is unchanged. The horizontal and vertical lengths of the object can be reduced in a form in which the coordinates with the smallest and largest Y value are moved to the lower right. Briefly explaining the above description with the drawings, it is exemplified that the change from FIG. 26 to FIG.
⑧ (Object or) The object activation area is two-touched by detecting and stopping so that the target button becomes the target button. In multi-touch, the coordinates with the largest X and Y values (X1, Y1) in the active area of the (object area or) object before the shape transformation of the object are (X1, Y1), and the coordinates with the smallest X and Y values are ( X2, Y2)
(Object area or) object activation area with an X value greater than the median value of X1, X2 (=(X1+X2)/2) and a Y value less than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as a reference finger, is touched at an inner point, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the object's horizontal and vertical lengths are reduced by the same ratio. I can do it. Even when the horizontal and vertical lengths of the object are reduced by the same ratio, the X value of the (object or) object activation area is the highest, without changing the coordinates of the (object area or) object activation area with the smallest X value and the largest Y value. The horizontal and vertical lengths of the object can be reduced in a form in which the coordinates with the smallest Y value are moved to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from Fig. 33 to Fig. 26 are made.
If the object has an X value less than the median value of X1, X2 (=(X1+X2)/2) and a Y value greater than the median value of Y1, Y2 (=(Y1+Y2)/2) When the index finger, which is to be recognized as the reference finger, is touched at a point in the active area, and the middle finger is touched at any point on the right part of the index finger, when'multi-all dragging' to the upper left, the object has the same horizontal and vertical length ratio. Can be enlarged. Even if the horizontal and vertical lengths of the object are enlarged at the same ratio, the X value of the (object area) or the object activation area (object area or) is the smallest, and the Y value has the smallest coordinate. The horizontal and vertical lengths of the object can be enlarged in such a way that the coordinates with the smallest and largest Y value are shifted to the upper left. Briefly explaining the above description with the drawings, it may be exemplified that changes from FIG. 34 to FIG. The method of claim 61,
In the enlargement or reduction, the method characterized in that the center point of the object is moved. The method according to any one of claims 41 to 64,
The multi-touch,
A method characterized in that the two fingers are used to be two multi-touch recognized by two touch points. The method of claim 65,
The two fingers,
The method characterized in that it is the index finger and the middle finger. The method according to any one of claims 41 to 66,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 41 to 67,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe)
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) In a device having a touch screen, in the method of inputting text,
Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;
Among the process of multi on & off so that a specific button is recognized as a target button,
After a multi-touch time point or after a multi-touch time point, including after a multi-touch finger is turned off (=multi-touch release),
Character input method characterized in that it comprises; a step of inputting a specific sequence of characters among the characters assigned to the button recognized as the target button. The method of claim 69,
When multi-touch is expressed in more detail with n multi-touch,
Character input method characterized in that the specific sequence number is determined according to the n value. The method according to claim 70,
Character input method characterized in that the n value and the numeric value corresponding to the sequence number of the specific sequence is determined to be the same. The method according to claim 70,
If the n value is 2, that is, when it is 2 multi-touch, the character input method characterized in that the second character assigned to the button recognized as the target button is inputted. The method according to claim 70,
If the n value is 3, that is, if it is 3 multi-touch, the third character assigned to the button recognized as the target button is inputted or processed.
If the n value is 4, that is, if it is 4 multi-touch, the character input method characterized in that the fourth character assigned to the button recognized as the target button is inputted. The method according to claim 69 to claim 73,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method of claim 74,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method of claim 75,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method of claim 75,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method of claim 75,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method of claim 75,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method of claim 74,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to claim 69 to claim 80,
The two multi-touch is multi-touch recognized by the touch points of the index finger and middle finger, or
The three multi-touch is multi-touch recognized by the touch points of the index finger, middle finger and ring finger, or
The method of claim 4, wherein the multi-touch is multi-touch recognized by the touch points of the index finger, middle finger, ring finger, and other finger. The method according to any one of claims 69 to 81,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 69 to 82,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points) The method according to any one of claims 69 to 83,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 69 to 84,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say. In a device having a touch screen, in the method of inputting text,
Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;
When a multi-touch is operated so that a specific button is recognized as a target button, after a multi-touch operation starts, or after a multi-touch operation, including after the operation ends,
Character input method characterized in that it comprises a; after the multi-touch operation of the characters assigned to a specific sequence number of characters assigned to the button recognized as the target button. The method of claim 86,
According to the operation after the multi-touch,
Character input method characterized in that the specific sequence number of the input character is determined. The method according to claim 87,
If the drag direction is different, the character input method characterized in that it is recognized that the operation type is different after the multi-touch. The method according to claim 87,
Depending on the situation before the final operation, a specific character group is matched among at least one character group, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Method characterized in that. The method according to claim 89,
The "character group" is characterized in that any one of the following character groups.
3) A group of characters assigned to a specific line among characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method according to claim 86 to claim 90,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method of claim 91,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 92,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 92,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 92,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 92,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method of claim 91,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to any one of claims 86 to 97,
The multi-touch,
A method characterized in that the two fingers are used to be two multi-touch recognized by two touch points. The method according to claim 98,
The two fingers,
The method characterized in that it is the index finger and the middle finger. The method according to any one of claims 86 to 99,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 86 to 100,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe)
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) The method according to any one of claims 86 to 101,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 86 to 102,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say. In a device having a touch screen, in the method of inputting text,
After the keyboard is displayed on the touch screen,
In the case of being operated after multi-touch so that a specific button is recognized as a target button,
The time at which the last operation of at least one of the last operations can be started, including nine behaviors including dragging in eight directions: off or upper, lower, left, right, upper left, lower left, upper right, and lower right. After or after the last operation starts, including after the last operation ends,
By a post-multi-touch operation including a final operation of at least one of the final operations that can include nine behaviors including multi-drags in the off or eight directions,
Among the at least one character group, while belonging to a specific character group, when a specific character is input among at least one character associated with a button recognized as a target button,
Depending on the situation before the final operation, a specific character group is matched among at least one character group, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Method characterized in that. The method of claim 104,
The "character group" is characterized in that any one of the following character groups.
1) Any one character group among two or more character groups classified into different series according to the spelling rule.
2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.
3) A group of characters assigned to a specific line among characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method according to claim 105,
The "character group" means that a character group to which other characters belong according to the spelling rule is a character group of characters input in another character mode on the spelling rule corresponding to the currently set character mode. The method according to claim 106,
The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.
In English,
If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,
If the currently set character mode is a lower case mode, it is a character group that can be entered in upper case mode,
In Japanese
If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,
If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode. The method according to claims 104 to 107,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 108,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 109,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 109,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 109,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 109,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 108,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to claim 104 to claim 114,
The multi-touch,
A method characterized in that the two fingers are used to be two multi-touch recognized by two touch points. The method according to claim 115,
The two fingers,
The method characterized in that it is the index finger and the middle finger. The method according to any one of claims 104 to 116,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 104 to 117,
After multi-touch operation, characterized in that at least one of the following operations
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe)
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) The method according to any one of claims 104 to 118,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 104 to 119,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say. In a device having a touch screen, in the method of inputting text,
After the keyboard is displayed on the touch screen (delete??),
In the case of being operated after multi-touch so that a specific button is recognized as a target button,
At least one of the final operations that can include 5 (9?) behaviors including dragging in 4 (8?) directions: off or up, down, left, right (, top left, bottom left, top right, bottom right) After the start of the last operation of one behavior, or after the start of the last operation, including after the end of the last operation,
By a post-touch operation including a final operation of at least one of the final operations that can include 5 (9?) behaviors including multi drag in the off or 4 (8?) direction,
Among the at least one character group, which belongs to a specific character group (delete?), is associated with the target button (or assigned to the target button??), and the first character, which is a specific character, of the at least one character.
A method characterized in that a second character, which is at least one specific character promised for each final operation, is additionally input regardless of the target button. The method according to claim 121,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 122,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 123,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 123,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 123,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 123,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 122,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method of any one of claims 121-128,
Character input method characterized in that the character assigned to the target button is displayed to the left of the additional input character. The method according to any one of claims 121 to 129,
The second character is a character input method, characterized in that any one of vowel, consonant, half-vowel, half-consonant, or special characters. In accordance with claim 130,
The second character, the character input method characterized in that it includes at least one of the characters corresponding to the pronunciation of the pronunciation of the English [a], [e], [i], [o], [u] . The method according to claim 130,
The second character, A, E, I, O or character input method comprising at least one of U. The method according to claim 130,
The second character, T, S, N, R, H, D, L or character input method characterized in that it comprises at least one of C. The method according to claim 130,
The second character is at least one of ㅏ, ㅓ, ㅗ, ㅜ, ㅑ, ㅕ, ㅛ, ㅠ, ㅡ, ㅣ, ㅢ, ㅐ, ㅔ, ㅒ, ㅖ, ㅚ, ㅘ, ㅙ, ㅟ, ㅝ, or ㅞ Character input method comprising a. The method according to any one of claims 121 to 129,
When dragging for a long time, the second character is a character input method, characterized in that two or more characters. The method according to any one of claims 121 to 129,
Characterized in that the touch is maintained, when dragging in the same direction once again or dragging is changed and the dragging direction is continuously added and input characters are input; characterized in that it further comprises. The method of any one of claims 121-128,
According to the situation before the final operation, a specific character group is matched among at least one character group, and at least one character of at least one character belonging to the matched character group is matched with the character assigned to the target button without changing the character mode. A method characterized by additionally being input together. The method according to claim 137,
When either one of multi-all on & on or multi-all dragging in four directions is performed, the second character is any one of A, E, I, O, and U, or
When the manipulation of either the multi-snall reference finger on/off or the multi-snall multi-snall finger drag is performed, the second character is either W or Y, or
When any one of the four-way single drag operation is performed, the second character is one of T, S, N, and R, or
If any one of the multi-all drags is performed after a single touch in four directions, the second character is any one of H, D, L, and C. The method according to any one of claims 121 to 138,
When there are more than two letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. The method according to any one of claims 121 to 139,
When there are more than two letters assigned to the target button,
According to the situation before the final operation, the method characterized in that the first character is selected and input. The method of claim 121-140,
The multi-touch,
A method characterized in that the two fingers are used to be two multi-touch recognized by two touch points. The method of claim 141,
The two fingers,
The method characterized in that it is the index finger and the middle finger. The method according to any one of claims 121 to 142,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 121 to 143,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..7. Multi drag
1.5.2..8. Multi All Drag
1.5.2..9. Multi sickle all drag
1.5.2..10. Finger drag based on multi-sick all (= Drag touch point based on multi-sick all)
1.5.2..11. Finger drag based on multi-sick all-scythe (= drag touch point based on multi-sick all-scythe)
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points)
1.5.2..13.7. Multi-drag with open fingers (= multi-drag with open touch points)
1.5.2..13.8. Multi-all dragging with open fingers (= Multi-all dragging with open touch points)
1.5.2..13.9. Multi-snall drag by open fingers (= multi-snall drag by open touch points)
1.5.2..13.10. Drag the multi-snall reference finger by the open finger (= drag the multi-snall reference touch point by the open touch point)
1.5.2..13.11. Drag a finger on a multi-sick all-scythe with a spread finger (= Drag a touch point on a multi-sick all-sick with a spread touch point)
1.5.2..13.12. Multi-tap with open fingers (= multi-tap with open touch points) The method according to any one of claims 121 to 144,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 121 to 145,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say. In a device having a touch screen, in the method of inputting text,
Displaying a keyboard on which a button to which a plurality of characters are assigned is displayed on the touch screen;
Among the process of multi on & off so that a specific button is recognized as a target button,
After a multi-touch time point or after a multi-touch time point, including after a multi-touch finger is turned off (=multi-touch release),
Depending on the situation before the final operation, a specific character group among at least one character group is matched, and while belonging to the matched character group, at least one character among at least one character associated with the target button is input without changing the character mode. Character input method comprising the step. The method according to claim 147,
The "character group" is characterized in that any one of the following character groups.
1) Any one character group among two or more character groups classified into different series according to the spelling rule.
2) A character group corresponding to any one of a variety of character modes in a conventional mobile phone, including a character group in a special character mode.
3) A group of characters assigned to a specific line among characters assigned to the same button.
4) Among the characters assigned to the same button, a group of characters assigned to a second specific sequence number that is greater than or equal to the first specific sequence number from the first specific sequence number (if the first specific sequence number and the second specific sequence number are the same, it means one sequence number).
5) A group of characters consisting of at least one character assigned or marked at a specific position among at least one character assigned to the same button. The method of claim 148,
The "character group" means that a character group to which other characters belong according to the spelling rule is a character group of characters input in another character mode on the spelling rule corresponding to the currently set character mode. The method according to claim 149,
The term "specific character group" means any one character group among two or more different character groups classified into different series according to the spelling rule.
In English,
If the currently set character mode is uppercase mode, it is a character group that can be entered in lowercase mode,
If the currently set character mode is a lower case mode, it is a character group that can be entered in upper case mode,
In Japanese
If the currently set text mode is hiragana text mode, it is a character group that can be entered in katakana text mode,
If the currently set character mode is katakana character mode, characterized in that it comprises a character group that can be input in hiragana character mode. The method of claim 147 to 150,
In the way the target button is recognized,
A method of recognizing a target button by a reference finger (= a method of recognizing a target button by a reference touch point) or a method of recognizing a target button by an open touch point (= a method of recognizing a target button by a spread finger) or two or more touch points Method characterized in that the target button is recognized by the target button recognition method by range. The method according to claim 151,
A method of recognizing a target button using a reference finger (= a method of recognizing a target button using a reference touch point) is one or more of the following methods.
1.6.1..1 Target button recognition method by reference finger according to X coordinate value order (= Target button recognition method by reference touch point according to X coordinate value order)
1.6.1..2 Target button recognition method by reference finger according to Y coordinate value order (= Target button recognition method by reference touch point according to Y coordinate value order)
1.6.1..3 Target button recognition method by reference finger according to X coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to X coordinate value order according to multi-touched number)
1.6.1..4 Target button recognition method by reference finger according to Y coordinate value order according to multi-touched number (= Target button recognition method by reference touch point according to Y coordinate value order according to multi-touched number) The method according to claim 152,
In the case that the target button recognition method is a target button recognition method using a reference finger according to the X coordinate value sequence (= a target button recognition method using a reference touch point according to the X coordinate value sequence),
A method characterized in that the leftmost point among the multi-touched touch points, that is, the touch button including the point having the first X coordinate value in the small order of the X coordinate values, is recognized as the target button. The method according to claim 152,
When the target button recognition method is a target button recognition method using a reference finger according to the Y coordinate value order (= a target button recognition method using a reference touch point according to the Y coordinate value order),
A method characterized in that the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value in the small order of the Y coordinate values, is recognized as the target button. The method according to claim 152,
The target button recognition method is a target button recognition method using a reference finger according to an X coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to an X coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, a touch button including the leftmost point of the multi-touched touch points, that is, a point having the first X-coordinate value in a small order of X-coordinate values, is recognized as a target button,
3 In the case of multi-touch, a method in which a touch button including a point having a second X-coordinate value among small order of X-coordinate values among multi-touched touch points is recognized as a target button. The method according to claim 152,
The target button recognition method is a target button recognition method using a reference finger according to a Y coordinate value sequence according to a multi-touched number (= a target button recognition method using a reference touch point according to a Y coordinate value sequence according to a multi-touched number). In some cases,
2 In the case of multi-touch, the touch button including the lowest point among the multi-touched touch points, that is, the point having the first Y coordinate value among the small order of Y coordinate values, is recognized as the target button,
3 In the case of multi-touch, a method characterized in that the touch button including the point having the second Y coordinate value among the small order of the Y coordinate values among the multi touched touch points is recognized as the target button. How to do. The method according to claim 151,
A method of recognizing a target button using a spread finger (= a method of recognizing a target button using a spread touch point) is one or more of the following methods.
1.6.2..1 Target button recognition method by first open finger (= Target button recognition method by first open touch point)
1.6.2..2 Target button recognition method with the second open finger (= Target button recognition method with the second open touch point)
1.6.2..3 Target button recognition method by third open finger (= Target button recognition method by third open touch point)
1.6.2..4 Target button recognition method using the fourth open finger (= Target button recognition method using the fourth open touch point)
1.6.2..5 Target Button Recognition Method with 5th Open Finger (= 5th Target Touch Button Recognition Method) The method according to claim 147 to 157,
The two multi-touch is multi-touch recognized by the touch points of the index finger and middle finger, or
The three multi-touch is multi-touch recognized by the touch points of the index finger, middle finger and ring finger, or
The method of claim 4, wherein the multi-touch is multi-touch recognized by the touch points of the index finger, middle finger, ring finger, and other finger. The method according to any one of claims 147 to 158,
A method characterized in that the multi-touch method, which is a method for a multi-touch process, is one of the following methods.
1.4.2..2. n Multi-touch
1.4.2..3. Multi all touch
1.4.2..4 multi sickle all touch
1.4.2..5. Multi-sick all standard finger touch (= multi-sick all standard touch point touch)
1.4.2..6. Multi-scythe All-scythe finger touch (= Multi-scythe all-scythe touch point touch)
1.4.2..7. Multi-sick all standard finger variation touch (= multi-sick all standard touch point variation touch)
1.4.2..8. Definition of multi-touch term with open fingers
1.4.2..8.1. Multi-touch with open fingers (= multi-touch with open touch points)
1.4.2..8.2. N multi-touch by spreading fingers (= n multi-touch by spreading touch points)
1.4.2..8.3. Multi All Touch by Open Finger (= Multi All Touch by Open Touch Point)
1.4.2..8.4. Multi sickle all touch by spread fingers (= Multi sickle all touch by spread touch points)
1.4.2..8.5. Multi sickle all standard finger touch by open fingers (= Multi sickle all standard touch point touch by open touch points)
1.4.2..8.6. Multi-sick all-scythe standard finger touch by open fingers The method according to any one of claims 147 to 159,
After multi-touch operation, characterized in that at least one of the following operations.
1.5.2..2. Multi on & off
1.5.2..3. Multi All On & Off
1.5.2..4. Multi sickle all on & off
1.5.2..5. Finger on & off based on multi-sick all (= Touch point on & off based on multi-sick all)
1.5.2..6. Finger on & off based on multi-sick all-scythe
1.5.2..12. Multi Multitap
1.5.2..13.1. Operation after multi-touch with open fingers (= operation after multi-touch with open touch points)
1.5.2..13.2. Multi on & off by open fingers (= multi on & off by open touch points)
1.5.2..13.3. Multi All On & Off by Open Finger (= Multi All On & Off by Open Touch Point)
1.5.2..13.4. Multi sickle all on & off with open fingers (= Multi sickle all on & off with open touch points)
1.5.2..13.5. Multi-not all standard finger on & off by open fingers (= Multi-all all standard touch point on & off by open touch points)
1.5.2..13.6. Multi-snall all-slot reference finger on/off by open fingers (= Multi-snall all-sn reference touch point on&off by open touch points) The method of any one of claims 147-160,
The character that can be applied is a method characterized in that the general character representing the language is water and also includes numbers or special characters. The method according to any one of claims 147 to 161,
The character is characterized in that it contains at least one of the world languages and special characters, including Greek Roman characters, Japanese characters, Cyrillic characters, Indian characters, Arabic characters, Thai modes, Vietnamese characters, Korean characters, English characters modes, and Japanese characters. Character input method to say.

Images