JP4803883B2 - Position information processing apparatus and method and program thereof. - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a position information processing apparatus, a method thereof, and a program thereof for detecting a coordinate position and its trajectory input with a finger, a pen, an indicator stick, or the like. Further, the present invention relates to an operating device, a method thereof, and a program thereof for performing an operation by interpreting a user instruction represented by a trajectory.
[0002]
[Prior art]
Conventionally, for example, the position coordinates of a plurality of contact points can be detected in an operation on a touch panel.
[0003]
[Problems to be solved by the invention]
However, the conventional apparatus detects another input as unknown input data for a fixed point, and cannot detect the trajectories of two or more designated positions that move simultaneously. It was.
[0004]
Therefore, it is impossible to interpret an instruction expressed by a combination of the trajectories of a plurality of instruction positions that move at the same time.
[0005]
The present invention has been made to solve the above-described problem, and an object of the present invention is to provide a position information processing apparatus and method capable of detecting the locus of two or more designated positions that move simultaneously. .
[0006]
Another object of the present invention is to provide an operation device and method capable of interpreting a user instruction expressed by a combination of trajectories of two or more designated positions and executing the designated operation. .
[0007]
[Means for Solving the Problems]
According to one aspect of the present invention, in the position information processing apparatus, the indicated position detecting means capable of simultaneously detecting a plurality of indicated positions, and the indicated area capable of detecting the area of the indicated position detected by the indicated position detecting means. Detection means; Storage means for storing a combination of designated positions and designated position areas detected by the designated position detecting means and the designated area detecting means; Based on the plurality of designated positions detected immediately before by the designated position detecting means and the current designated positions detected by the designated position detecting means, the locus of movement of the designated positions is identified. A moving locus identifying means for detecting, with respect to each of the current plurality of designated positions, an area of the designated position detected by the designated area detecting means and a detection by the designated area detecting means. The locus of movement of the plurality of places is identified with the designated position of the closest area among the designated positions of the immediately preceding designated positions as the designated position immediately before the current designated position. Then, the indication position and the indication area are stored in the storage means in association with the indication position and the indication area of the immediately preceding plurality of places stored in the storage means for each of the current indication positions of the plurality of places. .
[0013]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.
[0014]
FIG. 1 is a block diagram illustrating a hardware configuration of the information processing apparatus according to the present embodiment.
[0015]
In the figure, an input unit 1 is a touch panel or the like for inputting information according to a designated position. The CPU 2 performs calculations for various processes, logical judgments, and the like, and controls each component connected to the bus 6. The output unit 3 is a display for displaying information, a printer for printing information, a modem for transmitting information, and the like.
[0016]
The program memory 4 is a memory for storing a program for control by the CPU 2 including processing procedures to be described later with reference to the flowchart. The program memory 4 may be a ROM or a RAM in which a program is loaded from an external storage device or the like.
[0017]
The data memory 5 stores data generated by various processes, and stores knowledge in the knowledge base described later. The data memory 5 may be a RAM, for example, but knowledge based knowledge is loaded from a nonvolatile external storage medium prior to processing or is referred to whenever necessary.
[0018]
The bus 6 transfers an address signal indicating a component to be controlled by the CPU 2, a control signal for controlling each component, and data exchanged between the components.
[0019]
[Embodiment 1]
FIG. 2 is a diagram illustrating an example of position input by a finger using a touch panel. As shown in the figure, the relationship between the two points is acquired and the input is understood from the trajectory from the start point to the end point of each of the two points A and B in contact with the finger.
[0020]
As in Example 1 (parallel direction), the distance between points does not change and the trajectory may be parallel. As an example of such input, a parallel movement of an object can be considered.
[0021]
As in Example 2 (inward direction), the locus of each point may be directed to the other point. Examples of such input include reduction or minimization of an object.
[0022]
Conversely, as in Example 3 (outward direction), the locus of each point may move away from the other. As an example of such input, enlargement or maximization of an object can be considered.
[0023]
FIG. 3 is a diagram illustrating an example of position input by a finger using a photographing apparatus such as a camera. Here, instead of directly touching the touch panel and giving an instruction, the fingertip is moved within the effective area 302 of the camera 301 as indicated by 303 and 304, thereby recognizing the picked-up instruction point (fingertip) position. The indicated position is detected.
[0024]
FIG. 4 is a flowchart showing a processing procedure using the locus of the designated position. In the figure, when an input is detected in step S401, if the end is not detected in the next step S402, the process proceeds to step S403, and the locus detection process is activated. Subsequently, in step S404, processing corresponding to the detected locus as input information is started.
[0025]
FIG. 5 is a flowchart showing the procedure of the locus detection process in step S403. In step S501, the designated position detection process is executed, and the coordinate data of the current designated position is acquired. Next, a combination specifying process is executed in step S502, and a combination of each current indicated position and the immediately preceding indicated position closest to each is specified. In the subsequent step S503, the designated position storage process is executed, and the current designated position is stored in the optimum designated position data table (the same table as the nearest previous position).
[0026]
FIG. 6 is a flowchart showing the procedure of the combination specifying process in step S502. In the figure, in step S601, a process for determining the distance between one of the current designated positions and the previous designated position is started. In the next step S602, the designated position immediately before the current designated position and the shortest distance. Specify the combination. In subsequent step S603, if there is a corresponding combination, the process proceeds to step S604, and the current designated position is added to the same table as the designated position immediately before the combination. This is repeated until there is no corresponding combination in step S603.
[0027]
FIG. 7 is a diagram illustrating an example of designated position data stored by the locus detection process. In the figure, the XY coordinate of the point At1 at time t1 is (3, 3) as shown in the graph 7001, and the XY coordinate of the point At5 at time t5 is (7, 5), corresponding to t1 to t5 during this time The coordinate data of points A and B are stored in tables 702 and 703, respectively.
[0028]
FIG. 8 is a diagram illustrating an example of the current designated position data acquired by the locus detection process. In the same figure, as shown in the graph 801, at the current time t6, there are a point a having the XY coordinates (8, 6) and a point b having the XY coordinates (8, 8) as designated positions. The acquired current (t6) position data is stored in the table 802.
[0029]
FIG. 9 is a diagram illustrating a flow of data used in the locus detection process for a plurality of designated positions. In the figure, a point a (8, 6) and a point b (8, 8) are acquired as the current indicated position data in the table 901. For each point that is the designated position, the distance to each previous designated position is acquired. In this case, for example, the distance 1.414 from the point a to the previous designated position At5 and the distance 4.123 from the previous designated position Bt5 are acquired.
[0030]
As a result, the point a is stored in the same table 903 as the designated position At5 immediately before the closest distance. Similarly, the point b is stored in the same table 904 as the previous designated position Bt5.
[0031]
FIG. 10 is a flowchart illustrating a procedure of trajectory detection processing using the size of the designated area. In the above-described example, the trajectory is obtained by assuming that each current designated position corresponds to the closest position among a plurality of immediately preceding designated positions, but here, each current designated position is a plurality of immediately preceding designated positions. The locus is obtained assuming that the designated area (for example, the contact area of the finger on the touch panel) corresponds to the nearest position among the designated positions.
[0032]
In the figure, the designated area detection process is activated in step S1001, and the current designated area is acquired. In step S1002, a combination specifying process is started, and a combination with the immediately preceding designated area closest to the current designated area is identified from the difference from the immediately preceding designated area. Subsequently, in step S1003, the designated area storage process is activated, and the current designated area data is stored in an optimum table (a table in which the designated area immediately before the current designated area is stored).
[0033]
FIG. 11 is a flowchart showing the procedure of the combination specifying process using the size of the designated area in step S1002. In the figure, in step S1101, a process for calculating the difference between the area of the current designated position and the area of each previous designated position is activated, and in the next step S1102, the instruction immediately before the current designated position closest to the area is started. Specify the combination with the position. If there is a corresponding combination in the subsequent step S1103, the process proceeds to step S1104, where the current designated position and designated area are added to the table of the designated position and designated area immediately before the closest area. This is repeated until there is no corresponding combination in step S1103.
[0034]
FIG. 12 is a diagram illustrating an example of the area of the current designated position acquired. In the graph 1201, the current designated position is at the point a (8, 6), and an enlarged view 1202 shows the touching state of the touch panel when the point a is designated. As a result, the area of the designated position is obtained.
[0035]
FIG. 13 is a diagram illustrating an example of the area data of the indicated position that is stored. In the same figure, as indicated by the graph 1301, the XY coordinate of the designated position point At1 at time t1 is (3, 3), the XY coordinate of the designated position point Bt1 is (12, 14), and the designated position point At5 at time t5 The XY coordinates of (7, 5) are XY coordinates of the designated position point Bt5 (8, 8). Furthermore, at the current time t6, there are a designated area 1 including the point a (8, 6) and a designated area 2 including the point b (8, 8) as the current designated area.
[0036]
In the table 1302, the area of the point A at time t1 is 12.5, and subsequently, area data of the point A corresponding to the time t2 to t5 is stored. Similarly, the area data of point B at each time is stored in the table 1303. Furthermore, the area data 11.5 including the point a and the area data 20.0 including the point b are stored in the table 1304 as the acquired instruction area data at the current time t6.
[0037]
FIG. 14 is a diagram illustrating a flow of data used in the trajectory acquisition process using the size of the designated area. In the same figure, an area 11.5 including the point a (8, 6) and an area 20.0 including the point b (8, 8) are acquired as the current indicated area data in the table 1401, and the current indicated position is obtained. The difference between each area data and the area data at each immediately preceding designated position is acquired in the table 1402. Here, with respect to the designated area 11.5 including the point a, a difference 0.5 from the previous designated area A and a difference 9.0 from the previous designated area B are acquired.
[0038]
As a result, the designated area data 11.5 including the point a is stored in the same table 1403 as the designated area A immediately before the smallest difference. Similarly, the designated area data including the point b is stored in the same table 1404 as the designated area B immediately before.
[0039]
[Embodiment 2]
In the present embodiment, a process for interpreting an operation to be performed based on a combination of movement trajectories of two or more designated positions acquired will be specifically described.
[0040]
FIG. 15 is a flowchart showing an operation procedure using a trajectory of a plurality of designated positions. In the figure, when an input is detected in step S1501, if the end is not detected in the next step S1502, the process proceeds to step S1503, and the movement locus detection process is activated. Next, in step S1504, instruction interpretation processing is activated, and in step S1505, processing corresponding to the instruction is activated.
[0041]
FIG. 16 is a flowchart showing a procedure of instruction interpretation processing in step S1504. In the figure, in step S1601, the distance measurement process between designated positions is started, and the distance between the current designated positions is measured. Next, proceeding to step S1602, the process for acquiring the distance change between the designated positions is activated, and the change in the distance between the designated positions is obtained. Subsequently, in step S1603, an instruction interpretation process based on the distance change is activated to interpret an operation to be performed in accordance with the acquired distance change.
[0042]
FIG. 17 is a flowchart showing the procedure for acquiring the change in distance between the designated positions in step S1602. In the figure, the distance between the designated positions at the start of movement is measured in step S1701, and then the distance between the designated positions at the end of movement is measured in step S1702. Next, proceeding to step S1703, the difference between the distance between the designated positions at the start of movement and the distance between the designated positions at the end of movement is acquired.
[0043]
FIG. 18 is a flowchart showing the procedure of the instruction interpretation process based on the distance change in step S1603. In the figure, if the amount of change is smaller than 0 in step S1801, it is interpreted as a reduction operation (step S1802). Similarly, when the change amount is larger than 0, it is interpreted as an enlargement operation (step S1803), and when the change amount is equal to 0, it is interpreted as other than the reduction or enlargement operation (step S1804).
[0044]
FIG. 19 is a flowchart showing another procedure of the instruction interpretation process based on the distance change. In the figure, in step S1901, the operation magnification is acquired from the distance change acquired by the distance change acquisition process between the designated positions. Next, the change rate is acquired in s1902, and then the actual magnification is acquired from the operation magnification and the change rate data in step S1903.
[0045]
Formula: Actual magnification = 100-(100-Operation magnification X) x Change rate α
FIG. 20 is a diagram illustrating an operation example that is interpreted as a reduction operation. In the figure, when the designated position points A and B at the start of movement t1 change to designated position points A 'and B' at the end of movement t5, it is interpreted as a reduction operation.
[0046]
FIG. 21 is a diagram illustrating an example of data interpreted as a reduction operation. In the figure, the XY coordinates of each indicated position on the graph 2101 are the point At1 (3,3) and the point Bt1 (12,10) at the start of movement t1, the point At5 (7,5) and the point at the end of movement t5. Bt5 (8,6). At this time, as shown in the table 2102, the distance between the designated positions A and B is 15.000 at the start of movement t1 and 1.118 at the end of movement t6. Between the designated positions between the start of movement t1 and the end of movement t5 The amount of change in the distance is -13.882. Further, the magnification of the change in distance between the designated positions between the movement start time t1 and the movement end time t5 is 7%.
[0047]
FIG. 22 is a diagram illustrating an operation example that is interpreted as an enlargement operation. In the figure, when the designated position point A and point B at the start of movement t1 change to the designated position point A 'and point B' at the end of movement t5, it is interpreted as an enlargement operation.
[0048]
FIG. 23 is a diagram illustrating an example of data interpreted as an enlargement operation. In the same figure, as indicated by graph 2301, the XY coordinates of each indicated position are point At1 (7,5), point Bt1 (8,6) at the start of movement t1, and point At5 (3,3) at the end of movement t5. , Point Bt5 (12, 10). At this time, as shown in the table 2302, the distance between the designated positions A and B is 1.118 at the start of movement t1 and 11.402 at the end of movement t6. Between the designated positions between the start of movement t1 and the end of movement t5 The amount of change in the distance is +13.586. Further, the magnification of the change in distance between the designated positions between the movement start time t1 and the movement end time t5 is 1020%.
[0049]
[Embodiment 3]
In the present embodiment, when an operation to be performed is interpreted from a combination of acquired movement loci of two or more designated positions, an angle between a line connecting the two designated positions and a reference line (hereinafter, simply referred to as “the operation path to be performed”). An example focusing on the change in the designated position angle will be described in detail.
[0050]
FIG. 24 is a diagram illustrating a flow of instruction interpretation processing using an angle change of the designated position. In the same figure, in step S2401, the angle measurement process of the designated position is started, and the angle of the designated position is measured at each time point. Next, proceeding to step S2402, the designated position angle change acquisition process is activated to obtain a change in the angle of the line connecting the designated positions. Subsequently, in step S2403, an instruction interpretation process based on the angle change is activated to interpret an operation to be performed according to the acquired angle change.
[0051]
FIG. 25 is a flowchart illustrating the procedure of the measurement process of the change in the angle of the designated position. In the figure, the angle of the line connecting the designated positions at the start of movement is measured in step S2501, and then the angle of the line connecting the designated positions at the end of movement is measured in step S2502. Next, proceeding to step S2503, the difference between the angle of the line connecting the designated positions at the start of movement and the angle of the line connecting the designated positions at the end of movement is acquired.
[0052]
FIG. 26 is a flowchart illustrating a procedure of instruction interpretation processing based on an angle change. In the figure, if the amount of change is greater than 0 ° in step S2601, it is interpreted as a left rotation operation (step S2602). Similarly, when the change amount is smaller than 0 °, it is interpreted as a right rotation operation (step S2603), and when the change amount is equal to 0 °, it is interpreted as other than the rotation operation (step S2604).
[0053]
FIG. 27 is a diagram illustrating an operation example that is interpreted as a clockwise rotation operation. In the figure, when the designated position point A and point B at the start of movement t1 change to the designated position point A 'and point B' at the end of movement t5, it is interpreted as a clockwise rotation operation.
[0054]
FIG. 28 is a diagram illustrating a data example that is interpreted as a right rotation operation among the angle of the line connecting the designated positions and the change data thereof. In the same figure, as shown in the graph 2801, the angle between the designated positions AB is 60 degrees with respect to the X axis at the movement start time t1, and is 26 degrees at the movement end time t5. At this time, as shown in the table 2802, the change amount of the angle between the designated positions between the movement start time t1 and the movement end time t5 is −34 °.
[0055]
FIG. 29 is a diagram illustrating an operation example interpreted as a left rotation operation. When the designated position point A and point B at the start of movement t1 change to the designated position point A 'and point B' at the end of movement t5, it is interpreted as a left rotation operation.
[0056]
FIG. 30 is a diagram illustrating an example of data interpreted as a left rotation operation among the data indicating the angle of the line connecting the designated positions and the change thereof. In the drawing, as shown in the graph 3001, the angle between the designated positions AB is 60 degrees with respect to the X axis at the movement start time t1, and is 87 degrees at the movement end time t5. At this time, as in the table 3002, the change amount of the angle between the designated positions between the movement start time t1 and the movement end time t5 is + 27 °.
[0057]
[Embodiment 4]
In the present embodiment, an example in which attention is paid to a change in the relationship between the fixed instruction position and the movement instruction position when interpreting an operation to be performed from a combination of movement trajectories of two or more acquired instruction positions will be specifically described. To do.
[0058]
FIG. 31 is a flowchart illustrating a procedure of instruction interpretation processing using the relationship between the fixed instruction position and the movement instruction position. In the figure, a fixed instruction position detection process is activated in step S3101, and a fixed instruction position is detected. Next, proceeding to step S3102, instruction interpretation processing based on the fixed instruction position is activated to interpret the operation to be performed.
[0059]
FIG. 32 is a flowchart showing the procedure of the fixed instruction position detection process in step S3101. In the figure, when the fixed designated position detection process is activated, the designated position at time t is detected in step S3201, and if position data exists in the subsequent step S3202, the process proceeds to the next step S3203, where the designated position is detected. Compare with the initial value. As a result, if the position data does not match, it is determined in step S3204 that the indicated position has moved. If the position data match, the process proceeds to step S3205, advances the time t, and repeats from step S3201. If position data does not exist in step S3202, it is determined in step S3206 that the designated position is fixed, and the fixed designated position is detected.
[0060]
FIG. 33 is a flowchart illustrating a procedure of instruction interpretation processing based on the moving direction. In the figure, in step S3301, designated position movement direction determination processing is activated, and the movement direction of the movement designated position is determined. In step S3302, the instruction operation is interpreted based on the determined moving direction.
[0061]
If the moving direction is up, the process proceeds to Step 3303 and is interpreted as the next item operation. In addition to this, there are cases where it is interpreted as a next page operation, a next screen operation, a last line operation, an upper screen moving operation, an enlargement operation only in the vertical direction, or a reduction operation only in the vertical direction. If the movement direction is down, the process proceeds to step 3304 and is interpreted as a previous item operation. In addition to this, there are cases where it is interpreted as a previous page operation, a previous screen operation, a first line operation, a lower screen moving operation, an enlargement operation only in the vertical direction, or a reduction operation only in the vertical direction.
[0062]
If the moving direction is left, the process proceeds to step 3305 and is interpreted as a next item operation. In addition to this, there are cases where it is interpreted as the next page operation, the next screen operation, the last line operation, the left screen movement operation, the enlargement operation only in the left-right direction, or the reduction operation only in the left-right direction. If the movement direction is right, the process proceeds to step 3306 and is interpreted as a previous item operation. In addition to this, there are cases where it is interpreted as a previous page operation, a previous screen operation, a first line operation, a right screen movement operation, an enlargement operation only in the horizontal direction, or a reduction operation only in the horizontal direction.
[0063]
FIG. 34 is a flowchart showing the procedure of the designated position movement direction determination process in step S3301. In the figure, the movement amount of the designated position is acquired in step S3401, and in the next step S3402, the movement direction is determined from the current coordinates of the movement designated position. At that time, the arctangent of the current coordinates (X, Y) of the movement instruction position is obtained, and the unit is converted from radians to degrees.
[0064]
FIG. 35 is a diagram illustrating the interpretation of the angles used in the designated position movement direction determination process. In the same figure, as indicated by 3501, 360 ° is divided into a Y-axis positive direction of 0 ° to 180 ° and a Y-axis negative direction of −1 ° to −179 ° with reference to the X axis.
[0065]
According to this, ± 35 ° (-35 ° to 35 °) is interpreted as the right direction with 0 ° as the center, ± 35 ° (65 ° to 135 °) is interpreted as the upward direction with 90 ° as the center, and 180 ° ± 35 ° (155 ° to 180 ° and -179 ° to -145 °) as the left direction with the center as the center, and ± 35 ° (-65 ° to -135 °) as the bottom direction from the center as -90 ° Interpret. Further, the range of ± 10 ° centered at 45 °, 135 °, -135 °, and -45 ° is interpreted as other operations.
[0066]
FIG. 36 is a diagram illustrating an operation example interpreted as a left movement operation. In the figure, when the fixed instruction position point A is fixed and the movement instruction position point B moves from Bt1 to point Bt5, it is interpreted as a left movement operation.
[0067]
FIG. 37 is a diagram illustrating an example of data interpreted as a left movement operation. In the same figure, the coordinates of the fixed designated position are point A (3, 3) as shown in graph 3701. The coordinates of the movement designated position are point Bt1 (6, 3) at the start of movement t1 and point at the end of movement t5. Bt5 (4,2). A table 3702 shows position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. 3703 indicates designated position movement data. The movement amount of the designated position at the end of movement t5 is 0 at the fixed designated position point A, 2.236 at the designated movement position point B, and the moving direction is −153.43 °. is there.
[0068]
FIG. 38 is a diagram illustrating an operation example that is interpreted as an upward movement operation. In the figure, when the fixed instruction position point A is fixed and the movement instruction position point B moves from Bt1 to point Bt5, it is interpreted as an upward movement operation.
[0069]
FIG. 39 is a diagram illustrating an example of data when interpreted as an upward movement operation. In the same figure, the coordinates of the fixed designated position are point A (6, 6) as shown in graph 3901. The coordinates of the movement designated position are point Bt1 (5, 1) at the start of movement t1 and point at the end of movement t5. Bt5 (7,4). The table 3902 shows position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. Table 3903 shows the designated position movement data. The movement amount of the designated position at the end of movement t5 is 0 at the fixed designated position point A, 3.606 at the designated movement position point B, and the moving direction is 56.31 °. is there.
[0070]
FIG. 40 is a diagram illustrating an operation example that is interpreted as a downward movement operation. In the figure, when the fixed instruction position point A is fixed and the movement instruction position point B moves from Bt1 to point Bt5, it is interpreted as a downward movement operation.
[0071]
FIG. 41 is a diagram illustrating an example of data interpreted as a downward movement operation. In the same figure, the coordinates of the fixed designated position are point A (3, 3) as shown in graph 4101. The coordinates of the movement designated position are point Bt1 (5, 8) at the start of movement t1 and point at the end of movement t5. Bt5 (5,5). A table 4102 shows position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. The table 4103 shows the designated position movement data. The movement amount of the designated position at the time t5 at the end of movement is 0 for the fixed designated position point A, 3.000 for the designated movement position point B, and the moving direction is -90 °.
[0072]
FIG. 42 is a diagram illustrating an operation example that is interpreted as a right movement operation. In the figure, when the fixed instruction position A is fixed and the movement instruction position point B moves from Bt1 to Bt5 like 4201, it is interpreted as a right movement operation.
[0073]
FIG. 43 is a diagram illustrating an example of data interpreted as a right movement operation. In the same figure, the coordinates of the fixed instruction position are point A (6, 6) as shown in graph 4301. The coordinates of the movement instruction position are points Bt1 (2, 6) at the start of movement t1 and points at the end of movement t5. Bt5 (5,5). A table 4302 shows position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. Table 4303 shows the designated position movement data. The movement amount of the designated position at the end of movement t5 is 0 at the fixed designated position point A, 3.162 at the designated movement position point B, and the moving direction is -18.43 °. It is.
[0074]
[Embodiment 5]
In this embodiment, an example in which attention is paid to a change in distance between a fixed instruction position and a movement instruction position when an operation to be performed from a combination of movement trajectories of two or more acquired instruction positions is interpreted will be specifically described. .
[0075]
FIG. 44 is a flowchart showing a procedure of instruction interpretation processing using a change in distance between the fixed instruction position and the movement instruction position. In the same figure, when the instruction interpretation process is activated, the distance measurement process between designated positions is activated in step S4401, and the distance at each time point between the fixed designated position and the movement designated position is measured. Next, proceeding to step S4402, the distance change between the designated positions is obtained by the distance change obtaining process between designated positions. In the following step S4403, an instruction interpretation process based on the change in the indicated position distance is activated, and an operation to be performed is interpreted in response to the obtained change in the distance between the indicated positions.
[0076]
FIG. 45 is a flowchart showing a procedure of instruction interpretation processing based on a change in distance between designated positions in step S4403. In the figure, the amount of change is determined in step S4501, and when the amount of change is decreasing, it is interpreted as a reduction operation (step S4502), and when the amount of change is increasing, it is interpreted as an enlargement operation (step S4503).
[0077]
FIG. 46 is a diagram illustrating an operation example that is interpreted as a reduction operation. In the figure, when the fixed instruction position (point A) is fixed and the movement instruction position (point B) moves from point Bt1 to point Bt5 in the direction of the fixed instruction position (point A), the reduction operation is performed. It is interpreted as
[0078]
FIG. 47 is a diagram illustrating an example of data when interpreted as a reduction operation. In the same figure, the coordinates of the fixed designated position are point A (3, 3) as shown in graph 4701. The coordinates of the movement designated position are point Bt1 (6, 3) at the start of movement t1 and point at the end of movement t5. Bt5 (4,2). A table 4702 shows position data of the fixed instruction position point A and the movement instruction position point B from time t1 to time t5. A table 4703 shows distance change data between designated positions. The distance between designated positions AB at the start of movement t1 is 3.000, and the distance between designated positions AB at the end of movement t5 is 1.414. The magnification of the distance between positions AB from t1 to t5 is 47%.
[0079]
FIG. 48 is a diagram illustrating an operation example that is interpreted as an enlargement operation. In the figure, when the fixed instruction position point A is fixed and the movement instruction position point B moves from Bt1 to the point Bt5 in the opposite direction to the fixed instruction position point A, it is interpreted as an enlargement operation. The
[0080]
FIG. 49 is a diagram illustrating an example of data when interpreted as a reduction operation. In the same figure, the coordinates of the fixed indication position are point A (3, 3) as shown in graph 4901. The coordinates of the movement indication position are point Bt1 (4, 2) at the start of movement t1 and point at the end of movement t5. Bt5 (6,3). A table 4902 shows position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. Table 4903 shows distance change data between the fixed designated positions, the distance between the designated positions AB at the start of movement t1 is 1.414, and the distance between the designated positions AB at the end of movement t3 is 3.000. The magnification of the distance between the pointing positions AB from t1 to t5 is 212%.
[0081]
FIG. 50 is a diagram illustrating an operation example that is interpreted as a reduction operation centered on the fixed instruction position. In the figure, the fixed instruction position point A is fixed, and there is a movement instruction position 1 point Bt1 and a movement instruction position 2 points Ct1 as in 5001, and toward the direction of the fixed instruction position point A as in 5002. When the movement instruction position 1 point Bt1 moves to Bt5 and the movement instruction position 2 point Ct1 moves to point Ct5, it is interpreted as a reduction operation in the direction of the fixed instruction position point A, respectively.
[0082]
FIG. 51 is a diagram illustrating an example of data when interpreted as a reduction operation centered on the fixed instruction position. In the same figure, the coordinate of the fixed designated position is the point A (3, 3) as in the graph 5101, and the coordinate of the point B which is the movement designated position 1 is the point Bt1 (4, 8) at the start of movement t1, the movement At the end t5, the point Bt5 (5,5) is the point C. The coordinates of the point C as the movement instruction position 2 are the point Ct1 (2,2) at the start of movement t1, and the point Ct5 (4,3.5) at the end of movement t5. It is. A table 5102 shows position data of the fixed instruction position point A, the movement instruction position 1 point B, and the movement instruction position 2 points C from t1 to t5.
[0083]
The table 5103 shows distance change data between the fixed indication positions. In the indication position distance change data 1, the distance between the indication positions AB at the start of movement t1 is 5.099, and the indication position at the end of movement t5. The distance between AB is 2.828, and the magnification of the distance between the indicated positions AB from t1 to t5 is 55%. Further, in the distance change data 2 between the designated positions, the distance between the designated positions AC at the start of movement t1 is 1.414, the distance between the designated positions AC at the end of movement t5 is 1.118, and the distance between the designated positions AC The magnification from t1 to t5 is 79%.
[0084]
[Embodiment 6]
In the present embodiment, when interpreting an operation to be performed from a combination of movement trajectories of two or more designated positions acquired, an example focusing on the presence of a fixed designated position and a change in distance between other movement designated positions This will be specifically described.
[0085]
FIG. 52 is a flowchart illustrating a procedure of processing using the distance between the movement instruction positions. In the figure, when the fixed instruction position corresponding instruction interpretation process is activated, the movement instruction position distance measurement process is activated in step S5201, and the distance between the current movement instruction positions is measured. Next, proceeding to step S5202, the movement instruction position distance change acquisition process is activated to acquire the acquired distance change amount. Subsequently, in step S5203, an instruction interpretation process based on a change in the distance between the movement instruction positions is started, and an operation to be performed is interpreted based on the obtained change amount of the distance between the movement instruction positions.
[0086]
FIG. 53 is a flowchart illustrating a procedure of instruction interpretation processing based on a change in distance between movement instruction positions. In the figure, if there is a fixed instruction position in step S5301, the process proceeds to step S5302, and if the change amount is smaller than 0, it is interpreted as a reduction operation for the fixed instruction position in step S5303. If the amount of change is greater than 0, it is interpreted as an enlargement operation for the fixed designated position in step S5304. If the amount of change is equal to 0, it is interpreted as other than a reduction or enlargement operation in step S5305. If the presence of the fixed instruction position is not confirmed in step S5301, the process proceeds to step S5306 and is interpreted as an operation for the whole.
[0087]
FIG. 54 is a diagram illustrating an operation example that is interpreted as a reduction operation centered on the fixed instruction position. In the figure, the fixed instruction position point A is fixed, and there are two movement instruction position points Bt1 and a movement instruction position point Ct1, and these move instruction position points Bt1 are in the direction of the fixed instruction position point A. When the movement instruction position point Ct1 moves to the point Ct5 to Bt5, it is interpreted as a reduction operation centered on the fixed instruction position point A according to the amount of change in the distance between the movement instruction positions.
[0088]
FIG. 55 is a diagram illustrating an example of data when interpreted as a reduction operation centered on the fixed instruction position. In the same figure, the coordinate of the fixed designated position is point A (3, 3) as in graph 5501, the coordinate of the movement designated position point B is point Bt1 (4, 8) at the start of movement t1, and t5 at the end of movement. Is the point Bt5 (5, 5), and the coordinates of the movement instruction position point C are the point Ct1 (3, 2) at the start of movement t1, and the point Ct5 (4, 2.8) at the end of movement t5.
[0089]
A table 5502 shows position data of the fixed instruction position point A, the movement instruction position point B, and the movement instruction position point C from t1 to t5. The table 5503 shows the distance change data between the movement instruction positions. In the distance change data between the instruction positions, the distance between the instruction positions BC at the start of movement t1 is 6.083, and the instruction position BC at the end of movement t5. The distance between them is 2.417, and the amount of change of the distance between the designated positions BC from t1 to t5 is 40%.
[0090]
FIG. 56 is a diagram illustrating an operation example that is interpreted as an enlargement operation centered on the fixed instruction position. In the figure, the fixed instruction position point A is fixed, and there are a movement instruction position 1 point Bt1 and a movement instruction position 2 points Ct1, and these move toward the fixed instruction position point A and move instruction position 1 point Bt1. Is moved to Bt5 and the movement instruction position 2 point Ct1 is moved to point Ct5, it is interpreted as an enlargement operation centered on the fixed instruction position point A according to the ratio of the distance between the movement instruction positions.
[0091]
FIG. 57 is a diagram illustrating an example of data when interpreted as an enlargement operation centered on the fixed instruction position. In the same figure, the coordinate of the fixed designated position is the point A (3, 3) as in the graph 5701, and the coordinate of the point B which is the movement designated position 1 is the point Bt1 (5, 5) at the start of movement t1, the movement At the end time t5, the point Bt5 (4, 8) is the point C. The coordinates of the point C which is the movement instruction position 2 are the point Ct1 (4, 2.8) at the movement start time t1, and the point Ct5 (2, 2) at the movement end t5 It is.
[0092]
A table 5702 shows position data of the fixed instruction position point A, the movement instruction position 1 point B, and the movement instruction position 2 points C from t1 to t5. The table 5703 shows distance change data between movement instruction positions. In the distance change data 1 between instruction positions, the distance between the instruction positions BC at the start of movement t1 is 2.417, and the instruction position at the end of movement t5. The distance between BC is 6.325, and the amount of change from t1 to t5 of the distance between the designated positions BC is 262%.
[0093]
FIG. 58 is a diagram illustrating an operation example that is interpreted as a plurality of movement instruction operations centered on the fixed instruction position. In the figure, the fixed instruction position point A is fixed, and there are a movement instruction position 1 point Bt1, a movement instruction position 2 points Ct1, and a movement instruction position 3 points Dt1 as in 5801, and a fixed instruction position as 5802. In the direction of point A, if the movement instruction position 1 point Bt1 moves to Bt5, the movement instruction position 2 point Ct1 moves to point Ct5, and the movement instruction position 3 point Dt1 moves to point Dt5, the distance between the movement instruction positions Is interpreted as a plurality of movement instruction operations centered on the fixed instruction position point A.
[0094]
FIG. 59 is a diagram illustrating an example of data when interpreted as a plurality of movement instruction operations centered on the fixed instruction position. In the same figure, the coordinate of the fixed designated position is point A (3, 3) as shown in graph 5901, and the coordinate of point B, which is the movement designated position 1, is point Bt1 (5, 5) and moved at the start of movement t1. At the end time t5, the point Bt5 (4, 8) is the point C. The coordinates of the point C which is the movement instruction position 2 are the point Ct1 (4, 3.5) at the movement start time t1, and the point Ct5 (2, 2) at the movement end t5. The coordinates of the point D which is the movement instruction position 3 are the point Dt1 (5.5, 4.5) at the start of movement t1 and the point Dt5 (6, 9) at the end of movement t5.
[0095]
A table 5902 shows position data of the fixed instruction position point A, the three movement instruction position points B, the movement instruction position point C, and the movement instruction position point D from t1 to t5. The table 5903 shows the distance change data between the movement instruction positions. In the distance change data 1 between the instruction position, the distance between the instruction positions BC at the start of movement t1 is 1.803, and the instruction position at the end of movement t5. The distance between BCs is 6.325, and the amount of change in the distance between the designated positions BC from t1 to t5 is 352%. In the distance change data 2 between designated positions, the distance between the designated positions BD at the start of movement t1 is 0.707, the distance between the designated positions BD at the end of movement t5 is 2.236, and from the distance t1 between the designated positions BC The amount of change with respect to t5 is 316%. In the distance change data 3 between the designated positions, the distance between the designated positions CD at the start of movement t1 is 1.803, the distance between the designated positions CD at the end of movement t5 is 8.062, and the distance between the designated positions BC is t1. The amount of change with respect to t5 is 447%.
[0096]
[Embodiment 7]
In the present embodiment, when interpreting an operation to be performed from a combination of movement trajectories of two or more acquired instruction positions, an angle with respect to a horizontal direction of a line connecting the fixed instruction position and the movement instruction position (hereinafter referred to as an instruction position). An example focusing on the change in the angle (referred to as the angle between) will be described in detail.
[0097]
FIG. 60 is a flowchart illustrating a procedure of processing using an angle change between designated positions. In the figure, an angle measurement process between designated positions is started in step S6001, and an angle between designated positions is measured. Next, proceeding to step S6002, the fixed instruction position angle change acquisition process is activated, and the acquired change amount of the angle is acquired. Subsequently, in step S6003, an instruction interpretation process based on an angle change between the indicated positions is activated, and an operation to be performed is interpreted according to the acquired angle change.
[0098]
FIG. 61 is a flowchart showing the procedure of the instruction interpretation process based on the change in angle between the instruction positions. In the figure, if there is no fixed instruction position in step S6101, the process proceeds to step S6106 and is interpreted as an operation for the whole. If the fixed instruction position exists in step S6101, the process proceeds to step S6102, and if the change amount is smaller than 0 °, the process proceeds to step S6104, which is interpreted as a clockwise rotation operation centered on the fixed instruction position. If the amount of change is greater than 0 °, the process proceeds to step S6103, where it is interpreted as a left rotation operation centered on the fixed instruction position. If the amount of change is equal to 0 °, it is interpreted as a deformation operation in the rotation direction in a state other than the rotation operation or with the fixed instruction position fixed in step S6105.
[0099]
FIG. 62 is a diagram illustrating an operation example that is interpreted as a clockwise rotation operation. In the figure, the fixed instruction position point A is fixed, and since it has changed from the movement instruction position point Bt1 at the start of movement t1 to the movement instruction position point Bt5 at the end of movement, it is interpreted as a clockwise rotation operation. Is done.
[0100]
FIG. 63 is a diagram illustrating an example of data when interpreted as a right rotation operation. In the figure, the angle of the straight line connecting the fixed instruction position point A and the movement instruction position point B to the horizontal line as shown in the graph 6301 is 71.57 ° at the start of movement t1 and 18.43 ° at the end of movement t5. . Tables 6302A and B show position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. The table 6303 shows the angle change data between the designated positions. In the angle change data between the designated positions, the amount of change in the angle between the fixed designated positions at the end of movement t5 is −53.13 °.
[0101]
FIG. 64 is a diagram illustrating an operation example interpreted as a left rotation operation. In the same figure, if the fixed instruction position point A is fixed and changes from the movement instruction position point Bt1 at the start of movement t1 to the movement instruction position point Bt5 at the end of movement, it is interpreted as a left rotation operation. Is done.
[0102]
FIG. 65 is a diagram illustrating an example of data when interpreted as a left rotation operation. In the same figure, the angle of the movement instruction position point B with respect to the fixed instruction position point A is 71.57 ° at the movement start time t1 and 108.43 ° at the movement end time t5 as shown in the graph 6501. Tables 6502A and B show position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. Table 6503 shows angle change data between the fixed instruction positions. In the angle change data between the fixed instruction positions, the amount of change in the angle between the fixed instruction positions at the end of movement t5 is + 36.87 °.
[0103]
[Embodiment 8]
In this embodiment, when interpreting an operation to be performed from a combination of movement trajectories of two or more designated positions acquired, an angle of a line connecting the two movement designated positions with respect to a horizontal line (hereinafter referred to as an angle of the movement designated position). An example of paying attention to the change will be described in detail.
[0104]
FIG. 66 is a flowchart illustrating a procedure of processing using the change in the angle of the movement instruction position. In the figure, an angle measurement process of the movement instruction position is started in step S6601, and the angle of the instruction position other than the fixed instruction position is measured. Next, in step S6602, an angle change acquisition process for the movement instruction position is activated to acquire the angle change amount. Subsequently, in step S6603, an instruction interpretation process based on the angle change of the movement instruction position is started, and an operation to be performed is interpreted based on the acquired angle change.
[0105]
FIG. 67 is a flowchart showing the procedure of the instruction interpretation process based on the change in the angle of the movement instruction position. In the figure, if there is no fixed instruction position in step S6701, the process proceeds to step S6706 and is interpreted as an operation for the whole. If the fixed instruction position exists in step S6701, the amount of change is checked in step S6702. If the amount of change is smaller than 0 °, the process proceeds to step S6704, and is interpreted as a right rotation operation centered on the fixed instruction position. If the amount of change is greater than 0 °, the process proceeds to step S6703, where it is interpreted as a left rotation operation centered on the fixed instruction position. If the amount of change is equal to 0 °, the process proceeds to step S6705 and is interpreted as other than a rotation operation. Or it interprets as a deformation | transformation operation to the rotation direction centering on the gravity center of the movement instruction | indication position in the state which fixed the fixation instruction | indication position.
[0106]
FIG. 68 is a diagram illustrating an operation example that is interpreted as a clockwise rotation operation. In the figure, the fixed instruction position point A is fixed, and there is a movement instruction position 1 point Bt1 and a movement instruction position point Ct1, the movement instruction position 1 point Bt1 to Bt5, and the movement instruction position 2 point Ct1 to point Ct5. Is interpreted as a clockwise rotation operation.
[0107]
FIG. 69 is a diagram illustrating an example of data when interpreted as a right rotation operation. In the same figure, the coordinate of the fixed designated position is point A (3, 3) as in graph 6901, the coordinate of the movement designated position point B is point Bt1 (4, 6) at the start of movement t1, and t5 at the end of movement. Is the point Bt5 (6, 4), and the coordinates of the movement instruction position point C are the point Ct1 (2, 1) at the start of movement t1 and the point Ct5 (1, 2) at the end of movement t5. A table 6902 shows position data of the fixed instruction position point A, the movement instruction position 1 point B, and the movement instruction position 2 points C from t1 to t5. The table 6903 shows angle change data between movement instruction positions. In the movement instruction position angle change data, the angle between movement instruction positions is 68.20 ° at the start of movement t1 and 36.87 ° at the end of movement t5. The change amount of the angle between the movement instruction positions is −31.33 °.
[0108]
FIG. 70 is a diagram illustrating an operation example interpreted as a left rotation operation. In the figure, when the fixed instruction position point A is fixed, there are movement instruction position points Bt1 and Ct1, the movement instruction position point Bt1 moves to Bt5, and the movement instruction position point Ct1 moves to the point Ct5. Interpreted as an operation.
[0109]
FIG. 71 is a diagram illustrating an example of data when interpreted as a left rotation operation. In the same figure, the coordinate of the fixed designated position is point A (3, 3) as shown in graph 7101, the coordinate of point B which is the movement designated position is point Bt1 (4, 6) at the start of movement t1, and the movement is completed At the time t5, the point Bt5 (2, 5) is the point C, which is the movement instruction position, at the start point t1, the point Ct1 (2, 1), and at the end point t5, the point Ct5 (2.5, 2). . The table 7102 shows position data of the fixed instruction position point A and the movement instruction position points B and C from t1 to t5. Table 7103 shows the angle change data between the movement instruction positions. In the movement instruction position angle change data, the angle between movement instruction positions is 68.20 ° at the start of movement t1 and 99.46 ° at the end of movement t5. The change amount of the angle between the movement instruction positions is + 31.26 °.
[0110]
FIG. 72 is a diagram illustrating an operation example in which three movement instruction positions are interpreted as a rotation operation centered on the center of gravity. In the figure, the fixed instruction position point A is fixed, there are movement instruction position points Bt1, Ct1, and Dt1, the movement instruction position point Bt1 to Bt5, the movement instruction position point Ct1 to the point Ct5, and the movement instruction position point. When Dt1 moves to point Dt5, it is interpreted as a rotation operation centered on the center of gravity.
[0111]
FIG. 73 is a diagram illustrating an example of data when interpreted as a rotation operation centered on the center of gravity. In the same figure, the coordinate of the fixed instruction position is the point A (3, 3) as in the graph 7301, the coordinate of the point B which is the movement instruction position is the point Bt1 (5, 5) at the start of movement t1, and the movement is completed. At time t5, it is point Bt5 (4,8), and the coordinates of point C as the movement instruction position are point Ct1 (4,3.5) at the start of movement t1, and point Ct5 (2,2) at the end of movement t5. The coordinates of the point D as the movement instruction position are the point Dt1 (5.5, 4.5) at the start of movement t1 and the point Dt5 (6, 9) at the end of movement t5. A table 7302 shows position data of the fixed instruction position point A and the movement instruction position points B, C, and D from t1 to t5. Table 7303 shows distance change data between movement instruction positions. The distance between movement instruction positions BC is 1.803 at the start of movement t1 and 6.325 at the end of movement t5. The scaling factor is 351%. The distance between the movement instruction positions BD is 0.707 at the start of movement t1 and 2.236 at the movement end t5, and the scaling factor of the distance between the movement instruction positions is 316%. The distance between the movement instruction positions CD is 1.803 at the start of movement t1 and 8.062 at the end of movement t5, and the scaling factor of the distance between the movement instruction positions is 447%.
[0112]
[Embodiment 9]
In the present embodiment, an example in which attention is paid to the positional relationship between a plurality of designated positions when interpreting an operation to be performed from a combination of movement loci of two or more designated positions acquired will be specifically described.
[0113]
FIG. 74 is a flowchart showing a procedure of processing using the positional relationship between the designated positions. In the figure, in step S7401, the positional relationship determination process of the designated positions is started, and the positional relationship between the designated positions is determined. Next, proceeding to step S7402, an instruction interpretation process based on the positional relationship between the indicated positions is started, and an operation to be performed is interpreted according to the determined positional relationship.
[0114]
FIG. 75 is a flowchart showing the procedure of the positional relationship determination process between designated positions in step S7401. In the figure, the angle between the designated positions is acquired in step S7501. Subsequently, in step S7502, if the acquired angle is between 45 ° and 135 ° centered on 90 °, or between −45 ° and −135 ° centered on −90 °, the indicated position Inter-positional relationship is interpreted as a vertical relationship. When the angle is between 45 ° and −45 ° centered on 0 ° or between 135 ° and −135 ° centered on 180 °, the positional relationship between the indicated positions is interpreted as a left-right relationship. The interpretation of the angle is as shown in FIG.
[0115]
FIG. 76 is a flowchart showing the procedure of instruction interpretation processing based on the positional relationship of the designated positions in step S7402. In the figure, the designated position movement range acquisition process is activated in step S7601, and the movement target range of the designated position is obtained. Next, the positional relationship is determined in step S7602, and if the positional relationship is a vertical relationship, the process proceeds to step S7603 and is interpreted as a cut operation instruction or a delete operation instruction. If the positional relationship is left and right, the process proceeds to step S7604 and is interpreted as a copy operation instruction.
[0116]
FIG. 77 is a diagram illustrating an operation example that is interpreted as an up / down relation movement operation. In the figure, when the designated position moves from the designated position point At1 to the point At5 and from the designated position point Bt1 to the point Bt5, it is interpreted as a vertical movement operation.
[0117]
FIG. 78 is a diagram illustrating an example of data when interpreted as an up-and-down relation movement operation. In the same figure, when the coordinates of each indicated position at the start of movement t1 are point At1 (4, 5) and point Bt1 (3, 8) as shown in graph 7801, angle t1 representing the positional relationship between the indicated positions is When the coordinates of each indicated position at the end of movement t5 are 108.43 ° and the coordinates of the point At5 (8,5) and Bt5 (7,8) are the angle t5 representing the positional relationship between the indicated positions is 108.43 °. . The table 7802 shows the position data of the designated position point A and the designated position point B from t1 to t5. The table 7803 shows angle data representing the positional relationship between the designated positions. In the positional relationship data between the designated positions, the angles between the designated positions from t1 to t5 are stored.
[0118]
FIG. 79 is a diagram illustrating an operation example that is interpreted as a left-right relation movement operation. In the figure, when each designated position moves from the designated position point At1 to the point At5 and from the designated position point Bt1 to the point Bt5, it is interpreted as a left-right related movement operation.
[0119]
FIG. 80 is a diagram illustrating an example of data when interpreted as a left / right movement operation. In the same figure, as in graph 8001, when the coordinates of each indicated position at the start of movement t1 are point At1 (3, 8) and point Bt1 (5, 9), angle t1 representing the positional relationship between the indicated positions Is 26.57 °, and when the coordinates of each indicated position at the end of movement t5 are point At5 (7, 8) and point Bt5 (9, 9), the angle t5 representing the positional relationship between the indicated positions is 26.57 °. is there. The table 8002 shows the position data of the designated position point A and the designated position point B from t1 to t5.
[0120]
The table 8003 shows angle data representing the positional relationship between the designated positions, and the angle between the designated positions from t1 to t5 is stored in the positional relationship data between the designated positions.
[0121]
[Embodiment 10]
In the present embodiment, an example will be specifically described in which attention is paid to a change in the positional relationship between designated positions when an operation to be performed is interpreted from a combination of movement loci of two or more designated positions acquired.
[0122]
FIG. 81 is a flowchart showing the procedure of the instruction interpretation process based on the positional relationship between the instruction positions. In the figure, a positional relationship change determination process between designated positions is started in step S8101, and a positional relationship change between designated positions is determined. Next, proceeding to step S8102, an instruction interpretation process based on the positional relationship change is activated, and an operation to be performed is interpreted according to the determined positional relationship change data.
[0123]
FIG. 82 is a flowchart showing a procedure of instruction interpretation processing based on the positional relationship change. In the figure, in step S8201, the inversion angle change amount is checked, and if the acquired angle change amount is the inversion angle change amount, the process proceeds to step S8202, and as an arbitrary inversion operation, deletion, or cut instruction operation Interpret. If the angle change amount is not the reverse angle change amount in step S8201, the process proceeds to step S8203, the X-direction position change is checked, and if each indicated position is reversed left and right, the process proceeds to step S8204, Interpret as reverse operation, delete, or cut instruction operation.
[0124]
In step S8203, if it is not left-right reversal, the change in the Y-direction position is checked in step S8205. If each acquired indicated position is up-down reversal, the process proceeds to step S8206, and up-down reversing operation, or Interpret as a delete or cut instruction operation. If NO in step S8205, the flow advances to step S8207 to interpret as an enlargement or reduction instruction operation.
[0125]
FIG. 83 is a flowchart showing the procedure of the instruction position relationship change acquisition processing.
In the figure, an angle measurement process between designated positions is started in step S8301, and an angle between designated positions is measured. Next, in step S8302, an angle change acquisition process between indicated positions is activated to acquire an angle change between indicated positions.In the subsequent step S8303, if the acquired angle change is within a constant range of 180 °, Proceeding to step S8304, the positional relationship change between indicated positions is interpreted as reverse rotation.
[0126]
In step S8303, if the obtained angle change is not within the 180 ° symmetrical fixed range, the process proceeds to step S8305, where the horizontal positional relationship determination process between the indicated positions is activated, and the horizontal positional relationship between the indicated positions is determined. To be acquired. In the next step S8306, the horizontal positional relationship change determination process between the indicated positions is activated, and the horizontal positional relationship change between the indicated positions is acquired.In the subsequent step S8307, if the acquired horizontal positional relationship is negative, Proceeding to step S8308, a change in positional relationship between indicated positions is acquired as left-right reverse.
[0127]
In step S8307, if the obtained horizontal positional relationship change is positive, the process proceeds to step S8309, and the vertical positional relationship determination processing between designated positions is started, and the vertical positional relationship between designated positions is obtained. . In the next step S8310, the vertical positional relationship change determination process between designated positions is started, and the vertical positional relationship change between designated positions is acquired.In the subsequent step S8311, if the acquired vertical positional relationship is negative, Proceeding to step S8312, the change in positional relationship between indicated positions is acquired as upside down. On the other hand, in step S8311, if the acquired vertical positional relationship change is positive, the process proceeds to step S8313, and the positional relationship between the indicated positions is acquired as no change.
[0128]
FIG. 84 is a diagram illustrating an operation example interpreted as a reversal operation. In the figure, when the designated position moves from the designated position point At1 to the point At5 and from the designated position point Bt1 to the point Bt5, it is interpreted as a reversal operation.
[0129]
FIG. 85 is a diagram illustrating an example of data when interpreted as a reversal operation. In the same figure, when the coordinates of each indicated position at the start of movement t1 are point At1 (4, 10) and point Bt1 (8, 11) as in graph 8501, the angle t1 of point A with respect to point B is 14.04 °. When the coordinates of each indicated position at the end of movement t5 are point At5 (8, 4) and point Bt5 (4, 3), angle t5 is -165.96. A table 8502 shows position data of the designated position points A and B from t1 to t5. The table 8503 shows the positional relationship between the indicated positions. In the positional relationship change data, the positional relationship change based on the X direction position change, the Y direction position change, and the indicated position angle between the indicated positions from t1 to t5. The amount is stored. In this case, the positional relationship change amount is 180 °, and the positions of the designated position point A and the designated position point B are reversed.
[0130]
FIG. 86 is a diagram illustrating an operation example that is interpreted as a left / right reversal operation. In the figure, when the designated position moves from the point At1 to the point At5 and from the point Bt1 to the point Bt5, it is interpreted as a left-right reversing operation.
[0131]
FIG. 87 is a diagram illustrating an example of data when interpreted as a left / right reversing operation. In the figure, when the coordinates of each indicated position at the start of movement t1 are point At1 (10, 10) and point Bt1 (11, 13) as shown in graph 8701, the angle t1 of point A with respect to point B is 71.57 °. When the coordinates of each indicated position at the end of movement t5 are point At5 (9, 3) and point Bt5 (8, 5), angle t5 is 116.57 °. The table 8702 shows the position data of the designated position points A and B from t1 to t5. The table 8703 shows the positional relationship between the indicated positions. In the positional relationship change data, the positional relationship change based on the X-direction position change, the Y-direction position change, and the indicated position angle between the indicated positions from t1 to t5. The amount is stored. In this case, the positional relationship in the X direction changes from negative to positive, and the positions of the designated position points A and B are reversed left and right.
[0132]
FIG. 88 is a diagram illustrating an operation example that is interpreted as an upside down operation. In the figure, when the designated position moves from the point At1 to the point At5 and from the point Bt1 to the point Bt5, it is interpreted as an upside down operation.
[0133]
FIG. 89 is a diagram illustrating an example of data when interpreted as an upside down operation. In the same figure, when the coordinates of each indicated position at the start of movement t1 are point At1 (5,12) and point Bt1 (7,15) as in graph 8901, angle t1 of point A with respect to point B is 56.31 °. When the coordinates of each indicated position at the end of movement t5 are point At5 (5, 2) and point Bt5 (6, 1), angle t5 is −45.00 °. The table 8902 shows the position data of the designated position points A and B from t1 to t5. The table 8903 shows the positional relationship between the designated positions. In the positional relationship change data, the positional relationship change based on the Y-direction position change, the Y-direction position change, and the designated position angle between the designated positions from t1 to t5. The amount is stored. In this case, the positional relationship in the Y direction changes from negative to positive, and the positions of the designated position points A and B are inverted up and down.
[0134]
[Embodiment 11]
In the present embodiment, an example of paying attention to the positional relationship between the fixed instruction position and the movement instruction position when interpreting the operation to be performed from the combination of the movement trajectories of the acquired two or more instruction positions will be specifically described. .
[0135]
FIG. 90 is a flowchart illustrating the procedure of the positional relationship acquisition processing between designated positions. In the figure, a fixed designated position detection process is activated in step S9001, and a fixed designated position is detected. Next, proceeding to step S9002, the positional relationship determination process for the fixed instruction position is started, and the positional relationship between the detected fixed instruction position and the movement instruction position is acquired.
[0136]
FIG. 91 is a flowchart showing a procedure of instruction interpretation processing based on the positional relationship with respect to the fixed instruction position. In the figure, in step S9101, the position relationship correspondence instruction interpretation process between the fixed and fixed instruction positions is started, and an operation to be performed is interpreted according to the determined position relationship data.
[0137]
FIG. 92 is a flowchart showing a detailed procedure of instruction interpretation processing based on the positional relationship with respect to the fixed instruction position. In the figure, the designated position movement direction acquisition process is activated in step S9201, and the movement direction of the movement designated position is obtained. In the subsequent step S9202, the moving direction is determined. If the movement direction is left, the process proceeds to step S9203.
[0138]
In step S9203, if the positional relationship to the fixed instruction position is on the right side, the process proceeds to step S9207, and the operation to be performed is the next item operation, next page operation, next screen operation, last line operation, or left / right direction. This is interpreted as a reduction operation only. If the positional relationship is the left side in step S9203, the process proceeds to step S9208, and is interpreted as an operation to be performed on the left screen movement operation or an enlargement operation only in the left-right direction. In step S9203, if the positional relationship is on the upper side, the process proceeds to step S9209, and is interpreted as an operation left rotation operation to be performed. If the positional relationship is lower in step S9203, the process proceeds to step S9210, and the operation to be performed is interpreted as a right rotation operation.
[0139]
On the other hand, if the moving direction is up in step S9202, the process proceeds to step S9204. If the positional relationship with respect to the fixed instruction position is on the right side, the process proceeds to step S9211 and the operation to be performed is set as a left rotation operation. Interpret. If the positional relationship is the left side in step S9204, the process proceeds to step S9212, and the operation to be performed is interpreted as a right rotation operation. If the positional relationship is on the upper side in step S9204, the process proceeds to step S9213, and the operation to be performed is interpreted as an upper screen moving operation or an enlargement operation only in the vertical direction. If the positional relationship is lower in step S9204, the process proceeds to step S9214, and the operation to be performed is the next item operation, the next page operation, the next screen operation, the last line operation, or the reduction only in the vertical direction. Interpret as an operation.
[0140]
In step S9202, if the movement direction is down, the process proceeds to step S9205. If the positional relationship with the fixed instruction position is on the right side, the process proceeds to step S9215, and the operation to be performed is set as a right rotation operation. Interpret. If the positional relationship is the left side in step S9205, the process proceeds to step S9216, and the operation to be performed is interpreted as a left rotation operation. If the positional relationship is on the upper side in step S9205, the process proceeds to step S9217, and the operation to be performed is the previous item operation, the previous page operation, the previous screen operation, the first line operation, or the reduction operation only in the vertical direction. Is interpreted as If it is determined in step S9205 that the positional relationship is on the lower side, the process advances to step S9218 to interpret the operation to be performed as a lower screen movement operation.
[0141]
In step S9202, if the movement direction is right, the process proceeds to step S9206, and if the positional relationship with respect to the fixed instruction position is the right side, the process proceeds to step S9219 to perform the right screen movement operation to be performed. Or, it is interpreted as an enlargement operation only in the left-right direction. If the positional relationship is the left side in step S9206, the process proceeds to step S9220, and the operation to be performed is the previous item operation, the previous page operation, the previous screen operation, the first line operation, or the reduction operation only in the horizontal direction. Is interpreted as If the positional relationship is on the upper side in step S9206, the process proceeds to step S9221, and the operation to be performed is interpreted as a right rotation operation. In step S9206, if the positional relationship is lower, the process proceeds to step S9222, and the operation to be performed is interpreted as a left rotation operation.
[0142]
FIG. 93 is a flowchart showing the procedure of the positional relationship determination process for the fixed instruction position. In the figure, in step S9301, an angle between designated positions is started, and an angle between designated positions is obtained. In subsequent step S9302, if the acquired angle is within a certain range in the upward direction, it is determined in step S9303 that the positional relationship is upward. In step S9302, if the acquired angle is within a certain range in the downward direction, it is determined in step S9304 that the positional relationship is lower. In step S9302, if the acquired angle is within a certain range in the left direction, the positional relationship is determined to be left in step S9305. In step S9302, if the acquired angle is within a certain range in the right direction, the positional relationship is determined to be right in step S9306.
[0143]
FIG. 94 is a flowchart showing the procedure of the designated position movement direction acquisition process. In the figure, in step S9401, designated position movement angle acquisition processing is activated, and the movement angle of the designated position is obtained. In subsequent step S9402, if the acquired angle is within a certain range in the upward direction, it is determined in step S9403 that the moving direction is upward. In step S9402, if the acquired angle is within a certain range in the downward direction, it is determined in step S9404 that the moving direction is downward. If it is determined in step S9402 that the acquired angle is within a certain range in the left direction, the moving direction is determined to be left in step S9405. If it is determined in step S9402 that the acquired angle is within a certain range in the right direction, the moving direction is determined to be right in step S9406.
[0144]
FIG. 95 is a diagram illustrating two operation examples that are interpreted as the next item operation or the left screen movement operation depending on the positional relationship when the movement direction of the movement instruction position is the same. In the figure, since the movement instruction position point B is in the left direction and the positional relationship is to the right of the fixed instruction position point A, the operation to be performed is the next item operation, the next page operation, or the next screen. It is interpreted as an operation, a last line operation, or a reduction operation only in the horizontal direction. On the other hand, since the movement instruction position point D is the left direction and the positional relationship is the left side of the fixed instruction position point C, the operation to be performed is the left screen movement operation or the enlargement operation only in the left-right direction. To be interpreted.
[0145]
Similarly, when the movement direction is the left direction and the positional relationship is above the fixed instruction position, the operation to be performed is interpreted as a left rotation operation, and when the positional relationship is below the fixed instruction position, the operation should be performed. Interpret the operation as a right rotation operation.
[0146]
If the movement direction is upward and the positional relationship is to the right of the fixed designated position, the operation to be performed is interpreted as a left rotation operation.If the positional relationship is to the left of the fixed designated position, the operation to be performed is interpreted. If it is interpreted as a right rotation operation and the positional relationship is above the fixed instruction position, the operation to be performed is interpreted as an upper screen movement operation or an enlargement operation only in the vertical direction, and the positional relationship is below the fixed instruction position. In this case, the operation to be performed is interpreted as the next item operation, the next page operation, the next screen operation, the last line operation, or the reduction operation only in the vertical direction.
[0147]
If the movement direction is downward and the positional relationship is to the right of the fixed instruction position, the operation to be performed is interpreted as a right rotation operation. If the positional relationship is to the left of the fixed instruction position, the operation to be performed is When the positional relationship is above the fixed instruction position, the operation to be performed is the previous item operation, the previous page operation, the previous screen operation, the first line operation, or the reduction operation only in the vertical direction. When the positional relationship is below the fixed instruction position, the operation to be performed is interpreted as a lower screen movement operation or an enlargement operation only in the vertical direction.
[0148]
When the movement direction is the right direction and the positional relationship is on the right side of the fixed instruction position, the operation to be performed is interpreted as a right screen movement operation or an enlargement operation only in the horizontal direction, and the positional relationship is the fixed instruction position. In the case of the left side, the operation to be performed is interpreted as the previous item operation, the previous page operation, the previous screen operation, the first line operation, or the reduction operation only in the horizontal direction, and the positional relationship is above the fixed instruction position The operation to be performed is interpreted as a right rotation operation, and when the positional relationship is below the fixed instruction position, the operation to be performed is interpreted as a left rotation operation.
[0149]
FIG. 96 is a diagram illustrating an example of data when interpreted as the next item operation. In the same figure, there is a fixed designated position point A (3, 3) as shown in the graph 9601. The movement designated position is point Bt1 (6, 2.8) at the start of movement t1, and point Bt5 (4, 2 at the end of movement t5. ). The table 9602 shows the position data of the fixed instruction position point A and the movement instruction position point B from t1 to t5. The table 9603 shows the positional relationship between the fixed instruction position and the movement instruction position. In the instruction position movement data, the movement amount of the instruction position at the end of movement t5 is 0 at the fixed instruction position point A and the movement instruction position point B. Is 2.236, and the relationship between the fixed instruction position point A and the movement instruction position point B is 176.19 ° at t1 and changes to 135.00 ° at t5. The movement direction of the movement instruction position point B is −153.43 °.
[0150]
[Embodiment 12]
In the present embodiment, when interpreting an operation to be performed from a combination of movement trajectories of two or more designated positions acquired, an example focusing on a change in the positional relationship between the two fixed designated positions and the movement designated position is specifically described. explain.
[0151]
FIG. 97 is a flowchart illustrating a processing procedure based on the positional relationship between the fixed instruction position and the movement instruction position. In the figure, in step S9701, the positional relationship determination process between the fixed instruction position and the movement instruction position is started, and the positional relationship of the movement instruction position with respect to the two detected fixed instruction positions is acquired. In step S9702, an instruction interpretation process based on the positional relationship between the fixed instruction position and the movement instruction position is activated to interpret an operation to be performed according to the acquired instruction position relationship.
[0152]
FIG. 98 is a flowchart showing the procedure of the positional relationship determination process between the fixed instruction position and the movement instruction position. In the figure, in step S9801, an angle acquisition process between fixed instruction positions is started, and an angle between two fixed instruction positions is acquired. In step S9802, an angle acquisition process between movement instruction positions is started, and an angle between any one of the two fixed instruction positions and the movement instruction position is acquired. Next, in step S9803, a relationship determination process between designated positions is started, and a relationship between the acquired angle between fixed instruction positions and the angle between movement instruction positions is determined. Next, in step S9804, a relationship change acquisition process between designated positions is started, and a change in relationship is acquired.
[0153]
FIG. 99 is a flowchart illustrating the procedure of the instruction position relationship determination process. In step S9901, if the acquired angle between the fixed instruction positions is smaller than the angle between the movement instruction positions in step S9901, the process proceeds to step S9902, and the instruction position relationship is determined as the right rotation direction. If the angle between the fixed instruction positions matches the angle between the movement instruction positions, the process advances to step S9903 to determine that the instruction position relationship is the same. When the angle between the fixed instruction positions is larger than the angle between the movement instruction positions, the process proceeds to step S9904, and the instruction position relationship is determined as the left rotation direction.
[0154]
FIG. 100 is a flowchart illustrating the procedure of the instruction position relationship change acquisition process. In the figure, if the initial position does not match the latest position in step S10001, the process proceeds to step S10002, and if the initial position relationship does not match, the process proceeds to step S10003, and the latest position relationship is further updated. If they do not match, the process advances to step S10004 to interpret the positional relationship as reversed.
[0155]
FIG. 101 is a flowchart showing the procedure of instruction interpretation processing based on the positional relationship between the fixed instruction position and the movement instruction position. In the figure, if the change in the positional relationship determined in step S10101 is reverse rotation, the process proceeds to step S10102, and the operation to be performed is interpreted as target reversal between the fixed instruction positions.
[0156]
FIG. 102 is a diagram illustrating an operation example that is interpreted as symmetry inversion. In the figure, when there is a movement instruction position point Ct1 with respect to points A and B which are fixed instruction positions, and this point moves to the movement instruction position point Ct5, it is interpreted as a symmetrical inversion operation.
[0157]
FIG. 103 is a diagram illustrating an example of data when interpreted as a symmetrical inversion operation. In the same figure, there are a fixed instruction position point A (3, 1) and a fixed instruction position point B (4, 6) as shown in the graph 10301, and the angle between the fixed instruction positions is 78.69 °. The movement instruction position is a point Ct1 (5, 3), and the angle t1 between movement instruction positions with respect to the fixed instruction position point A is 45.00 °. At this time, the movement instruction position point Ct1 is on the right side of the line segment AB between the fixed instruction positions. At the end of movement t5, the movement instruction position point is Ct5 (3,3), the movement instruction position angle t5 with respect to the fixed instruction position point 1A is 90.00 °, and the movement instruction position point Ct5 is a line segment between the fixed instruction positions. On the left side of AB.
[0158]
The table 10302 shows position data of the fixed instruction position point A, the point B, and the movement instruction position point C from t1 to t5. Table 10303 shows the positional relationship between the two fixed instruction positions and the movement instruction position. In the positional relationship data between the fixed instruction position and the movement instruction position, the angle between the fixed instruction positions is constant at 78.69 ° between t1 and t5. The angle between the movement instruction positions is 45.00 ° at t1, and continues to increase thereafter, and is 90.00 ° larger than the angle between the fixed instruction positions at t5.
[0159]
[Embodiment 13]
In the present embodiment, when interpreting an operation to be performed from a combination of movement trajectories of two or more designated positions acquired, an example focusing on a change in the positional relationship between the three fixed designated positions and the movement designated position is specifically described. Explained.
[0160]
FIG. 104 is a diagram showing the flow of processing when there are three or more fixed instruction positions. In the figure, if there are three or more fixed instruction positions in step S10401, the process proceeds to step S10402, and the positional relationship determination process of the movement instruction position for a plurality of fixed instruction positions is started, and three or more already detected positions are detected. The positional relationship of the movement instruction position with respect to the fixed instruction position is determined. In step S10403, an instruction interpretation process based on the positional relationship of the movement instruction position with respect to the plurality of fixed instruction positions is activated, and an operation to be performed is interpreted according to the determined positional relationship.
[0161]
FIG. 105 is a flowchart showing the procedure of the positional relationship determination process of the movement instruction position with respect to a plurality of fixed instruction positions. In the same figure, the angle acquisition process between fixed instruction positions is started in step S10501, the angle between the fixed instruction positions is acquired, and then the angle acquisition process between movement instruction positions is started in step S10502, and the acquired fixed instruction is acquired. An angle between an arbitrary fixed instruction position and a movement instruction position is acquired. Next, in step S10503, the instruction position relationship determination process is driven to determine the relationship between the acquired fixed instruction position angle and the movement instruction position angle. Next, in step S10504, the inter-indicated position relationship change acquisition process is activated, and the acquired change in the relationship is acquired.
[0162]
FIG. 106 is a flowchart illustrating the procedure of the positional relationship determination processing between designated positions when there are three or more fixed designated positions. In step S10601, the acquisition target fixing instruction position is acquired from the fixing instruction position list of the fixing instruction position table. Next, in step S10602, the head fixing instruction position is acquired from the acquired fixing instruction position list. Next, in step S10603, when the acquisition target fixing instruction position is lower in list order than the tail fixing instruction position of the fixing instruction position list, the process proceeds to step S10604, and the fixing instruction position is acquired. Subsequently, in step S10605, when the angle between the movement instruction positions is equal to or less than the angle between the fixed instruction positions that forms the maximum angle with respect to the acquired fixing instruction position, the process proceeds to step S10606, and the acquired fixing instruction position is If it is equal to or larger than the angle between the fixed instruction positions that forms the minimum angle, the process proceeds to step S10607, and the fixed instruction position list is advanced to the next.
[0163]
In step S10603, if the acquisition target fixing instruction position reaches the tail fixing instruction position in the fixing instruction position list, the process proceeds to step S10608 and is interpreted as being within the area. In step S10605, if the angle between the movement instruction positions is larger than the angle between the fixed instruction positions that makes the maximum angle with respect to the acquired fixed instruction position, or the minimum angle with respect to the fixed instruction position acquired in step S10606 If the angle is smaller than the angle between the fixed instruction positions that make the process, the process proceeds to step S10609 and is interpreted as being out of the area.
[0164]
FIG. 107 is a diagram illustrating an operation example in which the positional relationship of the movement instruction position with respect to a plurality of fixed instruction positions is interpreted as being within the area between the fixed instruction positions. In the figure, the positional relationship of the movement instruction position point Dt1 is interpreted as in the area between the fixed instruction position with respect to the area surrounded by the fixed instruction position points A, B, and C like 10701.
[0165]
FIG. 108 is a diagram illustrating an example of operation data in which the positional relationship between the movement instruction positions with respect to the plurality of fixed instruction positions is interpreted as being in the area between the fixed instruction positions by the position relationship determination process between the instruction positions. In the same figure, as indicated by the graph 10801, the fixed instruction position point A (3, 1), the fixed instruction position point B (4, 6), the fixed instruction position point C (6, 5.5), and the movement instruction position point Dt1 ( The angle DAO 71.57 ° of the point Dt1 with respect to the fixed indication position point A is between the angle BAO 78.69 ° centered on the fixed indication position point A and the angle CAO 56.31 °, and at the same time the fixed indication position A The angle O′BD−90.00 ° of the point Dt1 with respect to the point B is between the angle O′BA 101.31 ° and the angle O′BC 14.04 ° with the fixed indication position point B as the center.
[0166]
The table 10802 shows position data of the fixed designated position point A, point B, point C, and movement designated position point D from t1 to t5. Table 10803 shows the change in the positional relationship between the fixed command position and the movement command position. In the positional relationship change data, the angle DAO71.57 ° of the movement command position point D with respect to the fixed command position point A is between the fixed command positions. It is between the angle BAO 78.69 ° and the fixed instruction position angle CAO56.31 °, and the angle O′BD 90.00 ° of the movement instruction position point D with respect to the fixed instruction position point B is the fixed instruction position angle O′BA. It is between -101.31 ° and the angle between fixed indication positions O'BC-14.04 °.
[0167]
FIG. 109 is a flowchart illustrating the procedure of the acquisition process of the positional relationship change between the designated positions. In the figure, if the change in the positional relationship determined in step S10901 is a movement from the inside of the area to the outside of the area, the process proceeds to step S10902 and is interpreted as a movement outside the area. In step S10901, if the positional relationship change is not a movement from the inside of the region to the outside of the region, the process proceeds to step S10903.If the positional relationship change is a movement from the outside of the region to the inside of the region, the process proceeds to step S10904. Proceed and interpret as movement within the area.
[0168]
FIG. 110 is a diagram illustrating an example of an operation that is interpreted as movement outside the region between fixed designated positions by the positional relationship change determination process between designated positions. In the figure, when the movement instruction position point Dt1 moves to the point Dt5 with respect to the area surrounded by the fixed instruction position points A, B, and C, the positional relationship of the movement instruction positions with respect to the plurality of fixed instruction positions Is interpreted as out-of-region movement between fixed indication positions.
[0169]
FIG. 111 is a diagram illustrating an example of operation data that is interpreted as movement outside the region between fixed designated positions by the positional relationship change determination process between designated positions. In the same figure, at the start of movement t1 as shown in the graph 11101, the fixed instruction position point A (3, 1), the fixed instruction position point B (4, 6), the fixed instruction position point C (6, 5.5), and the movement There is a designated position point Dt1 (4, 4), and the angle DAO 71.57 ° of the point Dt1 with respect to the fixed designated position point A is between the angle BAO 78.69 ° centered on the fixed designated position point A and the angle CAO 56.31 °, At the same time, the angle O′BD−90.00 ° of the point Dt1 with respect to the fixed instruction position point B is between the angle O′BA 101.31 ° and the angle O′BC 14.04 ° with the fixed instruction position point B as the center. At the end of movement t5, there is a movement instruction position point Dt5 (3,4), and the angle DAO 90.00 ° of the point Dt5 with respect to the fixed instruction position point A is an angle BAO 78.69 ° centered on the fixed instruction position point A and an angle CAO At the same time, the angle O'BD -116.57 ° of the point Dt5 with respect to the fixed indication position point B is outside the 59.04 °, the angle O'BA 101.31 ° and the angle O'BC 14.04 ° centered on the fixation indication position point B Is outside.
[0170]
The table 11102 shows the position data of the fixed instruction position point A, point B, point C, and movement instruction position point D from t1 to t5. The table 11103 shows the positional relationship change between the fixed instruction position and the movement instruction position. In the positional relationship change data, the angle DAO of the movement instruction position point D with respect to the fixed instruction position point A and the fixed instruction position point B The angle O′BD of the movement instruction position point D exists in the fixed instruction position area between t1 and t3, and moves outside the area at t4.
[0171]
FIG. 112 is a flowchart illustrating a procedure of instruction interpretation processing based on the positional relationship between a plurality of fixed instruction positions and movement instruction positions. In the figure, if the change in the positional relationship determined in step S11201 is movement outside the area, the process proceeds to step S11202, and the operation to be performed is interpreted as deletion in the area between the fixed designated positions. In step S11201, if the positional relationship change is not movement outside the region, the process proceeds to step S11203. If the positional relationship change is movement within the region, the process proceeds to step S11204, and the operation to be performed is determined as the fixed instruction position. Interpreted as attribute assignment in the interspace. In this case, the attribute assignment in the area between the fixed designated positions includes coloring in the area between the fixed designated positions.
[0172]
FIG. 113 is a diagram illustrating an operation example that is interpreted as coloring in the region between the fixed designated positions among the items that are interpreted as attribute assignment in the region between the fixed designated positions. In the same figure, when the movement instruction position point Dt1 moves to the point Dt5 with respect to the area surrounded by the fixed instruction position points A, B, and C, the operation to be performed is moved to the area between the fixed instruction positions. Interpret as coloring.
[0173]
FIG. 114 shows a case where, among the interpretations given as attributes in the area between the fixed designated positions by the positional relationship correspondence instruction interpretation process between the plurality of fixed designated positions, it is interpreted as coloring in the area between the fixed designated positions. It is a figure which shows the example of data of operation. In the same figure, at the start of movement t1 as shown by 11431, the fixed instruction position point A (3, 1), the fixed instruction position point B (4, 6), the fixed instruction position point C (6, 5.5), and the movement instruction Position point Dt1 (3,4), the angle DAO 90.00 ° of point Dt1 with respect to the fixed indication position point A is outside the angle BAO 78.69 ° and the angle CAO 56.31 ° around the fixed indication position point A, and at the same time The angle O′BD 116.57 ° of the point Dt1 with respect to the fixed indication position point B is outside the angle O′BA 101.31 ° and the angle O′BC 14.04 ° centered on the fixation indication position point B. At the end of movement t5, there is a movement command position point Dt5 (4, 4), and the angle DAO 71.57 ° of point Dt5 with respect to the fixed command position point A is an angle BAO of 78.69 ° centered on the fixed command position point A and an angle CAO At the same time, the angle O'BD 90.00 ° of the point Dt5 with respect to the fixed indication position point B is between the angle O'BA 101.31 ° and the angle O'BC 14.04 ° centered on the fixation indication position point B. between.
[0174]
The table 11432 shows position data of the fixed designated position point A, point B, point C, and movement designated position point D from t1 to t5. The table 11433 shows the positional relationship change between the fixed instruction position and the movement instruction position. In the positional relationship change data, the angle DAO of the movement instruction position point D with respect to the fixed instruction position point A and the fixed instruction position point B The angle O′BD of the movement instruction position point D exists outside the fixed instruction position area between t1 and t3, and moves into the area at t4.
[0175]
[Embodiment 14]
In the present embodiment, an example in which attention is paid to a change in the number of designated positions of a plurality of designated positions when interpreting an operation to be performed from a combination of movement loci of two or more designated positions acquired will be specifically described.
[0176]
FIG. 115 is a flowchart illustrating a procedure of instruction interpretation processing using a change in the number of designated positions at a plurality of designated positions. In the figure, the designated position number acquisition process is activated in step S11401 to obtain the designated position number, and in the subsequent step S11402, the designated position number change obtaining process is activated to obtain the designated position number change. Next, in step S11403, an instruction interpretation process based on a change in the number of designated positions is started, and an operation to be performed is interpreted according to the obtained number of designated positions.
[0177]
FIG. 116 is a flowchart showing a procedure of instruction interpretation processing based on a change in the number of initial designated positions. In the figure, in step S11601, the initial designated position number is compared with the current designated position number.If it is larger than the initial designated position number in step S11602, the process proceeds to step S11603, and the operation target is being specified. Interpret.
[0178]
FIG. 117 is a diagram illustrating an operation example when it is interpreted that the operation target is being specified by the instruction interpretation processing based on the change in the number of initial designated positions. At time t1, there are initial designated position points At1 and Bt1, and there are two designated positions. At time t2, there are designated position points At2, Bt2, and Ct2, and there are three designated positions from time t1. It has increased by one.
[0179]
FIG. 118 is a diagram illustrating an example of operation data when it is interpreted that the operation target is being specified. Like graph 11801, at time t1, there are designated position point At1 and designated position point Bt1, and the number of designated positions is two. At time t2, designated position point At2, designated position point Bt2, and designated position There is a point Ct2, and the number of indicated positions is three. The table 11802 shows the position data of the designated position point A, the designated position point B, and the designated position point C from t1 to t3. The table 11803 shows the change in the number of designated positions. In the designated position number data, at the time t1, the designated position number is 2, and the initial designated position number change is 0. At time t2, the number of designated positions is 3, and the change in the number of initial designated positions is 1.
[0180]
FIG. 119 is a flowchart illustrating the procedure of the instruction interpretation process based on the change in the number of designated positions based on the initial designated position. In the same figure, when the initial indication position number change corresponding instruction interpretation processing is activated, in step S11901, the initial indication position acquisition processing is activated to acquire the first indication position. Subsequently, in step S11902, if the acquired number of designated positions is greater than the number of initial designated positions, the process proceeds to step S11903, where the initial designated position reference instruction interpretation process is activated, and the acquired initial designated position is set. Interpret the operation to be performed as a reference.
[0181]
FIG. 120 is a flowchart showing the procedure of instruction interpretation processing based on the initial pointing position. In the figure, if the number of designated positions is one in step S12001, the process proceeds to step S12002, and the operation to be performed is interpreted as a rotation operation centered on the obtained designated position.
[0182]
FIG. 121 is a diagram illustrating an operation example when the rotation operation is interpreted as centering on the designated position. When there is an initial designated position point A at time t1, and there is a designated position point A at time t5, and when the designated position point Bt5 has moved from the designated position point Bt3, the rotation operation is centered on the designated position point A. Interpreted.
[0183]
FIG. 122 is a diagram illustrating an example of data when interpreted as a rotation operation centered on the designated position. As in graph 12201, the indicated position point A is at the same coordinate (3, 3) from time t1 to time t6, and the indicated position point B is at point Bt3 (6, 2.8) at time t3, at time t4. Sometimes it is at point Bt4 (5.6, 3.5), at time t5 it is at point Bt5 (5.2, 4.2), and at time t6 it has moved to point Bt6 (5, 5). The table 12202 shows the position data of the designated position points A and B from time t1 to time t6. The table 12203 shows changes in the number of designated positions. In the designated position number data, the designated position number is 1 and the initial designated position number change is 0 at times t1 and t2. At time t3, the indicated position number is 2, and the initial indicated position number change is 1. Thereafter, the number of designated positions does not change until time t6.
[0184]
[Embodiment 15]
In the present embodiment, an example in which attention is paid to a change in the number of final designated positions of a plurality of designated positions when interpreting an operation to be performed from a combination of movement loci of two or more designated positions acquired will be specifically described.
[0185]
FIG. 127 is a flowchart illustrating a processing procedure using the final designated position number change. In the figure, the final designated position number change acquisition process is activated in step S12301, and the final designated position number change is obtained. In step S12302, an instruction interpretation process based on a change in the number of final designated positions is performed.
[0186]
FIG. 124 is a flowchart showing the procedure of the instruction interpretation process based on the change in the number of final designated positions. In the figure, if the number of designated positions has decreased in step S12401, the process proceeds to step S12402 and is interpreted as a cancel instruction for the immediately preceding operation. If it is determined in step S12401 that the number of designated positions has not decreased, the process proceeds to step S12403, and is interpreted as an approval instruction for the immediately preceding operation.
[0187]
FIG. 125 is a diagram illustrating an operation example in the case of being interpreted as a cancel instruction operation in the instruction interpretation process based on the change in the number of final instruction positions. At time t1, there are initial designated position points At1, Bt1, and Ct1, the number of designated positions is three, and at time t2, there are designated position points At2 and Bt2, the number of designated positions is two, and time t1 It has decreased by one.
[0188]
FIG. 126 is a diagram illustrating an example of operation data when interpreted as a cancel instruction operation in the instruction interpretation process based on the change in the number of final instruction positions. As shown in graph 12601, at time t1, there are designated position points At1, Bt1, and Ct1, and there are three designated positions. At time t2, there are designated position points At2 and Bt2, and there are two designated positions. is there. The table 12602 shows the position data of the designated position points A, B and C from time t1 to t2. The table 12603 shows the change in the number of designated positions. In the designated position number data, at the time t1, the designated position number is 3, and the initial designated position number change is 0. At time t2, the number of designated positions is 2, and the change in the number of initial designated positions is -1.
[0189]
[Embodiment 16]
In the present embodiment, an example in which the number of designated positions is focused as instruction information other than the instruction locus when interpreting an operation to be performed from a combination of movement loci of two or more indicated positions acquired will be specifically described.
[0190]
FIG. 127 is a flowchart illustrating a processing procedure using instruction information other than the instruction locus. In the figure, instruction information acquisition processing is activated in step S12701, and instruction information other than the instruction locus is acquired. Next, in step S12702, if the operation has not been repeated, the process proceeds to step S12703, where an instruction interpretation process based on the instruction information is activated, and an operation to be performed is interpreted based on the acquired instruction information. If the operation has been repeated in step S12702, the process proceeds to step S12703, the interrupt operation interpretation process is started, the operation is interpreted to be interrupted, and the process proceeds to step S12703.
[0191]
FIG. 128 is a flowchart illustrating a procedure of instruction interpretation processing using instruction information other than the instruction locus. In the figure, if the instruction information is greater than or equal to the maximum determination value in step S12801, the process proceeds to step S12802 and is interpreted as the maximum operation amount. In step S12801, if the instruction information is less than the maximum determination value, the process proceeds to step S12803.If the instruction information is more than the repeated determination value, the process proceeds to step S12804 and is interpreted to increase the operation amount. Next, proceeding to step S12805, it is interpreted that the repetition interval is decreased. If it is determined in step S12803 that the instruction information does not satisfy the repeated determination value, the process proceeds to step S12806 and is interpreted to increase the operation amount.
[0192]
FIG. 129 is a flowchart illustrating a processing procedure using the total number of designated positions. In the figure, in step S12901, the total designated position number acquisition process is activated to obtain the total number of designated positions.
[0193]
FIG. 130 is a flowchart illustrating a processing procedure using the number of designated positions as instruction information other than the instruction locus. If the number of designated positions is greater than or equal to the maximum determination value in step S13001, the flow advances to step S13002 to be interpreted as the maximum page number, the maximum screen number, the maximum item number, or the maximum scale factor. In step S13001, if the number of designated positions is less than the maximum judgment value, the process proceeds to step S13003. If the number of designated positions is the repeat judgment value or more, the process proceeds to step S13004, where the number of pages is increased or the number of screens The increase, the increase in the number of items, or the increase in the scale factor is interpreted to increase, and then the process proceeds to step S13005, and the repetition interval is interpreted to decrease. If it is determined in step S13003 that the number of designated positions is less than the repeated determination value, the process advances to step S13006 to interpret an increase in page number, screen number, item number, or scale factor increase. Next, the process proceeds to step S13007, and is interpreted as a page movement operation, a screen movement operation, an item movement operation, or an enlargement / reduction operation.
[0194]
FIG. 131 is a diagram illustrating an operation example when interpreted as a page turning operation. At time t1, there are designated position point At1 and point Bt1, and when the total number of designated positions is 2, and at time t2, in addition to designated position point At2 and point Bt2, there are designated position point Ct2 and point Dt2. When the total number of indicated positions is 4, it is interpreted that the number of operation target pages in the page turning operation is larger at time t2 when the total number of indicated positions is larger.
[0195]
FIG. 132 is a diagram showing an example of operation data when interpreted as a page turning operation. As shown in graph 13201, at time t1, there are designated position points At1 and Bt1, and the total number of designated positions is two. At time t2, designated position points At2, Bt2, Ct2, and Dt2 are present, and all designated positions. The number is four. The table 13202 shows position data of the designated position points A, B, C, and D from time t1 to time t2. The table 13203 shows changes in the number of designated positions. In the designated position number data, the increase designated position number is 2 and the total designated position number is 3 at time t1. At time t2, the increase instruction position number is 2, and the total instruction position number is 5.
[0196]
[Embodiment 17]
In the present embodiment, an example of focusing on the designated position moving speed as instruction information other than the designated locus when interpreting an operation to be performed from a combination of the obtained two or more designated position movement loci will be specifically described. .
[0197]
FIG. 133 is a flowchart illustrating a processing procedure using the designated position moving speed as information other than the designated locus. In the figure, the designated position moving speed acquisition process is activated in step S13301, and the moving speed of the designated position is obtained. In step S13302, an instruction interpretation process based on the designated position moving speed is activated, and the instruction is interpreted based on the moving speed of the designated position.
[0198]
FIG. 134 is a flowchart illustrating a procedure of designated position movement speed acquisition processing. In the figure, in step S13401, the movement distance from the immediately preceding designated position is acquired, and in step S13042, the speed is calculated from the acquired distance and time.
[0199]
FIG. 135 is a flowchart showing the procedure of instruction interpretation processing using the designated position moving speed as the instruction information other than the instruction locus. In the figure, if the indicated position speed is greater than or equal to the maximum determination value in step S13501, the flow proceeds to step S13502, and is interpreted as the maximum page number, the maximum screen number, the maximum item number, or the maximum scale magnification. In step S13501, if the designated position speed is less than the maximum determination value, the process proceeds to step S13503. If the designated position speed is greater than or equal to the repeated determination value, the process proceeds to step S13504 to increase the number of pages or the number of screens. The increase, the increase in the number of items, or the increase in the scale factor is interpreted to increase, and then the process proceeds to step S13505, and the repetition interval is interpreted to decrease. If it is determined in step S13503 that the designated position speed is less than the repeated determination value, the process proceeds to step S13506, where the increase in the number of pages, the increase in the number of screens, the increase in the number of items, or the increase in the scale factor is interpreted. Next, proceeding to step S13507, it is interpreted as a page movement operation, a screen movement operation, an item movement operation, or an enlargement / reduction operation.
[0200]
FIG. 136 is a diagram illustrating an operation example when it is interpreted as a page turning operation using the designated position moving speed. When the designated position point A and point B move from time t1 to time t5, and when the designated position point A ′ and point B ′ move from time t1 to time t5, movement within the same time The speed is interpreted as the latter being larger.
[0201]
FIG. 137 is a diagram illustrating an example of operation data when interpreted as a page turning operation using the designated position moving speed. As shown in graph 13701, at time t1, the combination of designated position point A and designated position point B is such that designated position point At1 and designated position point A't1 are at the same coordinates (4, 2), and designated position point Bt1 And the designated position point B't1 are at the same coordinate (5,3). At time t5, the respective coordinates are designated by the designated position point At5 (3,3) and designated position point Bt5 (4,4). It has moved to A't5 (3,4) and designated position point B't5 (4,5).
[0202]
The table 13702 shows the position data of the designated position points A, B, A ′, B ′ from t1 to t5. The table 13703 shows the moving speed of the designated position. In the designated position moving speed data, the moving speed 0.559 of the designated position point A ′ and the designated position point B ′ The moving speed 0.559 is higher than the moving speed 0.354 at the indicated position point A and the moving speed 0.283 at the indicated position point B.
[0203]
[Embodiment 18]
In this embodiment, when interpreting an operation to be performed from a combination of movement loci of two or more indicated positions acquired, an example focusing on the contact pressure at the indicated position as instruction information other than the instruction locus will be specifically described. To do.
[0204]
FIG. 138 is a flowchart illustrating a processing procedure using the designated position contact pressure as information other than the designated locus. In the figure, the designated position contact pressure acquisition process is activated in step S13801, and the designated position contact pressure is obtained. In step S13802, an instruction interpretation process based on the indicated position contact pressure is activated, and the instruction is interpreted based on the contact pressure at the indicated position.
[0205]
FIG. 139 is a flowchart illustrating a procedure of instruction interpretation processing based on the instruction position contact pressure. In the figure, when the instruction information corresponding instruction interpretation process is activated, if the instruction position contact pressure is greater than or equal to the maximum determination value in step S13901, the process proceeds to step S13902, and the maximum number of screens, or the maximum number of items, or Interpret as the maximum scale factor. In step S13901, if the indicated position contact pressure is less than the maximum determination value, the process proceeds to step S13903.If the indicated position contact pressure is equal to or greater than the repeated determination value, the process proceeds to step S13904, where the number of screens is increased, or Interpretation to increase the number of items or increase in scale factor, and then proceed to step S13905 to interpret to decrease the repetition interval. If it is determined in step S13903 that the indicated position contact pressure does not reach the repetitive determination value, the flow advances to step S13906 to interpret an increase in the number of screens, the number of items, or the increase in scale factor. Next, the process proceeds to step S13907, and is interpreted as a screen movement operation, an item movement operation, or an enlargement / reduction operation.
[0206]
FIG. 140 is a diagram illustrating an operation example in the case of being interpreted as a screen movement operation by the designated position contact pressure. At the designated position point At1 (3, 3) and point Bt1 (4, 4) and the designated position point At5 (3, 3) and point Bt5 (4, 4), the latter is interpreted as having a larger contact pressure.
[0207]
FIG. 141 is a diagram illustrating an example of operation data that is interpreted as a screen movement operation based on the indication position contact pressure. As in graph 14101, from time t1 to time t5, the designated position point At1 (3,3) and the point Bt1 (4,4) to the designated position point At5 (3,1) and Bt5 (4,2) are the same. At the same time, the designated position points Ct1 (3,3) and Dt1 (4,4) are moved to designated position points Ct5 (3,1) and Dt5 (4,2). The table 14102 shows the position data of the designated position point A, the designated position point B, the designated position point C, and the designated position point D from t1 to t5. The table 14103 shows the contact pressure at the indicated position. In the indicated position contact pressure data, the indicated position point C and the indicated position are determined from the change in the contact pressure at the indicated position point A and the indicated position point B from time t1 to t5. The contact pressure change at point D is larger.
[0208]
[Embodiment 19]
In this embodiment, when interpreting an operation to be performed from a combination of movement loci of two or more designated positions acquired, an example focusing on the movement distances of a plurality of designated positions as instruction information other than the instruction locus is specifically described. explain.
[0209]
FIG. 142 is a flowchart illustrating a processing procedure using the movement distances of a plurality of designated positions as information other than the designated locus. In the figure, designated position movement distance acquisition processing is activated in step S14201, and the movement distance of the designated position is obtained. In step S14202, an instruction interpretation process based on the designated position moving distance is started, and the instruction is interpreted based on the designated position moving distance.
[0210]
FIG. 143 is a flowchart illustrating a procedure of instruction interpretation processing based on the movement distance of the plurality of designated positions. In the figure, when the instruction information corresponding instruction interpretation process is activated, if the instruction position movement distance is greater than or equal to the maximum determination value in step S14301, the process proceeds to step S14302, and the maximum number of pages, the maximum number of screens, or Interpret as the maximum number of items or maximum scale factor. In step S14301, if the designated position moving distance is less than the maximum determination value, the process proceeds to step S14303. If the designated position moving distance is not less than the repeated determination value, the process proceeds to step S14304, and the number of pages is increased. An increase in the number of screens, an increase in the number of items, or an increase in the scale factor is interpreted to be increased, and then the process proceeds to step S14305 and is interpreted to decrease the repetition interval. If it is determined in step S14303 that the designated position moving distance is less than the repeated determination value, the process proceeds to step S14306, and is interpreted to increase the page number, the screen number, the item number, or the scale factor increase. Next, the process proceeds to step S14307, and is interpreted as a page movement operation, a screen movement operation, an item movement operation, or an enlargement / reduction operation.
[0211]
FIG. 144 is a diagram illustrating an operation example when interpreted as a page turning operation. When the designated position point At1 (4, 2) and the point Bt1 (5, 3) at the time t1 move like the designated position point At5 (3, 3) and the point Bt5 (4, 4) at the time t5, and The designated position point A't1 (4,2) and the point B't1 (5,3) at the time t1 are the designated position point A't5 (3,6) and the point B't5 (4,7) at the time t5. In the case of moving as in the case of the latter, the latter is interpreted as having a longer moving distance.
[0212]
FIG. 145 is a diagram illustrating an example of data of an operation interpreted as a page turning operation. Like graph 14501, at time t1, the combination of designated position point A and designated position point B is such that designated position point At1 and designated position point A't1 are at the same coordinates (4, 2), and designated position point Bt1 And the designated position point B't1 are at the same coordinate (5,3). At time t5, the respective coordinates are designated by the designated position point At5 (3,3) and designated position point Bt5 (4,4). It has moved to A't5 (3, 6) and designated position point B't5 (4, 7). The table 14602 shows the position data of the designated position points A, B, A ′, B ′ from time t1 to time t5. The table 14603 shows the movement distances of a plurality of designated positions. In the movement distance data of the designated positions, the movement distance 4.123 of the designated position point A ′ and the designated position points are calculated based on the movement distance and the movement distance increase amount of each designated position. The movement distance 4.123 of B ′ is larger than the movement distance 1.414 of the designated position point A and the movement distance 1.131 of the designated position point B.
[0213]
[Embodiment 20]
In the present embodiment, an example of paying attention to the immobility time of a plurality of designated positions when interpreting an operation to be performed from a combination of movement trajectories of two or more designated positions acquired will be specifically described.
[0214]
FIG. 146 is a flowchart illustrating a processing procedure using the immobility time of a plurality of designated positions. In the same figure, the designated position immobilization time acquisition process is started in step s14601, and the immobilization time of the designated position is obtained. Next, in step s14602, if the designated position has not been fixed for a certain period of time, the process proceeds to step s14603, where it is interpreted as a range designation operation, and the designated range is clearly indicated in a form that can be distinguished from others on the display. If it is determined in step s14602 that the designated position is not stationary, the flow advances to step s14604 to interpret it as an operation for the specified range.
[0215]
FIG. 147 is a diagram illustrating an example of an operation that is interpreted as a range designation operation in the process using the immobility time at a plurality of designated positions. If the designated position points At1 and Bt1 are on an arbitrary character string at time t1, and if the designated position points At5 and Bt5 are on the same character string at time t5, it is interpreted that the area between the designated positions is specified. .
[0216]
FIG. 148 is a diagram illustrating an example of data when interpreted as a range designation operation in the process using the immobility time at a plurality of designated positions. Like graph 14801, indicated position point A (3, 3) is at the same coordinate from time t1 to t5, and indicated position point B (4, 4) is also at the same coordinate from time t1 to t5. It is in. The table 14802 shows the position data of the designated position points A and B from the designated position times t1 to t5. The table 14803 shows the movement amount of the designated position. In the designated position movement data, the movement amount of the designated position point A is 0 at time t1, and is 0 at time t5 after t2. Similarly, the movement amount of the designated position point B is 0 from time t1 to time t5, and it can be seen that the designated position point A and point B do not move from time t1 to time t5.
[0217]
FIG. 149 is a diagram illustrating an operation example in the case of processing using the immobilization time at a plurality of designated positions when the operation is interpreted as an enlargement operation with respect to a specified range. At time t5, the designated position point At5 and the designated position point Bt5 are on an arbitrary character string, and at time t6, the designated position point At6 and the designated position point Bt6 are moved from the position of t5, respectively. Interpreted as an enlargement operation on the specified range.
[0218]
FIG. 150 is a diagram illustrating an example of data when interpreted as an enlargement operation with respect to a specified range in the process using the immobilization time of a plurality of designated positions. As in the graph 15001, the designated position points A (3, 3) and B (4, 4) are at the same coordinates from time t1 to t5, and the designated position points At6 (2, 2.5) and Bt6 (4, 4) ) Exist in a direction away from the other designated position as seen from the position at time t5. The table 15002 shows the position data of the designated position point A and the designated position point B from the time t1 to t6 of the designated position. The table 15003 shows the time change of the designated position. In the designated position movement data, the movement amount of the designated position point A and the designated position point B is 0 between the times t1 and t5, and between the designated positions AB. The distance change magnification is 100% and has not changed. At time t6, the moving amount of point A is 1.118, the moving amount of point B is 2.236, and the distance change magnification between the designated positions AB is expanded to 285%.
[0219]
It should be noted that the present invention is applied to a system composed of a plurality of devices (for example, a computer main body, an interface device, a display, etc.) even when applied to an apparatus composed of a single device within the range in which the functions of the above embodiments can be realized. You may apply.
[0220]
In addition, for the purpose of operating various devices so as to realize the functions of the above-described embodiments, a software program that realizes the functions of the above-described embodiments on an apparatus or a computer in the system connected to the various devices. You may achieve by supplying the storage medium which stored the code | cord | chord, and the computer in an apparatus or a system reading and executing the program code stored in the storage medium.
[0221]
As a storage medium for supplying such program code, for example, a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.
[0222]
Alternatively, the program code may be provided from outside via a communication line.
[0223]
Further, the computer in the apparatus or system reads out and executes the program code stored in the storage medium, thereby not only directly realizing the functions of the above-described embodiments but also on the computer based on the instruction of the program code. The case where the above-described functions are realized by processing of an OS or the like that is running on is also included.
[0224]
In these cases, the storage medium storing the program code and the program code itself constitute the present invention.
[0225]
【The invention's effect】
As described above, according to the present invention, it is possible to detect the trajectories of two or more designated positions that move simultaneously.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a hardware configuration of an information processing apparatus according to an embodiment.
FIG. 2 is a diagram illustrating an example of position input by a finger using a touch panel.
FIG. 3 is a diagram illustrating an example of position input by a finger using the photographing apparatus.
FIG. 4 is a flowchart showing a procedure of processing using a locus of a designated position.
FIG. 5 is a flowchart illustrating a procedure of locus detection processing.
FIG. 6 is a flowchart showing a procedure of a combination specifying process.
FIG. 7 is a diagram illustrating an example of stored indication position data.
FIG. 8 is a diagram illustrating an example of current designated position data acquired.
FIG. 9 is a diagram illustrating a flow of data used in detecting a locus of a plurality of designated positions.
FIG. 10 is a flowchart showing a procedure of trajectory detection processing using the size of the designated area.
FIG. 11 is a flowchart illustrating a procedure of a combination specifying process using an instruction area.
FIG. 12 is a diagram showing the area of the current designated position acquired.
FIG. 13 is a diagram illustrating an example of stored area data of a designated position.
FIG. 14 is a diagram illustrating a flow of data used in processing using the size of the designated area.
FIG. 15 is a flowchart showing an operation procedure using a trajectory of a plurality of designated positions.
FIG. 16 is a flowchart showing a flow of instruction interpretation processing.
FIG. 17 is a flowchart illustrating a procedure for acquiring a change in distance between designated positions.
FIG. 18 is a flowchart illustrating a procedure of instruction interpretation processing based on a change in distance.
FIG. 19 is a flowchart showing another procedure of instruction interpretation processing based on a change in distance.
FIG. 20 is a diagram illustrating an example of an operation interpreted as a reduction operation.
FIG. 21 is a diagram illustrating an example of data interpreted as a reduction operation.
FIG. 22 is a diagram illustrating an operation example that is interpreted as an enlargement operation;
FIG. 23 is a diagram illustrating an example of data interpreted as an enlargement operation.
FIG. 24 is a flowchart showing a procedure of instruction interpretation using an angle change of an instruction position.
FIG. 25 is a flowchart illustrating a procedure of an acquisition process of the change in angle of the designated position.
FIG. 26 is a flowchart illustrating a procedure of instruction interpretation processing based on an angle change.
FIG. 27 is a diagram illustrating an operation example interpreted as a right rotation operation;
FIG. 28 is a diagram illustrating an example of data interpreted as a right rotation operation.
FIG. 29 is a diagram illustrating an operation example that is interpreted as a left rotation operation;
FIG. 30 is a diagram illustrating an example of data interpreted as a left rotation operation.
FIG. 31 is a flowchart illustrating a procedure of instruction interpretation processing using a relationship between a fixed instruction position and a movement instruction position.
FIG. 32 is a flowchart illustrating a procedure of fixed instruction position detection processing;
FIG. 33 is a flowchart illustrating a procedure of instruction interpretation processing based on a moving direction.
FIG. 34 is a flowchart showing a procedure of designated position movement direction determination processing;
FIG. 35 is a diagram illustrating an interpretation of an angle used in a designated position movement direction determination process.
FIG. 36 is a diagram illustrating an operation example that is interpreted as a left movement operation;
FIG. 37 is a diagram illustrating an example of data interpreted as a left movement operation.
FIG. 38 is a diagram illustrating an operation example that is interpreted as an upward movement operation;
FIG. 39 is a diagram illustrating an example of data interpreted as an upward movement operation.
FIG. 40 is a diagram illustrating an operation example that is interpreted as a downward movement operation;
FIG. 41 is a diagram illustrating an example of data interpreted as a downward movement operation;
FIG. 42 is a diagram illustrating an operation example interpreted as a right movement operation.
FIG. 43 is a diagram illustrating data interpreted as a right movement operation.
FIG. 44 is a flowchart showing a procedure of instruction interpretation processing using a change in distance between a fixed instruction position and a movement instruction position.
FIG. 45 is a flowchart showing a procedure of instruction interpretation processing based on a change in distance between designated positions.
FIG. 46 is a diagram illustrating an operation example interpreted as a reduction operation.
FIG. 47 is a diagram illustrating an example of data interpreted as a reduction operation.
FIG. 48 is a diagram illustrating an operation example that is interpreted as an enlargement operation;
FIG. 49 is a diagram illustrating an example of data interpreted as an enlargement operation.
FIG. 50 is a diagram illustrating an operation example that is interpreted as a reduction operation centered on a fixed instruction position;
FIG. 51 is a diagram illustrating an example of data interpreted as a reduction operation centered on a fixed instruction position;
FIG. 52 is a flowchart illustrating a processing procedure using a distance between movement instruction positions.
FIG. 53 is a flowchart illustrating a procedure of instruction interpretation processing based on a change in distance between movement instruction positions.
FIG. 54 is a diagram illustrating an operation example interpreted as a reduction operation.
FIG. 55 is a diagram illustrating an example of data interpreted as a reduction operation.
FIG. 56 is a diagram illustrating an operation example that is interpreted as an enlargement operation;
FIG. 57 is a diagram illustrating data interpreted as an enlargement operation.
FIG. 58 is a diagram illustrating an example of an operation interpreted as a multiple movement instruction operation.
FIG. 59 is a diagram illustrating data interpreted as a multiple movement instruction operation.
FIG. 60 is a flowchart showing a procedure of processing using an angle change between designated positions.
FIG. 61 is a flowchart showing a procedure of instruction interpretation processing based on an angle change between instruction positions.
FIG. 62 is a diagram illustrating an operation example that is interpreted as a right rotation operation;
FIG. 63 is a diagram illustrating an example of data interpreted as a right rotation operation;
FIG. 64 is a diagram illustrating an operation example that is interpreted as a left rotation operation;
FIG. 65 is a diagram illustrating an example of data interpreted as a left rotation operation;
FIG. 66 is a flowchart illustrating a procedure of processing using an angle change of a movement instruction position.
FIG. 67 is a flowchart showing a procedure of instruction interpretation processing based on a change in angle of a movement instruction position.
FIG. 68 is a diagram illustrating an operation example that is interpreted as a right rotation operation;
FIG. 69 is a diagram illustrating an example of data interpreted as a right rotation operation;
FIG. 70 is a diagram illustrating an operation example interpreted as a left rotation operation;
FIG. 71 is a diagram illustrating an example of data interpreted as a left rotation operation;
FIG. 72 is a diagram illustrating an operation example that is interpreted as a rotation operation with the center of gravity as the center;
FIG. 73 is a diagram showing an example of data interpreted as a rotation operation centered on the center of gravity.
FIG. 74 is a flowchart illustrating a procedure of processing using a positional relationship between designated positions.
FIG. 75 is a flowchart illustrating a procedure of a positional relationship determination process between designated positions.
FIG. 76 is a flowchart illustrating a procedure of instruction interpretation processing based on a positional relationship between instruction positions.
FIG. 77 is a diagram illustrating an operation example that is interpreted as an up / down movement operation;
FIG. 78 is a diagram illustrating an example of data interpreted as a vertical movement operation.
FIG. 79 is a diagram illustrating an operation example that is interpreted as a left-right movement operation;
FIG. 80 is a diagram illustrating data interpreted as a left / right movement operation;
FIG. 81 is a flowchart showing a procedure of instruction interpretation processing based on a positional relationship between instruction positions.
FIG. 82 is a flowchart showing a procedure of instruction interpretation processing based on a positional relationship change.
FIG. 83 is a flowchart illustrating a procedure of a change process of relationship between designated positions.
FIG. 84 is a diagram illustrating an operation example interpreted as a reversal operation.
FIG. 85 is a diagram illustrating an example of data interpreted as a reversal operation.
FIG. 86 is a diagram illustrating an operation example that is interpreted as a left / right reversal operation;
FIG. 87 is a diagram illustrating an example of data interpreted as a left / right reversing operation.
FIG. 88 is a diagram illustrating an operation example that is interpreted as an upside down operation;
FIG. 89 is a diagram illustrating an example of data interpreted as an upside down operation.
FIG. 90 is a flowchart illustrating a procedure of a positional relationship determination process between designated positions.
FIG. 91 is a flowchart showing a procedure of instruction interpretation processing based on a positional relationship with respect to a fixed instruction position.
FIG. 92 is a flowchart showing a detailed procedure of instruction interpretation processing based on a positional relationship with respect to a fixed instruction position.
FIG. 93 is a flowchart showing a procedure of a positional relationship determination process for a fixed instruction position.
FIG. 94 is a flowchart showing a procedure of designated position movement direction acquisition processing;
FIG. 95 is a diagram showing two operation examples with different interpretations depending on the positional relationship when the movement directions are the same.
FIG. 96 is a diagram showing an example of data interpreted as a next item operation.
FIG. 97 is a flowchart illustrating a processing procedure based on the positional relationship between the fixed instruction position and the movement instruction position.
FIG. 98 is a flowchart illustrating a procedure of a positional relationship determination process between a fixed instruction position and a movement instruction position.
FIG. 99 is a flowchart showing a procedure of a relationship determination process between designated positions.
FIG. 100 is a flowchart illustrating a procedure of an instruction position relationship change acquisition process;
FIG. 101 is a flowchart illustrating a procedure of instruction interpretation processing based on a positional relationship between a fixed instruction position and a movement instruction position.
FIG. 102 is a diagram illustrating an operation example that is interpreted as inversion of symmetry.
FIG. 103 is a diagram illustrating an example of data when interpreted as a symmetric inversion operation.
FIG. 104 is a flowchart showing the flow of processing when there are three or more fixing instruction positions.
FIG. 105 is a flowchart showing a procedure of a positional relationship determination process of a movement instruction position with respect to a plurality of fixed instruction positions.
FIG. 106 is a flowchart illustrating a procedure of a process for acquiring a relationship between designated positions.
FIG. 107 is a diagram illustrating an operation example that is interpreted as being within an area;
FIG. 108 is a diagram illustrating an example of data of an operation interpreted as being within an area.
FIG. 109 is a flowchart illustrating a procedure of acquisition processing of a change in positional relationship between designated positions.
FIG. 110 is a diagram illustrating an example of an operation that is interpreted as movement outside a region.
FIG. 111 is a diagram illustrating an example of operation data that is interpreted as movement outside a region;
FIG. 112 is a flowchart illustrating a procedure of instruction interpretation processing based on a positional relationship between a plurality of fixed instruction positions and movement instruction positions.
FIG. 113 is a diagram illustrating an example of an operation that is interpreted as attribute assignment in a region between fixed designated positions.
FIG. 114 is a diagram illustrating an example of operation data that is interpreted as attribute assignment in a region between fixed designated positions.
FIG. 115 is a flowchart illustrating a procedure of instruction interpretation processing using a change in the number of designated positions of a plurality of designated positions.
FIG. 116 is a flowchart showing a procedure of instruction interpretation processing based on a change in the number of initial designated positions.
FIG. 117 is a diagram illustrating an operation example when the operation target is being interpreted as being specified;
FIG. 118 is a diagram illustrating an example of operation data when being interpreted as an operation target designation in progress.
FIG. 119 is a flowchart showing a procedure of instruction interpretation processing based on a change in the number of designated positions.
FIG. 120 is a flowchart showing a procedure of instruction interpretation processing based on an initial pointing position.
FIG. 121 is a diagram illustrating an operation example when it is interpreted as a rotation operation centered on the designated position.
FIG. 122 is a diagram showing an example of data when interpreted as a rotation operation centered on the designated position.
FIG. 123 is a flowchart showing a procedure of processing using a change in the number of final designated positions.
FIG. 124 is a flowchart illustrating a procedure of instruction interpretation processing based on a change in the number of final designated positions.
FIG. 125 is a diagram illustrating an operation example when it is interpreted as a cancel instruction for the immediately preceding operation.
FIG. 126 is a diagram showing an example of operation data when interpreted as a cancel instruction for the immediately preceding operation;
FIG. 127 is a flowchart showing a processing procedure using instruction information other than the instruction locus;
FIG. 128 is a flowchart showing a procedure of processing using instruction information other than the instruction locus;
FIG. 129 is a flowchart illustrating a processing procedure using the total number of designated positions.
FIG. 130 is a flowchart illustrating a procedure of instruction interpretation processing using the number of designated positions.
FIG. 131 is a diagram illustrating an operation example that is interpreted as a page turning operation;
FIG. 132 is a diagram illustrating an example of data interpreted as a page turning operation.
FIG. 133 is a flowchart showing a procedure of processing for acquiring a designated position moving speed as instruction information other than the designated locus.
FIG. 134 is a flowchart showing a procedure of designated position movement speed acquisition processing;
FIG. 135 is a flowchart showing a procedure of instruction interpretation processing based on a designated position moving speed.
FIG. 136 is a diagram showing an operation example when it is interpreted as a page turning operation using a designated position moving speed;
FIG. 137 is a diagram showing an example of data when interpreted as a page turning operation using a designated position moving speed.
FIG. 138 is a flowchart showing a procedure of processing using designated position contact pressure as instruction information other than the designated locus.
FIG. 139 is a flowchart showing a procedure of instruction interpretation processing based on an instruction position contact pressure;
FIG. 140 is a diagram illustrating an example of an operation that is interpreted as a screen movement operation based on an instruction position contact pressure;
FIG. 141 is a diagram illustrating an example of data that is interpreted as a screen movement operation based on a designated position contact pressure;
FIG. 142 is a flowchart showing a procedure of processing using a moving distance of a plurality of designated positions.
FIG. 143 is a flowchart illustrating a procedure of instruction interpretation processing based on a movement distance of a plurality of designated positions.
FIG. 144 is a diagram showing an operation example when interpreted as a page turning operation using the movement distances of a plurality of designated positions.
FIG. 145 is a diagram showing an example of data when interpreted as a page turning operation using the movement distances of a plurality of designated positions.
FIG. 146 is a flowchart showing a processing procedure when attention is paid to immobility times at a plurality of designated positions.
FIG. 147 is a diagram showing an operation example when interpreted as a range specifying operation;
FIG. 148 is a diagram illustrating an example of data when interpreted as a range specifying operation.
FIG. 149 is a diagram illustrating an operation example that is interpreted as an enlargement operation with respect to a specified range;
FIG. 150 is a diagram illustrating an example of data interpreted as an enlargement operation with respect to a specified range.

Claims (5)

Indicated position detecting means capable of simultaneously detecting indicated positions at a plurality of locations;
Indicated area detecting means capable of detecting the area of the indicated position detected by the indicated position detecting means;
Storage means for storing a combination of designated positions and designated position areas detected by the designated position detecting means and the designated area detecting means;
Based on the plurality of designated positions detected immediately before by the designated position detecting means and the current designated positions detected by the designated position detecting means, the locus of movement of the designated positions is identified. A moving locus identifying means for
The movement trajectory identifying means includes
For each of the current plurality of designated positions, the area of the designated position detected by the designated area detecting means and the area of the designated positions immediately before detected by the designated area detecting means are the closest Using the designated position of the area as the immediately preceding designated position with respect to the current designated position, the locus of movement of the plurality of locations is identified, and the plurality of immediately preceding locations stored in the storage means are stored for each of the currently designated multiple designated positions. A position information processing apparatus that stores an instruction position and an instruction area in the storage means in correspondence with the instruction position and the instruction area .   The position information processing apparatus according to claim 1, wherein the indicated position detection unit is a touch panel type detection unit. The position information processing apparatus according to claim 2 , wherein the indication area detection unit detects a touch area of the touch panel of the touch panel type detection unit. An imaging unit for imaging the state where the indicated position detection unit is instructed by an operator;
The position information processing apparatus according to claim 1, further comprising designated position recognition means for recognizing a designated position from an image photographed by the photographing means.   The position information processing apparatus according to claim 1, wherein the indicated position detection unit detects a position of an operator's fingertip.

Images