JP5110588B2 - Portable information terminal, control method thereof, control program, and recording medium - Google Patents

Description

  The present invention relates to a portable information terminal, and more particularly to a portable information terminal that operates a touch panel provided on a display unit, a control method thereof, a control program, and a recording medium.

  2. Description of the Related Art Conventionally, in an information terminal, a touch panel is provided on a display unit, video is displayed on the display unit, images such as buttons corresponding to the operation unit are displayed, and operation information is obtained by allowing a user to operate the touch panel. Various techniques for receiving the input are used.

In such a technique, for example, as disclosed in Non-Patent Document 1, when a user touches a touch screen of a corresponding device with a finger, an image of an area hidden by the finger is displayed so as to be visible. There was something to do. Specifically, referring to FIG. 29, when the user's finger 800 touches the touch screen 900, the image of the area hidden by the finger 800 is shifted from the area hidden by the finger 800, and newly Are displayed in a frame 901.
“Microsoft announces“ Shift ”UI technology that can operate a pen touch screen with just a finger”, [online], May 17, 2007, Nikkei BP, [Search May 15, 2008], Internet <http://itpro.nikkeibp.co.jp/article/NEWS/20070517/271307/>

  However, as described with reference to FIG. 29, even if the area hidden by the finger is only partially shown, the user can grasp the positional relationship between the position where the finger is positioned and the position in the vicinity thereof. It becomes difficult. Therefore, the conventional technique as described with reference to FIG. 29 has no problem when the user's finger is at the operation position desired by the user, but is not at the desired operation position and is desired by the user around it. When searching for an operation position, it is difficult to say that the user can surely perform a touch operation on a desired operation position.

  The present invention has been conceived in view of such circumstances, and its purpose is to enable a user of a portable information terminal to reliably operate at a desired position on a touch panel provided on a display unit. It is.

The portable information terminal according to the present invention includes a display unit, a touch panel provided in front of the display unit, a display control unit that controls a display mode of the display unit according to an operation mode of the touch panel, and the touch panel. includes a special operation determining section for determining whether is operated in a special operating mode, the operating position determination unit that determines the position where operation is performed on the touch panel with respect to the display control unit, the If the special operation determination unit has determined to have been operated in a special operation mode with respect to the touch panel, the display mode of location of the display unit corresponding to the operation of the operating position determination unit determines is made position varying manner, converts the display contents corresponding to the entire of the display unit, the display contents of the display unit, to at least the human width dimension only wholly shifted envisioned finger When the operation position determination unit determines that the position where the operation is performed is a predetermined one side area on the touch panel, the display content is converted to the predetermined other side. When it is determined that the position where the operation is performed is the predetermined other-side region, the display content is shifted in the predetermined one-side direction, and the operation according to the special operation mode is started. in a state of displaying predetermined information on position, characterized Rukoto shifting the display contents.

  In the portable information terminal of the present invention, it is preferable that the display control unit shifts the display content by an amount corresponding to the duration of the operation according to the special operation mode.

In the portable information terminal of the present invention, it is preferable that the display control unit increases the display magnification of the display unit after shifting the display content as the conversion of the display content.

Further, in the portable information terminal of the present invention, the display control unit, when the special operation determination unit has determined to have been operated in a special operation mode with respect to the touch panel, increasing the display magnification of the display unit In addition, it is preferable to realize conversion of the display content.

  In the portable information terminal of the present invention, it is preferable that the display control unit increases the display magnification of the display content by an amount corresponding to the duration of the operation according to the special operation mode.

In the portable information terminal of the present invention, it is preferable that the display control unit shifts the display content after increasing the display magnification of the display unit as the conversion of the display content.

  In the portable information terminal of the present invention, it is preferable that the display control unit returns the entire display of the converted display unit to the one before conversion after the operation according to the special operation mode is resolved.

The portable information terminal of the present invention further includes a determination unit that determines whether or not a position where the operation according to the special operation mode is started corresponds to a position where the anchor text is displayed on the display unit, When the determination unit determines that the position where the operation according to the special operation mode is started does not correspond to the position where the anchor text is displayed on the display unit, the display control unit is configured according to the special operation mode. After the operation is canceled, it is preferable to return the entire display of the converted display unit to the one before conversion.
In the portable information terminal of the present invention, when the user moves the touch operation position on the touch panel, the display control unit displays the predetermined information on the touch panel corresponding to the current touch operation position. When the user moves the touch operation position with respect to the touch panel, the position is displayed at the display position on the touch panel corresponding to the current touch operation position. When the predetermined information is out of the display area of the touch panel, the touch operation position is moved in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information remains in the display area of the touch panel and is displayed. The display content is preferably continuously scrolled.

A method for controlling a portable information terminal according to the present invention is a method for controlling a portable information terminal including a touch panel provided on a front surface of a display unit, and whether or not the touch panel is operated in a special operation mode. and determining, when identifying a position where operation is performed on the touch panel, the step of the determining determines that have been manipulated in the special operation mode, which corresponds to the operating position relative to the touch panel Converting the display content corresponding to the entirety of the display unit so that the display mode of the portion of the display unit changes, and the converting step includes at least the display of the display content of the display unit. The display content is converted by shifting the entire size by an assumed width and the specifying step is performed at the position where the operation is performed. Is specified as a predetermined one side area on the touch panel, the display content is shifted in the predetermined other side direction, and the position where the operation is performed is specified as the predetermined other side area. , the display content is shifted in the direction of said predetermined one side, in a state in which the operation by special operation mode is to display the predetermined information on the start position, and wherein Rukoto shifting the display content To do.
Further, in the method for controlling a portable information terminal according to the present invention, when the user moves the touch operation position on the touch panel, the converting step converts the predetermined information into the touch panel corresponding to the current touch operation position. The display position on the touch panel corresponding to the current touch operation position when the user moves the touch operation position with respect to the touch panel when the user moves the touch operation position with the movement of the touch operation position. When the predetermined information displayed on the touch panel protrudes from the display area of the touch panel, the touch operation position is moved in a direction in which the touch operation position is moved so that the predetermined information remains in the display area of the touch panel and is displayed. It is preferable to continuously scroll the display content in the reverse direction.

Control program of the portable information terminal according to the present invention is a control program for controlling the portable information terminal with a touch panel provided in front of the display unit, the portable information terminal, the touch panel decision and determining whether or not operated in a special operation mode for, identifying a position where operation is performed on the touch screen, and said step of determining is operated in the special operation mode In this case, the display content corresponding to the entire display unit is converted so that the display mode of the portion of the display unit corresponding to the operation position on the touch panel is changed , and the converting step is performed. The display content is converted by shifting the display content of the display unit as a whole by at least a dimension assumed to be the width of a human finger. When the step of specifying and specifying the position where the operation is performed is a predetermined one side region on the touch panel, the display content is shifted in the predetermined other side direction, and the operation is performed. If the specified position is determined to be the predetermined other-side area, the display content is shifted in the predetermined one-side direction, and predetermined information is displayed at the position where the operation according to the special operation mode is started. in the state, and wherein the Rukoto shifting the display contents.
In the control program for a portable information terminal of the present invention, the step of converting may include the step of converting the predetermined information corresponding to the current touch operation position when the user moves the touch operation position on the touch panel. When the touch operation position is moved and displayed at the display position on the touch panel and the user moves the touch operation position with respect to the touch panel, the display on the touch panel corresponding to the current touch operation position The direction in which the touch operation position is moved and operated so that the predetermined information is displayed within the display area of the touch panel when the predetermined information displayed at the position protrudes from the display area of the touch panel. It is preferable that the display content is continuously scrolled in the opposite direction.

Recording medium according to the present invention, there is provided a recording medium recording a control program for controlling the portable information terminal with a touch panel provided in front of the display unit, the control program, the portable information The step of determining whether or not the touch panel is operated in a special operation mode on the terminal, the step of specifying the position where the operation is performed on the touch panel, and the step of determining are the special operation mode. in the case where it is determined to have been operated, so that the display mode of location of the display unit corresponding to the operation position with respect to the touch panel has changed to perform a step of converting the display contents corresponding to the entire of the display unit The converting step includes shifting the display content of the display unit as a whole by at least a dimension assumed to be the width of a human finger. If the step of realizing and converting the display content specifies that the position where the operation is performed is a predetermined one side area on the touch panel, the display content is shifted in the direction of the predetermined other side. When the position where the operation is performed is specified as the predetermined other-side area, the display content is shifted in the predetermined one-side direction, and the operation according to the special operation mode is started. while displaying the predetermined information, characterized by Rukoto shifting the display contents.
In the recording medium of the present invention, when the user moves the touch operation position on the touch panel, the converting step displays the predetermined information on the touch panel corresponding to the current touch operation position. When the user moves the touch operation position with respect to the touch panel, the display is displayed at the display position on the touch panel corresponding to the current touch operation position. When the predetermined information is out of the display area of the touch panel, the touch operation position is moved in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information remains in the display area of the touch panel and is displayed. It is preferable that the display content is continuously scrolled.

According to the present invention, when the user operates the touch panel in a special operation mode, the display mode of the portion corresponding to the operation position on the touch panel of the display unit of the portable information terminal changes. The entire display is converted.

As a result, the display mode of the display unit corresponding to the operation position of the user changes, and the display content of the display unit changes as a whole. Therefore, as described with reference to FIG. 29, the display unit is operated by the user. The display mode of the vicinity of the operation position by the user can be changed as compared with the case where only the vicinity of the location is separately displayed as shown in the frame 901. Therefore, the user can reliably operate a desired location on the touch panel.

  Hereinafter, a mobile phone which is an embodiment of the portable information terminal of the present invention will be described with reference to the drawings. Note that the portable information terminal of the present invention is not limited to a mobile phone. That is, if the portable information terminal of the present invention is a terminal having a touch panel, it is not necessary to have a function specific to a cellular phone such as a communication function.

[1. Configuration of portable information terminal]
FIG. 1 is a front view of a mobile phone as an embodiment of the portable information terminal of the present invention.

  First, referring to FIG. 1A, a mobile phone 100 is provided with a display unit 30 including a liquid crystal display or the like. The display unit 30 includes a document on a network such as a web page, an e-mail by an address book or mailer stored in the mobile phone 100 (software for creating and sending / receiving e-mail, and storing / managing received mail). Various information such as a creation screen can be displayed.

  In the mobile phone 100, a touch panel 40 is provided on the front surface of the display unit 30. The mobile phone 100 can be used in a horizontally long state as shown in FIG. 1 (A), and can also be used in a vertically long state as shown in FIG. 1 (B).

FIG. 2 is a diagram schematically illustrating a hardware configuration of the mobile phone 100.
Referring to FIG. 2, mobile phone 100 performs a control unit 50 for overall control of the operation of mobile phone 100, a control unit 50 for overall control of the operation of mobile phone 100, and data transmission / reception. Antenna 81, communication control unit 80 for processing signals when data is transmitted / received by antenna 81, attitude detection unit 90 for detecting the attitude of a mobile phone, storage unit 60 including a flash memory, touch panel 40, display unit 30, a display control unit 51 for controlling display contents on the display unit 30, a receiver 56 and a microphone 58 mainly used for a call function, a speaker 57 for outputting an alarm sound, and a sound to be output from the receiver 56 and the speaker 57 Voice output control units 53 and 54, voice input control unit 55 for processing voice input to microphone 58, and camera Including the 91. The control unit 50 includes a CPU (Central Processing Unit). The control unit 50 has a built-in timer 50A. The display unit 50 controls the display content of the display unit 30 via the display control unit 51.

  The posture detection unit 90 is for detecting the direction and moving direction of the mobile phone 100 and the acceleration given to the mobile phone 100, and includes, for example, a plurality of gyroscopes, acceleration sensors, and geomagnetic sensors. The orientation of the mobile phone 100 is, for example, whether it is held by the user in a horizontally long state as shown in FIG. 1A, or is held by a user in a vertically long state as shown in FIG. Means. As a technique for detecting the orientation, the moving direction, and the moving speed of the main body of the mobile phone 100 using the attitude detection unit 90, a well-known technique can be adopted, and therefore description thereof will not be repeated here.

  The storage unit 60 includes a program storage unit 61 that stores programs executed by the CPU of the control unit 50, a setting content storage unit 62 that stores setting contents for the mobile phone 100 such as an address book, and various tables and the like described later. A data storage unit 63 that stores various data necessary for executing a program stored in the program storage unit 61 is included.

  Note that the program executed by the CPU of the control unit 50 may be stored in the storage unit 60 in advance, or may be installed later by being downloaded through a network. Further, the program executed by the CPU of the control unit 50 is recorded on a recording medium detachable from the mobile phone 100 instead of being stored in a storage device (storage unit 50) built in the mobile phone 100. May be.

[2. Contents of processing executed in portable information terminal (zoom)]
Next, the contents of processing executed in the mobile phone 100 will be described.

  In the mobile phone 100, the touch panel 40 is continuously touched at one place for a specified time ("threshold value Tmax" described later), thereby increasing the display magnification around the touched place (zoom). Thus, the display content of the display unit 30 is converted. Hereinafter, the contents of the display control process (display control process) including the display conversion will be described with reference to FIGS. 3 and 4 which are flowcharts of the process.

  First, referring to FIG. 3, when a certain screen is displayed on display unit 30 in step S101, for example, when an application is started up in mobile phone 100, control unit 50 displays on touch panel 40 in step S102. To determine if there was a touchdown. Touchdown means switching from a state in which a touch operation on the touch panel 40 is started, that is, a state in which no touch operation is performed on the touch panel 40 to a state in which the touch operation is started. Then, when the control unit 50 determines that there is a touchdown, the process proceeds to step S103.

  In step S103, the control unit 50 acquires the time when the touchdown is detected in step S102 (touch start time T0) and information for specifying the position where the touch operation is started on the touch panel 40 (touch start position P0). For example, the data is stored in the data storage unit 63, and the process proceeds to step S104.

  In step S104, the control unit 50 determines whether or not there is a touch-up. Touch-up refers to a state in which a user's finger on the touch panel 40 is separated from the touch panel 40. If it is determined that touch-up has occurred, the control unit 50 proceeds to step S121. If not, the control unit 50 proceeds to step S105.

  In step S105, the control unit 50 stores the current time Tn and the current touch position Pn in the data storage unit 63, for example, and advances the process to step S106.

  In step S106, the control unit 50 determines whether the difference between the touch start time T0 stored in step S103 and the current time Tn stored in step S105, that is, the time during which the touch operation is continued on the touch panel 40 exceeds the threshold Tmax. Judge whether or not. If it is determined that the threshold is exceeded, the process proceeds to step S107. If it is determined that the threshold Tmax is not yet exceeded, the process proceeds to step S118.

  In step S118, the control unit 50 determines whether or not the movement distance of the operation position (distance between P0 and Pn) while the touch operation on the touch panel 40 is continued exceeds the threshold value Pmax. If it is determined, the process proceeds to step S119, and if it is determined that it has not exceeded, the process returns to step S104.

  In step S119, the control unit 50 determines whether or not there has been a touch-up. On the other hand, if it is determined that there is no touch-up yet, the process proceeds to step S120.

  In step S120, the control unit 50 determines that a drag operation has been performed on the touch panel 40, scrolls the display on the display unit 30 in response to the drag operation, and returns the process to step S119. Here, “corresponding to the drag operation” means, for example, that the direction of scrolling the display is the direction of movement of the operation position in the drag operation.

  In step S121, the control unit 50 determines whether the touch-up position detected in step S104 is a position where the selection item is displayed. If so, the process proceeds to step S122. If it is determined that this is not the case, the process is terminated.

  In step S122, the control unit 50 performs a process based on the content of the selection item determined to be in the touch-up position in step S121, and updates the display content of the display unit 30 based on the execution of the process. The display control process is terminated.

  Referring to FIG. 4, in step S107, control unit 50 determines whether or not there is a touch-up. If it is determined that there is a touch-up, the process proceeds to step S114. If it is determined that there is no touch-up, the process proceeds to step S108. Proceed.

  In step S108, the control unit 50 waits for a predetermined time, and proceeds to step S109.

  In step S109, the control unit 50 determines whether or not the zoom magnification Zn of the display on the current display unit 30 has yet reached the threshold value Zmax relating to the zoom ratio, and proceeds to step S110 when determining that it has not yet reached. If it is determined that the threshold value Zmax has already been reached, the process proceeds to step S113.

  Here, the zoom magnification is a magnification of display enlargement or reduction for an image created for display on the display unit 30 based on an application. In step S110 and step S117, which will be described later, the control unit 50 updates the display content on the display unit 30 so that the overall display magnification of the display unit 30 is changed. The control unit 50 appropriately sets the magnification of the image currently displayed on the display unit 30 in the data storage unit 63 or the like.

  In step S110, the control unit 50 updates the display content of the display unit 30 so that the zoom magnification of the display on the display unit 30 is A (A> 1), and the process proceeds to step S111.

  In step S111, the control unit 50 determines whether or not a drag operation has been performed on the touch panel 40. If it is determined that the pointer 31 (see FIG. 6) is displayed in step S112, the pointer 31 is displayed. Is moved in correspondence with the movement of the touch position by the drag operation, and the process returns to step S111. Whether or not there has been a drag operation is determined, for example, by whether or not the movement distance of the operation position on the touch panel 40 has exceeded the threshold value Pmax.

  On the other hand, when determining in step S111 that there is no drag operation, the control unit 50 returns the process to step S107 as it is.

  If it is determined in step S109 that the current zoom magnification Zn has reached the threshold value Zmax, the process proceeds to step S113. In step S113, the control unit 50 determines whether or not there is a touch-up on the touch panel 40. If it is determined that there is a touch-up, the process proceeds to step S114.

  In step S114, the control unit 50 determines whether or not the position determined to have been touched up in step S113 is a position corresponding to the position where the selection item is displayed on the display unit 30. If it is determined, the process proceeds to step S122, and if not, the process proceeds to step S115.

  In step S122 (see FIG. 3), as described above, the process based on the selected item is executed, and the display content of the display unit 30 is updated based on the execution of the process. Is terminated.

  Returning to FIG. 4, in step S115, the control unit 50 waits for a predetermined time, and proceeds to step S116. The “predetermined time” in step S115 may be the same length as the “predetermined time” in step S108, or may be a different length.

  In step S116, the control unit 50 determines whether or not the zoom ratio Zn of the display on the current display unit 30 is larger than the threshold value Zmin. If so, the process proceeds to step S117. If it is determined that there is no, the process is terminated as it is.

  In step S117, the display content of the display unit 30 is updated so that the zoom magnification in the display unit 30 is B times (0 <B <1), and the process returns to step S115.

  As described above, according to the processing described with reference to FIGS. 3 and 4, the touch panel 40 continues for a time longer than the threshold value Tmax (a range in which the movement distance of the operation position on the touch panel 40 becomes the threshold value Pmax). When the touch operation is performed (YES in S106), the zoom rate on the display unit 30 is increased by A times until the touch-up is performed or until the zoom rate Zn of the display on the display unit 30 reaches the threshold value Zmax. It is updated every certain time (step S108) so as to zoom up (S107 to S112). Such zooming up of the display of the display unit 30 will be described in more detail with reference to FIG.

  FIG. 5 shows a state in which the zoom ratio of the display on the display unit 30 sequentially increases as FIGS. 5 (A) to 5 (D). Specifically, the display content indicated by the frame 30A in FIG. 5A corresponds to the frame 30B with the zoom rate increased in FIG. 5B, and further, in FIG. In FIG. 5D, the zoom rate is increased to correspond to the display content in the frame 30D.

  Such conversion of the display content on the display unit 30 so as to increase the zoom rate is performed, for example, in a video random access memory (VRAM) for the control unit 50 to display the display unit 30 in accordance with execution of the application. This is realized by converting the stored image so that the zoom ratio is increased and displayed. In the mobile phone 100, the VRAM is included in the display control unit 51, for example.

  Further, when zooming up the display on the display unit 30, it is preferable that the display is performed around the point where the user touches the touch panel 40. In FIG. 5A to FIG. 5D, the user's finger that performs an operation on the touch panel 40 is schematically shown by a one-dot chain line. Then, in FIG. 5A to FIG. 5D, the display content on the display unit 30 is zoomed up, with the tip of the finger actually touching the touch panel 40 as the center.

  The zoom-up as shown in steps S107 to S112 is continued until it is determined in step S102 that there is a touch-down, and then it is determined in steps S104 and S107 that there is a touch-up. When it is determined that it has been completed, the process ends. In other words, depending on the length of time during which the touch-up is continued, if there is a case where zoom-up is performed from the state shown in FIG. 5A to the state shown in FIG. 5D, FIG. In some cases, zoom-up is completed from the state shown in A) to the state shown in FIG.

  In the display control process described above, the display content in the display unit 30 is changed from a time interval of FIG. 5A to FIG. 5B and from FIG. 5B to FIG. 5C. Then, as shown in FIGS. 5 (C) to 5 (D), it is updated so as to be zoomed up in order. The fixed time in this case is, for example, FIG. 5 (A), FIG. (B), a time period in which display contents are zoomed up in the order of FIG. 5 (C) and FIG. 5 (D) when it is viewed by humans.

  On the other hand, in steps S115 to S117, the display content of the display unit 30 zoomed up as described above is zoomed down and the display magnification is returned until the display magnification becomes the threshold value Zmin. In the display control process described above, the zoom-down is started in response to touch-up other than the selection item position (YES in step S113 and NO in step S114). The touch operation (for example, double click) may be used as a trigger. If the threshold value Zmin is set to 1, steps S115 to S117 can be returned to the original display magnification (before the zoom magnification is first increased in step S110). The selection item position is a position where the mobile phone 100 executes some processing in response to an operation of selecting, for example, an anchor text or a button is arranged.

  Further, if the display magnification (zoom rate) on the display unit 30 is zoomed up to the threshold value Zmax by the processing in steps S107 to S112, immediately after that (even if no touch operation or the like is performed), the original in steps S115 to S117 is performed. A process of returning the display magnification toward the display magnification (a process of zooming down) may be started.

  Further, such zoom-down processing may be omitted. That is, once zoomed in, the display on the display unit 30 may be continued at the display magnification after zooming up.

  In the display control process described above, if the movement distance of the user's operation position on the touch panel 40 exceeds the threshold value Pmax in step S118, it is determined that a drag operation is performed and there is a touch-up (NO in step S119) In step S120, scrolling based on the drag operation is performed.

  In the display control process described above, if it is determined in step S122 that there is a selection item at the touch-up position, the process based on the content of the selection item is executed, and the display unit is executed based on the execution of the process. 30 display contents are updated. Specifically, for example, as shown in FIG. 6A, when touch-up is performed on an anchor text jumping to a news item “Start delivery of terminal”, the control unit 50 6B, a file corresponding to a URL (Uniform Resource Locator) linked to the anchor text is acquired, and the file is displayed on the display unit 30.

  In FIG. 6A, a pointer 31 is displayed in the display unit 30. As shown in FIG. 6A, the control unit 50 includes an anchor included in a position that is a target of the touch operation by the user (or a position that is a target of the touch operation) in the display unit 30. It is preferable to display the pointer 31 at a specific position in the text. The pointer 31 constitutes predetermined information displayed at a position where an operation according to a specific operation mode is started on the touch panel.

[3. First Modification of Display Control Processing (Shift Processing)]
A first modification of the display control process described above will be described.

  In this modification, when the touch panel 40 is continuously touched at one place for a specific time ("threshold value Tmax" described later), the display content of the touch-operated part is touched. The display content of the entire display unit 30 is converted so that it can be moved within the display unit 30 and displayed in another place without being hidden by a finger considered to be. Hereinafter, the contents of the display control processing (display control processing) of the control unit 50 including such display conversion will be described with reference to FIGS. 7 and 8 which are flowcharts of the processing.

  First, referring to FIG. 7, when a screen is displayed on display unit 30 in step S <b> 201, such as when an application is started up in mobile phone 100, control unit 50 displays on touch panel 40 in step S <b> 202. To determine if there was a touchdown. Then, when the control unit 50 determines that there is a touchdown, the process proceeds to step S203.

  In step S203, the control unit 50 acquires the time (touch start time T0) when the touchdown is detected in step S202 and information (touch start position P0) that specifies the position where the touch operation is started on the touch panel 40. For example, the data is stored in the data storage unit 63, and the process proceeds to step S204.

  In step S204, the control unit 50 determines whether or not there is a touch-up. If it is determined that there is a touch-up, the control unit 50 proceeds to step S221. If not, the control unit 50 proceeds to step S205.

  In step S205, the control unit 50 stores the current time Tn and the current touch position Pn in the data storage unit 63, for example, and advances the process to step S206.

  In step S206, the control unit 50 determines whether the difference between the touch start time T0 stored in step S203 and the current time Tn stored in step S205, that is, the time during which the touch operation is continued on the touch panel 40 exceeds the threshold Tmax. Judge whether or not. If it is determined that the threshold value has been exceeded, the process proceeds to step S207. If it is determined that the threshold value Tmax has not been exceeded, the process proceeds to step S218.

  In step S218, the control unit 50 determines whether or not the movement distance of the operation position (distance between P0 and Pn) while the touch operation on the touch panel 40 is continued exceeds the threshold value Pmax. If it is determined, the process proceeds to step S219, and if it is not exceeded, the process returns to step S204.

  In step S219, the control unit 50 determines whether or not there is a touch-up, and ends the process when determining that there is a touch-up. On the other hand, if it is determined that there is no touch-up yet, the process proceeds to step S220.

  In step S220, the control unit 50 determines that a drag operation has been performed on the touch panel 40, scrolls the display on the display unit 30 in response to the drag operation, and returns the process to step S219. Here, “corresponding to the drag operation” means, for example, that the direction of scrolling the display is the direction of movement of the operation position in the drag operation.

  In step S221, the control unit 50 determines whether or not the touch-up position detected in step S204 is a position where the selection item is displayed. If so, the process proceeds to step S222. If it is determined that this is not the case, the process is terminated.

  In step S222, the control unit 50 performs a process based on the content of the selection item determined to be in the touch-up position in step S221, and updates the display content of the display unit 30 based on the execution of the process. The display control process is terminated. The updating of the display content here is as described with reference to FIGS. 6A and 6B, for example.

  Referring to FIG. 8, in step S207, control unit 50 determines whether or not there is a touch-up. If it is determined that there is a touch-up, the process proceeds to step S214. If it is determined that there is no touch-up, the process proceeds to step S208. Proceed.

  In step S208, the control unit 50 waits for a predetermined time and advances the process to step S209.

  In step S209, the control unit 50 determines whether the display shift amount Sn on the current display unit 30 has not yet reached the threshold value Smax relating to the shift amount. If it is determined that it has not yet reached, the process proceeds to step S210. If it is determined that the threshold value Smax has already been reached, the process proceeds to step S213.

  Here, the shift amount is a distance shifted by the process of step S210 described later with respect to an image created for display on the display unit 30 based on the application. In the display control process described with reference to FIGS. 7 and 8, the display contents on the display unit 30 are updated so that the entire display of the display unit 30 is shifted in steps S210 and S217. The control unit 50 appropriately stores the amount (distance) by which the display is shifted, together with the shifted direction, in the data storage unit 63 or the like.

  Referring to FIG. 9, when partial image G11 is cut out from initial content G10 as an initial image to be displayed on display unit 30 based on the application and displayed on display unit 30, it is shifted by step S210 described later. Then, if the image that is cut out and displayed on the display unit 30 changes to the partial image G12, the distance Sn at which the cutout position has changed becomes the shift amount. In FIG. 9, the partial image G11 is described by a one-dot chain line, and the partial image G12 is described by a broken line.

  Also, as shown in FIG. 9, when the cutout position changes downward from the partial image G11 to the partial image G12, the P point included in both partial images is displayed on the display unit when the partial image G11 is cut out. Although displayed at the lower part of 30, when the partial image 12 is cut out, it is displayed at the upper part of the display unit 30. That is, the fact that the display content on the display unit 30 is shifted upward corresponds to the downward shift of the cutout position of the partial image to be cut out.

  Returning to FIG. 8, in step S <b> 210, the control unit 50 updates the display content of the display unit 30 so that the display content on the display unit 30 is shifted upward or downward by the distance X, and the process proceeds to step S <b> 211. Proceed. The control unit 50 shifts the display content upward if the touch start position P0 is below the broken line 40X schematically shown in the display unit 30 in FIG. 10, and displays the display content if it is above the broken line 40X. Is shifted downward. The broken line 40X can be set, for example, at a distance W from the upper end of the display unit 30 (about the width of a finger, which will be described later with reference to FIG. 13), but may be changed as appropriate according to user settings and the like. .

  In step S211, the control unit 50 determines whether or not a drag operation has been performed on the touch panel 40. If it is determined that the pointer 31 described later with reference to FIG. The display position of the pointer 31 is moved corresponding to the movement of the touch position by the drag operation, and the process returns to step S211. Whether or not there has been a drag operation is determined, for example, by whether or not the movement distance of the operation position on the touch panel 40 has exceeded the threshold value Pmax.

  On the other hand, when determining in step S211 that there is no drag operation, the control unit 50 returns the process to step S207 as it is.

  If it is determined in step S209 that the current shift amount Sn has reached the threshold value Smax, the process proceeds to step S213. In step S213, the control unit 50 determines whether or not there is a touch-up on the touch panel 40. If it is determined that there is a touch-up, the process proceeds to step S214.

  In step S213, the process waits until there is a touch-up. In this state, as described in steps S211 to S212, a process of moving the display position of the pointer 31 based on the drag operation is executed. May be. The movement of the display position of the pointer 31 will be described later with reference to FIGS.

  In step S214, the control unit 50 determines whether or not the position determined to have been touched up in step S213 is a position corresponding to the position where the selection item is displayed on the display unit 30. If it is determined, the process proceeds to step S222. If not, the process proceeds to step S215.

  In step S222 (see FIG. 7), as described above, the process based on the selected item is executed, and the display content of the display unit 30 is updated based on the execution of the process. Is terminated.

  Returning to FIG. 8, in step S215, the control unit 50 waits for a predetermined time, and proceeds to step S216.

  In step S216, the control unit 50 determines whether or not the current display shift amount Sn in the display unit 30 is greater than the threshold value Smin. If so, the process proceeds to step S217. If it is determined that there is no, the process is terminated as it is.

  In step S217, the display contents on the display unit 30 are updated so as to be shifted by the distance Y in the direction opposite to the direction shifted in step S210 (downward or upward), and the process returns to step S215.

  As described above, according to the processing described with reference to FIGS. 7 and 8, the touch panel 40 continues for a time longer than the threshold value Tmax (a range in which the movement distance of the operation position on the touch panel 40 becomes the threshold value Pmax). If the touch operation is performed (YES in S206), the display content on the display unit 30 is upward or downward until the touch-up is performed or until the display shift amount Sn of the display unit 30 reaches the threshold value Smax. (S207 to S212).

  The shift of the display content will be specifically described with reference to FIG. 11 and FIG. FIG. 11 shows a state where the display content is shifted upward, and FIG. 12 shows a state where the display content is shifted downward.

  Referring to FIG. 11, in FIGS. 11A and 11B, a user's finger that performs a touch operation on touch panel 40 is indicated by a dashed line. FIG. 11B shows a state in which the display content on the display unit 30 is shifted upward with respect to FIG. In FIG. 11A, an area in the vicinity of the part touched by the user is schematically shown as the frame 30E. In FIG. 11B, the content displayed in the area corresponding to the frame 30E in FIG. 11A is shifted in the frame 30F, that is, upward in the display unit 30 with respect to FIG. It is displayed at the position.

  Referring to FIG. 12, in FIGS. 12A and 12B, the user's finger that performs a touch operation on touch panel 40 is indicated by a dashed line. FIG. 12B shows a state in which the display content on the display unit 30 is shifted downward with respect to FIG. In FIG. 12A, an area in the vicinity of the part touched by the user is schematically shown as the frame 30G. In FIG. 12B, the content displayed in the area corresponding to the frame 30G in FIG. 12A is shifted within the frame 30H, that is, downward in the display unit 30 with respect to FIG. It is displayed at the position.

  Such conversion of the display content on the display unit 30 to shift the display is performed by, for example, displaying the cutout position of the image cut out and stored in the VRAM by the control unit 50 for display on the display unit 30. As described with reference to FIG.

  Further, the shift in steps S207 to S212 is continued until the shift amount becomes Smax. The shift amount Smax is, for example, at least a distance (distance W) about the width of the finger as shown in FIG. This is to make it possible for the user to visually recognize the image displayed at the place where the touch operation is performed, which is hidden by the touched finger itself, by shifting the display contents.

  In addition, said distance W can also be preset and the control part 50 can also be determined based on a user's touch operation. That is, when a touch operation is performed on the touch panel 40, the control unit 50 extracts information for specifying a region where the touch operation is performed, and uses the information of the extracted region, for example, as illustrated in FIG. It is also possible to calculate the distance W by patterning as shown in FIG.

  The display content shift as shown in steps S207 to S212 is continued until it is determined in step S202 that there is a touchdown, and then in steps S204 and S207, where it is determined that there is a touchup. If it is determined that there is, it ends. In other words, depending on the length of time during which the touch-up is continued, the display content may be shifted before the shift amount reaches Smax.

  In the display control process described above, the display content in the display unit 30 is updated so as to shift by a distance X at regular time intervals. The certain time in this case is, for example, a time that seems to be continuously performed when the display content is shifted by a human.

  On the other hand, in steps S215 to S217, the display content of the display unit 30 zoomed up as described above is shifted in the reverse direction to step S210 and the display position is returned until the shift amount reaches the threshold value Smin. In the display control process described with reference to FIG. 7 and FIG. 8, the reverse shift is triggered by the touch-up other than the selected item position (YES in step S213 and NO in step S214). Although started, it may be triggered by another special kind of touch operation (for example, double click). If the threshold value Smin is set to 0, steps S215 to S217 can be returned to the original display position (before the display contents are first shifted in step S210).

  Further, when the display content of the display unit 30 is shifted to the threshold value Smax by the processing of steps S207 to S212, immediately after that (even if no touch operation or the like is performed), the display is performed toward the original display position in steps S215 to S217. Processing for returning the position (processing for returning the display position) may be started.

  In addition, such processing for returning the display position may be omitted. That is, once the display contents are shifted, the display on the display unit 30 may be continued at the display position.

  Further, when updating the display that shifts the display content on the display unit 30 described with reference to FIGS. 7 and 8, the pointer 31 is displayed as in FIG. Thus, it is preferable to shift the display position of the pointer 31 as well. FIGS. 14A and 14B are diagrams showing a state in which a pointer 31 is added and displayed in the display unit 30 with respect to FIGS. 11A and 11B.

Referring to FIG. 14, when the display content on display unit 30 is updated from the one shown in FIG. 14A to the one shown in FIG. 14B, it is shown in frame 30G in FIG. 14A. The information displayed at the position, that is, at the top of the display unit 30 is displayed at the position indicated by the frame 30H in FIG. 14B, that is, at the center of the display unit 30. Then, the pointer 31 displayed at the operation position on the touch panel 40 by the user in FIG. 14A leaves the operation position in FIG. 14B and is shifted with the display content on the display unit 30. Is displayed.

Furthermore, on the display unit 30 shown in FIG. 14B, a pointer 32 is displayed at a position where a touch operation is performed on the actual touch panel 40, and the pointer 31 and the pointer 32 are associated with each other. A line 33 is displayed. In the mobile phone 100, the display contents are displayed in a shifted manner, so that the location that is the user's operation target is not hidden by the finger operated by the user. In addition, since the pointer 31 and the pointer 32 are displayed, and these are displayed in association with each other by the line 33, the user can easily determine that the actual touch operation position is different from the operation target point. Can be recognized.

The pointer 32 is displayed from the time when the display content shift on the display unit 30 described with reference to FIGS. 7 and 8 is started, and gradually moves away from the pointer 31 as the display content is shifted. Is preferably displayed. Accordingly, the user can more intuitively and surely understand that the pointer 32 is displayed corresponding to the operation position on the touch panel 40 at the start of the display content shift. .

[4. Second Modification of Display Control Processing (Zoom / Shift Processing)]
A second modification of the above display control process will be described.

  In the display control process described with reference to FIGS. 3 and 4, the touch-operated part and its vicinity are zoomed up to the zoom magnification Zmax by touching one place on the touch panel 40 for a specific time or longer. As shown, the display content of the display unit 30 has been updated. In this modification, the display operation is further shifted by a predetermined distance (Smax) after zooming up to the zoom magnification Zmax by performing the touch operation.

  15 and FIG. 16 show a changed part of the part shown in FIG. 4 in the flowchart of the display control process described with reference to FIG. 3 and FIG. That is, the flowchart of the process of this modification is comprised by FIG. 3, FIG. 15 and FIG.

  In this modification, in step S106 (see FIG. 3), the control unit 50 continues the touch operation on the touch panel 40, that is, the difference between the touch start time T0 stored in step S103 and the current time Tn stored in step S105. It is determined whether or not the elapsed time exceeds the threshold value Tmax. If it is determined that the time has exceeded, the process proceeds to step S107 (see FIG. 15).

  Referring to FIG. 15, when the process proceeds to step S107, the process of zooming up the display on display unit 30 is executed in steps S107 to S112, as described with reference to FIG. .

  If it is determined in step S109 that the zoom rate has reached the threshold value Zmax (NO in step S109), the process proceeds to step S207.

  In step S207 to step S212, the control unit 50 displays the display unit 30 until the touch-up is performed and the shift amount becomes Smax, similarly to step S207 to step S212 described with reference to FIG. Shift the display content of.

  If it is determined that there is a touch-up during the shift, the control unit 50 advances the process to step S121A.

  When the shift amount becomes Smax (NO in step S209), the process proceeds to step S313.

  Referring to FIG. 16, in step S313, control unit 50 determines whether or not there is a touch-up. If it is determined that there is a touch-up, the process proceeds to step S121A, and if it is determined that there is no touch-up, the process proceeds to step S314.

  In step S314, the control unit 50 determines whether or not a drag operation has been performed on the touch panel 40. If it is determined that the drag operation has been performed, in step S315, the display unit 30 updates the display content on the display unit 30 based on the drag operation. The process returns to S313. If it is determined in step S314 that there is no drag operation, the control unit 50 returns the process to step S313 as it is.

  In step S121A, similarly to step S121 in FIG. 3, the control unit 50 determines whether or not the touch-up position detected in step S104 is a position where the selection item is displayed. If it is determined that there is, the process proceeds to step S122A, and if it is not, the process proceeds to step S115.

  In step S122A, as in step S122A of FIG. 3, the control unit 50 executes processing based on the content of the selection item determined to be in the touch-up position in step S121A and displays based on the execution of the processing. The display content of the unit 30 is updated, and the display control process is terminated.

  In step S115 to step S117, the control unit 50 returns the zoom rate in the display unit 30 to the original zoom rate, and then proceeds to step S215.

  In step S215 to step S217, the control unit 50 shifts the display content in the control unit 30 so as to return to the original display position by shifting the display content in the direction opposite to the shift direction in step S207 to step S212. If it is determined that the shift amount is equal to or less than the threshold value Smin (NO in step S216), the display control process is terminated.

  According to the display control process of this modification described above, when the user continues to touch the touch panel 40 without dragging, the display content of the display unit 30 is zoomed up around the touch position or the vicinity thereof (step S107). To step S112), and then shifted by a maximum Smax. That is, if the touch operation is continued without dragging the touch panel 40 while the display content shown in FIG. 17A is displayed on the display unit 30, the display content of the display unit 30 is As shown in FIG. 17 (B), it is updated so as to be enlarged around the touched position or the vicinity thereof, and further shifted upward (or downward) as shown in FIG. 17 (C). Updated to In this case, the position corresponding to the touch position or the vicinity thereof corresponds to the corresponding position of the operation position on the touch panel 40 of the display unit 30.

  As a result, the display content in the frame 301A in FIG. 17A is enlarged as indicated by a frame 301B in FIG. 17B and then shifted as indicated by a frame 301C in FIG. 17C.

[5. Third Modification of Display Control Processing (Shift / Zoom Processing)]
A third modification of the above display control process will be described.

  In the display control process described with reference to FIGS. 7 and 8, the touch panel 40 is continuously touched at one place for a specific time or longer, so that the display content of the display unit 30 is entirely the maximum distance Smax. The display content of the display unit 30 has been updated so as to be shifted. In this modified example, by performing the touch operation, the display content is shifted and then zoomed up to the zoom magnification Zmax.

  FIGS. 18 and 19 show a changed part of the part shown in FIG. 8 in the flowchart of the display control process described with reference to FIGS. 7 and 8. That is, the flowchart of the process of the present modification is configured by FIG. 7, FIG. 15, and FIG.

  In this modification, in step S206 (see FIG. 7), the control unit 50 continues the touch operation on the touch panel 40, that is, the difference between the touch start time T0 stored in step S203 and the current time Tn stored in step S205. It is determined whether or not the elapsed time exceeds the threshold value Tmax, and if it is determined that the time has exceeded, the process proceeds to step S207 (see FIG. 18).

  Referring to FIG. 18, when the process proceeds to step S207, the process of shifting the display on display unit 30 is executed in steps S207 to S212, as described with reference to FIG.

  If it is determined in step S209 that the shift amount has reached the threshold value Smax (NO in step S209), the process proceeds to step S107.

  In step S107 to step S112, the control unit 50 displays the display unit 30 until touch-up is performed and the zoom ratio becomes Zmax, similarly to step S107 to step S112 described with reference to FIG. Zoom up the display content of.

  If it is determined that there is a touch-up while zooming up (YES in step S107), control unit 50 advances the process to step S121A.

  When the zoom ratio becomes Zmax (NO in step S109), the process proceeds to step S413.

  Referring to FIG. 19, in step S413, control unit 50 determines whether or not there is a touch-up. If it is determined that there is a touch-up, the process proceeds to step S221A, and if it is not, the process proceeds to step S414.

  In step S414, the control unit 50 determines whether or not a drag operation has been performed on the touch panel 40. If it is determined that the drag operation has been performed, in step S415, the display unit 30 updates the display content on the display unit 30 based on the drag operation. The process returns to S413. If it is determined in step S414 that there is no drag operation, the control unit 50 returns the process to step S413 as it is.

  In step S221A, similarly to step S221 in FIG. 7, the control unit 50 determines whether or not the touch-up position detected in step S104 is a position where the selection item is displayed. If it is determined that there is, the process proceeds to step S122A, and if it is not, the process proceeds to step S115.

  In step S222A, as in step S122A of FIG. 3, the control unit 50 executes processing based on the content of the selection item determined to be in the touch-up position in step S121A and displays based on the execution of the processing. The display content of the unit 30 is updated, and the display control process is terminated.

  In step S115 to step S117, the control unit 50 returns the zoom rate in the display unit 30 to the original zoom rate, and then proceeds to step S215.

  In step S215 to step S217, the control unit 50 shifts the display content in the control unit 30 so as to return to the original display position by shifting the display content in the direction opposite to the shift direction in step S207 to step S212. If it is determined that the shift amount is equal to or less than the threshold value Smin (NO in step S216), the display control process is terminated.

  According to the display control process of the present modification described above, if the user continues to touch the touch panel 40 without performing a drag operation, the maximum Smax is shifted, and thereafter, the display content of the display unit 30 is changed to the touch position or the vicinity thereof. The image is zoomed up as the center (steps S107 to S112). That is, when the touch operation is continued without dragging the touch panel 40 when the display content shown in FIG. 20A is displayed on the display unit 30, the display content of the display unit 30 is as shown in FIG. As shown in FIG. 20 (B), it is updated so that it is shifted upward (or downward), and then, as shown in FIG. 20 (C), it is enlarged around the touched position or its vicinity. Updated to

  Accordingly, the display content in the frame 302A in FIG. 20A is shifted upward as indicated by a frame 302B in FIG. 20B, and then shifted as indicated by a frame 302C in FIG. 20C. .

[6. Explanation of display control]
Hereinafter, points that should be particularly mentioned in the display control of the display unit 30 in the mobile phone 100 will be described.

(1) Display control during standby for touch-up As described in the first modification of the display control process, in step S213, the mobile phone 100 is in a standby state until touch-up occurs. The process of moving the display position of the pointer 31 based on the drag operation (step S211 to step S212) may be executed.

  Here, the display control of the display unit 30 by the control unit 50 in a state where the shift to the threshold is completed and the touch-up is awaited as in step S213 will be described with reference to FIGS. In this example, the display content of the display unit 30 is shifted until the threshold shift amount is reached, then zoomed until the threshold zoom ratio is reached, and the touch-up is waited in that state.

  First, referring to FIG. 21, a pointer 31 indicating the position of the user's touch operation is displayed on the display unit 30. When the touch operation is continued for the threshold value Tmax or more in this state, the display content of the display unit 30 shifts to that shown in FIG. The display of the pointer 31 may be started when the touch operation is started, or may be started on the condition that the touch operation is continued for the threshold value Tmax or more.

  Referring to FIG. 22, in display unit 30, the display content is shifted upward, and accordingly, pointer 32 is displayed above pointer 31. In addition, a line 33 connecting the pointer 31 and the pointer 32 is displayed on the display unit 30. Thereafter, the display content of the display unit 30 shifts to that shown in FIG. Here, the pointer 31 indicating the position where the actual touch operation is performed is not necessarily displayed. That is, at least the pointer 32 and the line 33 may be displayed on the display unit 30.

  Next, referring to FIG. 23, even if the display content is enlarged with respect to that shown in FIG. 22, pointer 32 is displayed correspondingly in FIG. 22 (and FIG. 21). It is displayed so as to correspond to the contents (menu “anchor text” “start delivery of terminal”). In the present embodiment, a corresponding display is realized by displaying the pointer 32 on the menu. The standby state in step S213 corresponds to a state in which the display of shift and zoom is completed as shown in FIG.

  As shown in FIG. 24, when the user's finger is slid rightward from the state shown in FIG. 23 and the touch-operated position on the touch panel 40 is also slid rightward, the position where the pointer 31 is displayed. Moves according to the position where the touch operation is performed, and the display position of the pointer 32 also moves in the same manner. Note that the display positions of the pointer 31 and the pointer 32 are moved according to the position of the touch operation as shown in FIG. 24 by the processing of step S211 and step S212. The same display control is performed in steps S111 and 112, steps S314 and 315, and steps S414 and 415.

  In FIG. 24, the drag operation is performed outside the anchor text, and the pointer 32 is displayed in an area where the selection item position (anchor text or the like) on the display unit 30 is not displayed. In this state, when the touch operation on the touch panel 40 is released, the display of the pointers 31 and 32 and the line 33 ends as shown in FIG. In FIG. 25, for reference, the display position immediately before the pointer 32 is shown as a dotted line 31A. If the touch-up is performed at a position other than the selection item position as shown in FIG. 25 if the process is waiting in step S213, the process proceeds to step S215.

(2) Scrolling In the present embodiment described above, the control unit 50 shifts the display content of the display unit 30 in steps S209 to S210 (see FIG. 15), or steps S314 to S315 (FIG. 16). When it is determined that the pointer 32 can no longer be displayed in the display unit 30 by updating the display content of the display unit 30 in (see), it is preferable to continuously shift the display content on the screen.

  For example, consider a case where the user further performs a drag operation in the upward direction from the state shown in FIG. In the state shown in FIG. 26A, it is assumed that the display content on the display unit 30 is shifted and / or zoomed up to a threshold value by a continuous touch operation by the user. On the display unit 30, pointers 31 and 32 and a line 33 are displayed.

  In this state, as shown in FIG. 26B, when the user performs a drag operation by moving the finger upward on the touch panel 40, the pointer 32 is as shown in FIG. In addition, it is displayed outside the display unit 30. In FIG. 26B, it is shown that the portions indicated by the dotted lines of the pointer 32 and the line 33 are not actually displayed on the display unit 30.

  Then, as shown in FIG. 26B, when the pointer 32 is located outside the upper end of the display unit 30 and is not displayed in the display unit 30, the control unit 50 causes the display content of the display unit 30 to move downward. It is preferable to scroll continuously. The downward scrolling is continuously performed while the user's touch operation continues and the pointer 32 is outside the display unit 30.

  When the user performs a drag operation while scrolling, the position where the pointer 32 is displayed is changed accordingly. The display position of the pointer 32 is moved by such a drag operation, and as a result, the pointer 32 is displayed in the display unit 30.

  FIG. 26C shows a state in which the pointer 32 is displayed in the display unit 30 when the user performs a drag operation downward from the state shown in FIG. .

  Then, as shown in FIG. 26C, when the entire pointer 32 is displayed in the display unit 30 by the user's drag operation, the scroll display is stopped. In FIG. 26C, the position of the finger before the drag operation is indicated by a dotted line, and the position of the finger after the drag operation is indicated by a one-dot chain line.

  In addition, such a display is made when a series of display control about the display part 30 which was demonstrated with reference to FIG. 26 (A), FIG.26 (B), and FIG.26 (C) is implement | achieved. In this period, the user continues to perform a touch operation on the touch panel 40 without touching up once.

  Further, the scroll display may be stopped when the upper end of the pointer 32 reaches the upper end of the content (the upper end of the entire content G10 in FIG. 9) during the scrolling.

  Further, here, a case has been described in which the drag operation is further performed upward from the state shown in FIG. 26A, but the user performs a touch operation from the position indicated by the alternate long and short dash line in FIG. Even when the operation is started, scroll display is performed until the position of the pointer 32 reaches the position shown in FIG. That is, when a touch operation is started from a position as shown in FIG. 26B, processing for shifting the display content of the display unit 30 upward is performed. At this time, the pointer 32 is outside the display unit 30. Therefore, the display content of the display unit 30 is continuously scrolled downward.

  The scrolling of the display content of the display unit 30 in this way is particularly effective when browsing a large page (content) on a device having a small display unit such as the mobile phone 100. If such a scrolling process is not performed, in order to display the upper part of the content that is far away from the current display position in the screen of the display unit 30, it is necessary to scroll in the screen of the display unit 30. The drag operation (scrolling based on the drag operation in step S220 (see FIG. 7)) is repeatedly required, and it may be necessary to provide a special button for scrolling the screen instead of such an operation. . When a scroll button is provided, the button at a fixed position must be selected. On the other hand, when the scroll is performed as described with reference to FIG. 26, the scroll operation can be performed at the position where the finger can reach at any position in the page (content). In the present embodiment, since the entire screen of the display unit 30 is shifted and displayed, scrolling can be performed in the same manner as the operation for performing the shift display, and the user learns a plurality of operations. Intuitive operation is possible.

  FIG. 27 is a flowchart of the processing described above with reference to FIG. 26. Steps S313 to S315 in “4. Zoom / shift processing” described with reference to FIGS. It is a flowchart of the process replaced with the process (refer FIG. 16) of step S121A and S122A.

  Referring to FIG. 27, when the shift amount becomes Smax (when NO is determined in step S209), the process proceeds to step S313, and in step S313, control unit 50 determines whether or not there is a touch-up. If it is determined that there is, the process proceeds to step S121A, and if it is determined that there is not, the process proceeds to step S314.

  In step S314, the control unit 50 determines whether or not a drag operation has been performed on the touch panel 40. If it is determined that the drag operation has been performed, in step S315A, the display content on the display unit 30 is updated based on the drag operation. The process proceeds to S330. On the other hand, if it is determined in step S314 that there is no drag operation, the control unit 50 proceeds to step S330 as it is.

  In step S121A, the control unit 50 determines whether or not the touch-up position detected in step S104 (see FIG. 3) is a position where the selection item is displayed, and determines that this is the case. The process proceeds to step S122A, and if it is not, the process proceeds to step S115 (see FIG. 16).

  In step S122A, as in step S122A of FIG. 3, the control unit 50 executes processing based on the content of the selection item determined to be in the touch-up position in step S121A and displays based on the execution of the processing. The display content of the unit 30 is updated, and the display control process is terminated.

  On the other hand, in step S330, the control unit 50 determines whether or not the pointer 32 is displayed in the display unit 30. If it is determined that the pointer 32 is displayed, the control unit 50 proceeds to step S332, and the pointer 32 is moved to FIG. If it is determined that it is not displayed in the display unit 30 as shown in (), the process proceeds to step S331. In step S331, the control unit 50 shifts the display content of the display unit 50 in the direction opposite to the shift direction in the display content shift process (steps S209 to S212 (see FIG. 15)) performed so far. The scroll display is performed for a fixed distance, and the process returns to step S313.

  In step S332, the control unit 50 determines whether or not the pointer 31 is displayed on the display unit 30 at a position from the lower end of the display unit 30 to the broken line 41X shown in FIG. Referring to FIG. 28, the broken line 41X can be set to a position at an arbitrary distance predetermined from the lower end of the display unit 30, but may be appropriately changed according to a user setting or the like.

  Returning to FIG. 27, when the control unit 50 determines that the pointer 31 is displayed at such a position, the control unit 50 proceeds to step S333 and determines that the pointer 31 is not displayed at such a position. Then, the process returns to step S313.

  In step S333, the control unit 50 scrolls the display content of the display unit 50 by a predetermined distance in the same direction as the shift direction in the display content shift process (steps S209 to S212 (see FIG. 15)). The process returns to step S313.

  When the pointer 31 is displayed below the display unit 30 by the process described with reference to FIG. 27, the control unit 50 scrolls the display content of the display unit 30 upward. The upward scrolling is continued until the position of the pointer 31 is changed to a position above the threshold value on the display unit 30 based on the drag operation performed by the user. During scrolling, the position of the pointer 32 stops at the position after the shift process until a drag operation is performed.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims. In addition, it is intended that the matters described in the respective embodiments and modifications are combined as much as possible.

It is a front view of the mobile telephone which is one Embodiment of the portable information terminal of this invention. It is a figure which shows typically the hardware constitutions of the mobile telephone of FIG. 3 is a flowchart of a display control process executed in the mobile phone of FIG. 3 is a flowchart of a display control process executed in the mobile phone of FIG. It is a figure for demonstrating the change of the display content in the display part of the mobile telephone of FIG. It is a figure for demonstrating the change of the display content in the display part of the mobile telephone of FIG. 5 is a flowchart of a first modification of the display control process shown in FIGS. 3 and 4. 5 is a flowchart of a first modification of the display control process shown in FIGS. 3 and 4. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. It is a figure for demonstrating the control method of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. It is a figure for demonstrating the control method of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 2nd modification of a display control process. FIG. 5 is a flowchart of a second modification of the display control process shown in FIGS. 3 and 4 and shows a changed portion of the flowchart shown in FIG. 4. FIG. 5 is a flowchart of a second modification of the display control process shown in FIGS. 3 and 4 and shows a changed portion of the flowchart shown in FIG. 4. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 3rd modification of a display control process. FIG. 9 is a flowchart of a third modification of the display control process shown in FIG. 3 and FIG. 4, and shows a changed portion of the flowchart shown in FIG. 8. FIG. 9 is a flowchart of a third modification of the display control process shown in FIG. 3 and FIG. 4, and shows a changed portion of the flowchart shown in FIG. 8. It is a figure for demonstrating the change of the display content in the display part of a mobile telephone in the 3rd modification of a display control process. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a flowchart which shows the some modification of the processing content shown by FIG. It is a figure which shows an example of the display content in the display part of the mobile telephone of FIG. It is a figure for demonstrating an example of the display content when a user's finger | toe touches a touch screen in the conventional information terminal.

Explanation of symbols

  30 display unit, 31, 32 pointer, 40 touch panel, 50 control unit, 50A timer, 51 display control unit, 53, 54 audio output control unit, 55 audio input control unit, 56 receiver, 57 speaker, 58 microphone, 60 storage unit , 61 Program storage unit, 62 Setting content storage unit, 63 Data storage unit, 80 Communication control unit, 81 Antenna, 90 Attitude detection unit, 91 Camera, 100 Mobile phone.

Claims (15)

A display unit;
A touch panel provided in front of the display unit;
A display control unit for controlling a display mode of the display unit according to an operation mode for the touch panel ;
A special operation determination unit that determines whether the touch panel is operated in a special operation mode;
An operation position determination unit that determines a position where an operation is performed on the touch panel ;
The display control unit
When the special operation determination unit has determined to have been operated in a special operation mode with respect to the touch panel, the display mode of location of the display unit corresponding to the operation of the operating position determination unit determines is made position The display content corresponding to the entire display unit is converted so that the
Realizing the conversion of the display content by shifting the display content of the display unit as a whole by at least the dimensions assumed to be the width of a human finger,
When the operation position determination unit determines that the position where the operation is performed is a predetermined one side region on the touch panel, the display content is shifted in the predetermined other side direction, and the position where the operation is performed , The display content is shifted in the direction of the predetermined one side,
In a state where the operation by special operation mode is to display the predetermined information on the start position, Ru shifting the display contents, the portable information terminal. The portable information terminal according to claim 1 , wherein the display control unit shifts the display content by an amount corresponding to a duration of an operation according to the special operation mode. The portable information terminal according to claim 1 , wherein the display control unit increases the display magnification of the display unit after shifting the display content as the conversion of the display content. Wherein the display control unit, when the special operation determination unit has determined to have been operated in a special operation mode with respect to the touch panel, even in addition converts the display contents to increase the display magnification of the display unit The personal digital assistant according to claim 1, which is realized. The portable information terminal according to claim 4 , wherein the display control unit increases the display magnification of the display content by an amount corresponding to an operation duration time of the special operation mode. The portable information terminal according to claim 1 , wherein the display control unit shifts the display content after increasing the display magnification of the display unit as the conversion of the display content. The mobile phone according to any one of claims 1 to 6 , wherein the display control unit returns the entire display of the converted display unit to the one before the conversion after the operation according to the special operation mode is eliminated. Information terminal. A determination unit that determines whether or not a position where the operation according to the special operation mode is started corresponds to a position where the anchor text is displayed on the display unit;
When the determination unit determines that the position where the operation according to the special operation mode is started does not correspond to the position where the anchor text is displayed on the display unit, the display control unit is configured according to the special operation mode. The portable information terminal according to claim 7 , wherein after the operation is canceled, the entire display of the converted display unit is returned to the one before conversion. The display control unit
When the user moves the touch operation position on the touch panel, the predetermined information is moved and displayed together with the movement of the touch operation position to the display position on the touch panel corresponding to the current touch operation position,
When the user moves the touch operation position with respect to the touch panel, the predetermined information displayed at the display position on the touch panel corresponding to the current touch operation position protrudes from the display area of the touch panel The display content is continuously scrolled in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information is displayed in the display area of the touch panel. The portable information terminal according to any one of 8. A method for controlling a portable information terminal including a touch panel provided on a front surface of a display unit,
Determining whether the touch panel is operated in a special operation mode;
Identifying a position where an operation is performed on the touch panel;
If said step of determining has determined to have been operated by the special operation mode, the display mode of location of the display unit corresponding to the operation position relative to the touch panel so as to change, corresponding to the whole of the display unit Converting the display content ,
The converting step includes:
Realizing the conversion of the display content by shifting the display content of the display unit as a whole by at least the dimensions assumed to be the width of a human finger,
When the specifying step specifies that the position where the operation is performed is a predetermined one side area on the touch panel, the display content is shifted in the predetermined other side direction, and the position where the operation is performed is determined. If it is specified that the region is on the other side of the predetermined, the display content is shifted in the direction of the predetermined one side,
Wherein the operation by the special operation mode is the start position in a state of displaying predetermined information, Ru shifting the display content, method of controlling a mobile information terminal. The converting step includes:
When the user moves the touch operation position on the touch panel, the predetermined information is moved and displayed together with the movement of the touch operation position to the display position on the touch panel corresponding to the current touch operation position,
When the user moves the touch operation position with respect to the touch panel, the predetermined information displayed at the display position on the touch panel corresponding to the current touch operation position protrudes from the display area of the touch panel The display content is continuously scrolled in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information is displayed in the display area of the touch panel. The portable information terminal control method described. A control program for controlling the portable information terminal with a touch panel provided in front of the display unit,
In the portable information terminal,
Determining whether the touch panel is operated in a special operation mode;
Identifying a position where an operation is performed on the touch panel;
If said step of determining has determined to have been operated by the special operation mode, the display mode of location of the display unit corresponding to the operation position with respect to the touch screen is to be changed, corresponding to the whole of the display unit The step of converting the display content ,
The converting step includes:
Realizing the conversion of the display content by shifting the display content of the display unit as a whole by at least the dimensions assumed to be the width of a human finger,
When the specifying step specifies that the position where the operation is performed is a predetermined one side area on the touch panel, the display content is shifted in the predetermined other side direction, and the position where the operation is performed is determined. If it is specified that the region is on the other side of the predetermined, the display content is shifted in the direction of the predetermined one side,
Wherein the operation by the special operation mode is the start position in a state of displaying predetermined information, Ru shifting the display content, control program. The converting step includes:
When the user moves the touch operation position on the touch panel, the predetermined information is moved and displayed together with the movement of the touch operation position to the display position on the touch panel corresponding to the current touch operation position,
When the user moves the touch operation position with respect to the touch panel, the predetermined information displayed at the display position on the touch panel corresponding to the current touch operation position protrudes from the display area of the touch panel The display content is continuously scrolled in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information is displayed in the display area of the touch panel. The control program described. A recording medium recording a control program for controlling the portable information terminal with a touch panel provided in front of the display unit,
Said control program, said portable information terminal,
Determining whether the touch panel is operated in a special operation mode;
Identifying a position where an operation is performed on the touch panel;
If said step of determining has determined to have been operated by the special operation mode, the display mode of location of the display unit corresponding to the operation position with respect to the touch panel so as to change, corresponding to the whole of the display unit The step of converting the display content ,
The converting step includes:
Realizing the conversion of the display content by shifting the display content of the display unit as a whole by at least the dimensions assumed to be the width of a human finger,
When the specifying step specifies that the position where the operation is performed is a predetermined one side area on the touch panel, the display content is shifted in the predetermined other side direction, and the position where the operation is performed is determined. If it is specified that the region is on the other side of the predetermined, the display content is shifted in the direction of the predetermined one side,
In a state where the operation by special operation mode is to display the predetermined information on the start position, Ru shifting the display contents, a recording medium. The converting step includes:
When the user moves the touch operation position on the touch panel, the predetermined information is moved and displayed together with the movement of the touch operation position to the display position on the touch panel corresponding to the current touch operation position,
When the user moves the touch operation position with respect to the touch panel, the predetermined information displayed at the display position on the touch panel corresponding to the current touch operation position protrudes from the display area of the touch panel The display content is continuously scrolled in a direction opposite to the direction in which the touch operation position is moved so that the predetermined information is displayed within the display area of the touch panel. The recording medium described.

Images