[go: nahoru, domu]

WO2008064142A2 - Interactive sequential key system to input characters on small keypads - Google Patents

Interactive sequential key system to input characters on small keypads Download PDF

Info

Publication number
WO2008064142A2
WO2008064142A2 PCT/US2007/085047 US2007085047W WO2008064142A2 WO 2008064142 A2 WO2008064142 A2 WO 2008064142A2 US 2007085047 W US2007085047 W US 2007085047W WO 2008064142 A2 WO2008064142 A2 WO 2008064142A2
Authority
WO
WIPO (PCT)
Prior art keywords
array
keypad
onscreen
character
selection
Prior art date
Application number
PCT/US2007/085047
Other languages
French (fr)
Other versions
WO2008064142A3 (en
Inventor
Don N. Pham
Original Assignee
Pham Don N
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pham Don N filed Critical Pham Don N
Publication of WO2008064142A2 publication Critical patent/WO2008064142A2/en
Publication of WO2008064142A3 publication Critical patent/WO2008064142A3/en

Links

Classifications

    • HELECTRICITY
    • H03ELECTRONIC CIRCUITRY
    • H03KPULSE TECHNIQUE
    • H03K17/00Electronic switching or gating, i.e. not by contact-making and –breaking
    • H03K17/94Electronic switching or gating, i.e. not by contact-making and –breaking characterised by the way in which the control signals are generated
    • H03K17/96Touch switches
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof

Definitions

  • the invention relates to methods and apparatus to input characters when the number of buttons on a keypad is less than the number of characters.
  • Patents 5,392,338 and 4,658,417 set the standard method of inputting an alphabet via the phone keypad, in which pushing a button one or more times during some period enters a character.
  • the method is simple and easy to learn but is slow and limited in the number of characters.
  • the most promising system to bypass the disadvantages of the above multipress method is the two-key system, in which each character is entered via two buttons, pressed simultaneously or sequentially.
  • Typewriter and computer keyboards have always used the two- key system.
  • Capitalization for example, is accomplished by simultaneously pressing a shift button and another button.
  • Most computer applications support control actions on simultaneously pressing a control button and another button, and many also allow menu selection by sequentially pressing an alt button and then typing another button.
  • the two-key system is also used to input non-English letters in some languages.
  • This invention discloses an interactive sequential key system to input characters of many writing scripts.
  • the system is easy to learn and may be used on portable devices such as PDAs, handheld computers, handheld text-messaging devices and telephones.
  • This invention builds on four observations.
  • First, the human mind can quickly recognize and process information when it is displayed in nine or fewer chunks at a time.
  • a writer can identify the location of a letter more quickly if it is presented in alphabetical order than in random or QWERTY order.
  • the mind can identify the location of a group of symbols more quickly if the symbols are grouped by similar shapes or functions.
  • keys on handheld devices are typically small and the symbols printed on the keys are frequently obscured by fingers.
  • ⁇ CHAR ⁇ means a set of no letters, one letter or many characters. For example, ⁇ represents an empty set; ⁇ A ⁇ represents the set of the single letter A; and ⁇ A,B,C,D,E,F ⁇ represents the set of the letters A, B, C, D, E and F. Moreover, (CHAR)(R, C) represents the character set at row R and column C. Similarly, key(R, C) represents the key at row R and column C.
  • the invention includes a device for receiving input characters from a user, comprising a keypad with a plurality of keys arranged in rows and columns forming a keypad array; a display screen showing a plurality of character sets arranged in rows and columns forming a character set array wherein each element in the character set array (CHAR)(R, C) is mapped to each element in the keypad array key(R, C); and a processor for receiving a selection of one of the plurality of keys on the keypad to designate a character set by its corresponding location coordinate as mapped on the keypad array.
  • CHAR character set array
  • Typing a letter involves interactively selecting a first character set from a character set array displayed on the display screen by pressing the corresponding button on the keypad and then selecting a second character set from a second character set array displayed on the display screen by pressing the corresponding button on the keypad. In some cases, selecting a third character-set from a third character-set displayed on the display screen is also needed.
  • the invention can be implemented in numerous ways, including as a system, a device, a method, or a computer readable medium. Several embodiments of the invention are discussed below.
  • the invention generally includes a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; a display operable to display an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; a processor for receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
  • the invention generally includes providing a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
  • the computer program product for receiving an input character from a user
  • the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein
  • the computer program mechanism generally includes instructions for displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in a keypad array of a keypad; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
  • Additional features may include one or more of providing a mode selection for selecting a writing script mode comprising one or more languages or functions; populating the characters and character sets for each language in the onscreen array in accordance with a convention for reading directions of the language; outputting a pre-selection indication upon receiving a pre-selection input from the keypad, wherein the pre-selection input comprises an input to the keypad distinguishable from the user selection; and predictive text functionality comprising displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
  • the user by selecting a key on a physical keypad interface (keypad or touchscreen), the user provides input/commands to the device (e.g., input).
  • the physical key selections correspond to selecting elements of the onscreen array (i.e., the icons displayed on the display as a keypad image).
  • Each key in the physical keypad array is coordinately mapped to each element of the onscreen array resulting in a positional relationship between keys on the physical keypad interface and icon positions (array elements) on the keypad image (onscreen array) — e.g., the upper left key on the physical keypad corresponds to the upper left key icon in the keypad image.
  • the user may select the respective key icon of the keypad image in the display by pressing down on the physical keypad interface.
  • Figure 1 shows an implementation of the first character-set array to type the English alphabet and various symbols.
  • Figure 2 shows an implementation of the first character-set array to type the Spanish alphabet and various symbols.
  • Figure 3 shows an implementation of the first character-set array to type the French alphabet and various symbols.
  • Figure 4 shows an implementation of the first character-set array to type the German alphabet and various symbols.
  • Figure 5 shows an implementation of the first character-set array to type the mathematical and miscellaneous characters.
  • Figure 6 shows an implementation of an array to select writing scripts.
  • Figure 7 shows an implementation of the second character-set array to type English letters after pressing button 500.
  • Figure 8 shows an implementation of the second character-set array to type Spanish letters and various symbols after pressing button 504.
  • Figure 9 shows an implementation of the third character-set array to type Spanish letters and various symbols after pressing button 504 twice.
  • Figure 10 shows an implementation of the second character-set array to type French letters and various symbols after pressing button 504.
  • Figure 11 shows an implementation of the second character-set array to type German letters and various symbols after pressing button 504.
  • Figure 12 shows an implementation of the English alphabet arranged on display 400 in sequential order and the convention for reading directions of the English language (left to right and top to bottom).
  • Figure 13 shows an implementation of the English alphabet arranged on display 400 with punctuation separately grouped on its own button.
  • Figure 14 shows an implementation arranged on display 400 where the convention for reading directions is different from that in English, namely Hebrew where the text is from right to left, top to bottom.
  • This invention discloses an interactive sequential key system to input characters of many writing scripts, hi a first embodiment, the invention comprises a device (such as a mobile phone, PDA, iPod® device, or other device, especially those with limited keys for data entry) for receiving an input character from a user.
  • a device such as a mobile phone, PDA, iPod® device, or other device, especially those with limited keys for data entry
  • the device includes a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array (such as a cell phone keypad with 3 columns and 2 - 4 rows); a display (e.g., grayscale or color LCD) operable to display a graphical user interface which, in this embodiment, is represented as an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array. So, for example, if the onscreen array has 3 columns and 2 rows, the elements of the onscreen array are mapped to 3 columns and 2 rows of keys on the keypad having the same relative coordinate location.
  • a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array (such as a cell phone keypad with 3 columns and 2 - 4 rows); a display (e.g., grayscale or color LCD) operable to display a graphical user interface which, in this embodiment, is represented as an
  • the "keys" for user input can be physical buttons (physical keypad) or buttons on touch-sensitive screens (touchscreens - display overlays which have the ability to display and receive information on the same screen) and provide the physical keypad interface with the device.
  • the device further includes a processor for receiving an input character by first populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters [such as an English language character set shown in Figure 1 comprising array elements: "abc-def ; "ghi-jkl”; “mno ⁇ pqr”; “stuv— wx”; “yz? - ⁇ *;”; "(misc. punctuation or commands)".
  • the "--” as used herein merely represents the start of the next row for this example if the contents are displayed as 3 columns and 2 rows].
  • the processor receives a first user selection from the keypad to select one of the character sets mapped to the first user selection. So, if element 1:1 (i.e., row 1 column 1) of the onscreen array comprises "abc—def ', the user can select that element/character set by selecting key 1:1 (i.e., row 1 column 1) on the keypad array.
  • the onscreen array is populated with a plurality of characters from the selected one of the character sets as elements of the onscreen array (See for Example Figure 7). So, in this example, the array is populated with the contents of the selected "abc— def" character set as individual array elements: "a”; "b”; “c”; “d”; "e”; “f '.
  • the processor receives a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character. So, if the user wants to select "b", he selects key 1:2 (i.e., row 1 column 2) in order to select element 1:2 (i.e., row 1 column 2), which contains the character "b". Thus, character "b" is input by the user into the device.
  • the onscreen array can be graphically designed to simulate an image of a keypad having buttons to represent the elements of the onscreen array. This allows easier user association between the keypad and the onscreen array.
  • the onscreen array can mimic the size, shape, color, layout, and/or design of the keypad or take on its own look and feel. Since the keys on a keypad are usually very small, the array elements can be made larger than the physical keys so that the contents of the array elements can be easily seen by the user, while still preserving the same overall look and feel.
  • the onscreen array may be designed to look like a corresponding "keypad image" graphically designed to appear like buttons/keys similar to the physical keypad interface keys, making the association easier for the user.
  • the displayed icons are preferably arranged in a pattern/array corresponding to a conventional physical keypad for a mobile phone, or the like.
  • the onscreen array only uses 6 elements, for example, then these six elements of the onscreen array would be coordinately mapped to only six of the keys available on the keypad, possibly leaving other keys not used and not mapped (which can be mapped or used for other functions).
  • the keys chosen to be mapped to the onscreen array comprise the same layout as the onscreen array. In most cases, this would be some combination of columns and rows of elements mapped to similar columns and rows of keys. Row 1 of the keypad would not necessarily need to be mapped to row 1 of the array (for example, you could map two onscreen rows to rows 3 and 4 of a keypad having 4 total rows).
  • the layout could be a matter of design choice as long as the relative locations between the elements/keys are maintained.
  • the onscreen array be designed to mimic a perimeter of keys, only a certain row, only a certain column, skipping a row or column, etc, for example, the key mapping would follow the same layout so the user can associate the onscreen array with the key mapping.
  • a similar row/column array would suffice, such as an onscreen array having up to six elements arranged in three columns and two rows.
  • the characters inside the character sets are displayed in a similar manner, such as up to six characters arranged in three columns and two rows (so that the onscreen array appears and functions similar to a nested array).
  • onscreen array Since the contents of the onscreen array can be easily updated/changed through software, the device would be able to readily use different onscreen arrays.
  • one onscreen array could be designed for the English language (See for example Figure 1) and others for different languages (See for example Figures 2 - 4) (i.e., "writing script").
  • arrays could be designed for other types of functionality such as math functions (See for example Figure 5) or industry specific functions (real estate math, chemistry symbols, etc.).
  • This invention preferably groups letters of a writing script into character set arrays.
  • character sets may be designed to correspond to a selected writing script mode comprising one or more languages or functions.
  • the processor could selectively populate the onscreen array with a plurality of writing script mode selections as elements of the onscreen array (See for example Figure 6), and receive input from the keypad so the user can select one of the writing script mode selections mapped to the received input.
  • the onscreen array Upon receiving the writing script mode selection, the onscreen array populates the onscreen character set according to that mode.
  • Other means for selecting modes of a device may be utilized by the device to select the writing script mode.
  • the characters and character sets for each language are populated in the onscreen array in accordance with a convention for reading directions of the language. So, for English, since left to right, top to bottom is the reading direction, the array is populated in that manner.
  • each array element is filled before proceeding to fill the next element. So, if an element holds six characters, then it is filled with six characters before filling the next element.
  • a new element may be populated without completely filling the prior element (see for example, Figure 13) or the convention of filling the elements may be used as a matter of design, especially where space is a factor.
  • the number of elements in a set and the number of sets in the set array is preferably limited to 6 or less in the embodiments to correspond with 2 rows/3 columns, hi grouping alphabetic characters into character sets, the preference is listing in alphabetical order or in groups of similar shapes and functions. In grouping non-alphabetic characters into character sets, the preference is grouping characters of similar shapes and functions.
  • the onscreen array does not need to fill the entire screen of the display. In most cases, it comprises only a portion of the display, such as the lower half. This would leave room on the screen so that the input character may be output to the display, as well as other display outputs.
  • the invention displays characters on the screen of the handheld device as a keypad image (onscreen array) representing a first character set array with the relative coordinates of the character sets mapped to the relative coordinates of the keys in the key array.
  • pressing physical keypad interface key(R, C) results in selecting (CHAR)(R 5 C) from the character set array.
  • the first character set array may be displayed in such a way as to preserve the alphabetical order of characters or grouping of characters of similar shapes and functions.
  • the display screen After a character set is selected from the first character set array, the display screen shows a second character set array arranged again as a keypad image (onscreen array). Each character set in the second array is a subset of the previously selected character set and preferably has at most one character. An exception for this one-character rule is when a third character-set needs to be selected and this exception will be explained later.
  • the union of all character sets in the second array is the selected character set of the first character set array.
  • the display screen may show character sets in the second array in such a way as to preserve the alphabetical order and the grouping of shapes and functions of the previously selected character set.
  • the second character set array is ⁇ A ⁇ , (B), (C), (D), (E) and (F).
  • the second character set array may be displayed such that the relative coordinates of elements of the array map to the relative coordinates of the key array. Hence pressing key(R,C) results in selecting character set (CHAR)(R 5 C).
  • typing a character comprises a) examining a first character set array displayed (preferably as a keypad image/onscreen array) on the screen, b) pressing a key on the physical keypad interface to select a first character set containing the desired character, c) examining a second character set array displayed (preferably as a keypad image/onscreen array) on the screen and d) pressing a key on the physical keypad interface to select a second character set containing only the desired character, resulting in character input.
  • Many writing scripts have letters formed by adding one or more diacritics to a letter. These letters may be grouped into sets either by their diacritical sign or by their letter. Typing such a letter may take more than two key strokes.
  • An option to type a letter with diacritics is to designate a special key. Pressing the key after or before typing a letter turns it into the letter with the diacritics. For example, numeric key 7 can be designated as the special key and pressing it after typing the letter u changes the letter u to umlaut u in German.
  • One way to display character set arrays is to display each character set as a group of characters without separating commas and brackets used for set notation.
  • the set ⁇ A,B,C,D,E,F ⁇ may be displayed as ABCDEF and the set ⁇ A ⁇ may be displayed as A. Blank spaces and tabs may be used to separate character sets.
  • Another way to display a character-set that has more than one member is to display the members such that their relative positions correspond to the relative locations of the numeric keys of the standard phone keypad in the next keystroke.
  • the set ⁇ A,B,C,D,E,F ⁇ may be displayed in two rows; the first row shows ABC and the second row shows DEF.
  • the invention also proposes a pre-selection mode.
  • Pre-selection functionality may provide an indication upon receiving a pre-selection input from the keypad, wherein the preselection input comprises an input to the keypad distinguishable from the user selection.
  • the pre-selection input is distinguishable from the user selection based on key pressure, for example.
  • the pre-selection indication comprises a visual indication of which element of the onscreen array is coordinately mapped to the corresponding key in the keypad array for which the pre-selection input was received.
  • the cue can also be audible by playing a sound, speaking a word or phrase. Providing audible pre-selection cue is especially important for visually challenged users. The pre-selection mode is possible even when buttons are virtual buttons on a touch sensitive display and the button faces are the graphics of the buttons.
  • a button may have two pressure sensitivity levels; light pressure sensitivity level is associated with pre-selection and high pressure sensitivity level is associated with button selection.
  • Other sensory techniques and combination of techniques are also possible.
  • a form of pre-selection on keypads sensitive to only one detection level may include a technique such that the press provides information about the selection and the second press is the actual selection.
  • This invention also proposes a method to ease selection in text predictive technology for mobile devices.
  • a mobile device displays one or more predictive guesses which may be displayed either on the input text line or as a drop-down list. Li both cases, selection is by pressing cursor or "select" buttons.
  • Predictive Text functionality may be provided by displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
  • the invention proposes displaying a key label adjacent to each guess and selecting a guess is by pressing the key associated with the label adjacent to the guess.
  • pre-selection mode When pre-selection mode is active, light pressing of a button triggers cuing of the associated predictive guess.
  • the processor outputs a pre-selection indication upon receiving a pre-selection input from the keypad corresponding to the user selection of one of the text prediction icons.
  • the cue can be audible by reading aloud the predictive guess or visual by displaying the predictive guess with different colors, with a different size or shape, or with special effects. Hard pressing on a button results in selecting the associated predictive guess.
  • 400 is the display screen; the 500s represent the physical keypad interface keys: 500 is key(l,l); 501 is key(l,2); 502 is key(l,3); 503 is key(2,l); 504 is key(2,2); 505 is key(2,3); 506 is key(3,l); 507 is key(3,2); 508 is key(3,3); 509 is key(4,l); 510 is key(4,2); 511 is key(4,3), the 600s represent the keypad images/icons on the screen: 600 is ⁇ CHAR ⁇ (1, 1); 601 is ⁇ CHAR ⁇ (1,2); 602 is ⁇ CHAR ⁇ (1,3); 603 is ⁇ CHAR ⁇ (2,1); 604 is ⁇ CHAR ⁇ (2,2); 605 is ⁇ CHAR ⁇ (2,3); 606 is ⁇ CHAR ⁇ (3,1); 607 is ⁇ CHAR ⁇ (3,2); 608 is ⁇ CHAR ⁇ (3,3); 609 is ⁇ CHAR ⁇ (4,1);
  • Pressing key(R, C) results in selecting ⁇ CHAR ⁇ (R,C).
  • pressing key(l,l) results in selecting ⁇ CHAR ⁇ (1,1); pressing key(l,2) results in selecting ⁇ CHAR ⁇ (1,2); pressing key(l,3) results in selecting ⁇ CHAR ⁇ (1,3);
  • pressing key(2,l) results in selecting ⁇ CHAR ⁇ (2,1); pressing key(2,2) results in selecting ⁇ CHAR ⁇ (2,2); pressing key(2,3) results in selecting ⁇ CHAR ⁇ (2,3);
  • pressing key(3,l) results in selecting ⁇ CHAR ⁇ (3,1); pressing key(3,2) results in selecting ⁇ CHAR ⁇ (3,2); pressing key(3,3) results in selecting ⁇ CHAR ⁇ (3,3);
  • pressing key(4,l) results in selecting ⁇ CHAR ⁇ (4,1); pressing key(4,2) results in selecting ⁇ CHAR ⁇ (4,2); and pressing key(4,3) results in selecting ⁇ CHAR ⁇ (4,3).
  • Figure 1 shows an implementation of a device with a display 400 (such as a screen, LCD, or the like), a physical keypad interface with six keys shown (500 - 505) (such as a mobile phone or mobile device keypad or a touchscreen keypad or the like), and an image on the screen showing six icons arranged as an onscreen array (600 - 605), and in this example, graphically designed to appear as a keypad image.
  • the physical keypad interface may actually comprise additional keys, not shown herein. The keys may be larger or smaller than represented.
  • the physical keys may include indicia such as numbers for dialing, (or an array of numbers/letters that is arranged in an ITU Standard E.161 arrangement that most phones built today utilize), or other types of indicia (including the character arrays of the present invention).
  • indicia such as numbers for dialing, (or an array of numbers/letters that is arranged in an ITU Standard E.161 arrangement that most phones built today utilize), or other types of indicia (including the character arrays of the present invention).
  • the indicia printed on the physical keys are immaterial.
  • the icons of the keypad image (i.e., elements of the onscreen array) on the screen are shown near the bottom of the screen, which may be a desired location in that it is near the physical keypad interface. Other locations on the display area are contemplated herein.
  • Figure 1 represents a first character-set array to type the English alphabet and various symbols. Here, the symbol for new line is spelled out as "entr.” Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing of the icons on the display also shows character-sets to appear as buttons, making the association easier for the user.
  • Figure 2 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the Spanish alphabet and various symbols. Here, the symbol for new line is spelled out as "entr.” Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as burtons.
  • Figure 3 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the French alphabet and various symbols.
  • the symbol for new line is spelled out as "entr.”
  • Groups of special French letters and symbols are labeled as "accents.”
  • symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons.
  • Figure 4 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the German alphabet and various symbols. Here, the symbol for new line is spelled out as "entr.” Groups of special German letters and symbols are labeled as an umlaute. Whenever possible, symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons.
  • Figure 5 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type numeral, mathematical and miscellaneous characters.
  • the symbol for new line is spelled out as "entr.”
  • Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons.
  • Figure 6 shows an implementation of an array to select different writing scripts (modes), such as those shown in Figures 1 - 5, for example, hi this example, selecting physical keypad interface key 500 will select icon 600 that represents English language writing script mode (Figure 1); selecting physical keypad interface key 501 will select icon 601 that represents Spanish language writing script mode ( Figure 2); selecting physical keypad interface key 502 will select icon 602 that represents French language writing script mode ( Figure 3); selecting physical keypad interface key 503 will select icon 603 that represents German language writing script mode ( Figure 4); selecting physical keypad interface key 504 will select icon 604 that represents Math/Misc function mode (Figure 5) .
  • a button position (505) is reserved for caps lock (icon 605).
  • the arrangement shown in Figure 6 will allow a user to switch between different languages/implementations/modes.
  • Figure 7 shows an implementation of the second character-set array to type English letters after pressing button 500 in Figure 1. hi this example, each second character-set has exactly one member.
  • Figure 8 shows an implementation of the second character-set array to type Spanish letters and various symbols after pressing button 504 in Figure 2.
  • each second character-set has exactly one member.
  • Icon 604 has the label "acento" and selecting it via pressing the 504 key on the physical keypad interface takes the user to a third character-set array shown in Figure 9.
  • Figure 9 shows an implementation of the third character-set array to type unique Spanish letters and various symbols after pressing button 504 twice.
  • each second character-set has exactly one member.
  • Figure 10 shows an implementation of the second character-set array to type French letters and various symbols after pressing button 504 in Figure 3. Two character-sets consist of one member each. Selecting other character-sets lead to third character sets.
  • Figure 11 shows an implementation of the second character-set array to type German letters and various symbols after pressing button 504 in Figure 4. Here, except for 604, each second character-set has exactly one member. Icon 604 has the label "umlaut" and selecting it via pressing 504 leads to a third character-set array. This is an example of further nesting of arrays.
  • the device then populates the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receives a third user selection from the keypad to select one of the characters mapped to the third user selection as the input character.
  • Sequential key selection drills down through nested arrays and is not necessarily limited by 2 or 3 inputs.
  • Figure 12 shows the encoding of the English alphabet in accordance with the convention for reading directions of English on the keypad image on the screen showing six icons arranged as an array (600 - 605).
  • Figure 13 shows the encoding of the English alphabet in accordance with the convention for reading directions of English, further including punctuation grouped together on the keypad image on the screen showing six icons arranged as an array (600 - 605).
  • Figure 14 is an encoding example of a language where the convention for reading directions is different from that in English on the keypad image on the screen showing six icons arranged as an array (600 - 605).
  • aleph N
  • the first letter of the alphabet is on the third character-set of the first row.
  • the arrangement of letters on a character-set also follow the right to left then top to bottom usage, hence the letter beth (p. ) is on the left of the letter aleph.
  • zayin (T) the seventh letter of the alphabet, is on the second character-set of the first row.
  • Other letters are similarly arranged.
  • buttons may or may not include the key arrangements printed thereon.
  • a unique advantage to the present invention is that the displayed characters can be programmed in accordance with the various character arrays without having to change the physical keypad markings.
  • the user can associate what is shown on the display (keypad image) with where his fingers should be positioned on the physical keypad interface, without ever having to look at the physical keypad (similar to knowing where to move a mouse or graphical pen by associating where the pointer is on the display screen and not looking at the mouse/pen).
  • the invention may utilize more or less keys as needed for the particular implementation.
  • the keypad image includes up to nine keys arranged in three columns and three rows mapped to nine keys of the physical keypad interface.
  • the keypad image includes up to twelve keys arranged in three columns and four rows (or otherwise) mapped to twelve keys of the physical keypad interface.
  • the twelve keys can be arranged to correspond to a standard phone keypad with numeric buttons and asterisk and pound buttons in their respective locations on the keypad array, the standard phone keypad separately accessible.
  • the physical keypads described herein are generally in the context of a plurality of keys, the term physical keypad may also be used equally in the context of a touchscreen or other touch-type keyboards.
  • the keys need not necessarily be arranged exactly in an array (rows and columns) but other layouts are contemplated herein where the onscreen array layout essentially mimics part or all of the keypad layout.
  • the device may include a large or small screen as known in the art.
  • the display screen may include gray-scale or color (such as an LCD).
  • the present invention can be adapted for portable devices such as a personal digital assistant, a portable computer, a digital camera or other electronic devices provided with keypad buttons (e.g., mobile phones, music players, iPod ® devices, and the like).
  • the housing for the device may be elongated vertically, or may take on other sizes and shapes, including a clamshell housing structure where the physical keypad is separated by a hinge from the display screen, among other structures.
  • the keyboard may include well-known mode selection keys, or other hardware or software for switching between text entry and telephony entry.
  • the output device shown in the examples is a display, which is preferably a full graphic LCD. Other types of output devices may alternatively be utilized.
  • the output device may display the output so a user can visually see what characters are being selected and include tones, etc.
  • a processing device is contained within the housing of the device and is coupled between the physical keyboard interface and the display. The processing device controls the operation of the display, as well as the overall operation of the device, in response to actuation of keys on the by the user.
  • Computer program elements of the invention may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.).
  • the invention may take the form of a computer program product, which can be embodied by a computer-usable or computer-readable storage medium having computer-usable or computer-readable program instructions, "code” or a "computer program” embodied in the medium for use by or in connection with the instruction execution system, hi the context of this document, a computer- usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device.
  • the computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device.
  • the computer program product and any software and hardware described herein form the various means for carrying out the functions of the invention in the example embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

This invention discloses an interactive sequential system to input letters of the English alphabet and of many world languages, numbers, punctuation marks and many other symbols on keypads with few buttons. The invention includes a device for receiving input characters from a user, having a keypad with a plurality of keys arranged in rows and columns forming a keypad array; a display screen showing a plurality of character sets arranged in rows and columns forming a character set onscreen array wherein each element in the character set array is mapped to each element in the keypad array; and a processor for receiving a selection of one of the plurality of keys on the keypad to designate a character set by its corresponding location coordinate as mapped on the keypad array. Sequential key selection drills down through nested arrays.

Description

INTERACTIVE SEQUENTIAL KEY SYSTEM TO INPUT CHARACTERS ON SMALL KEYPADS
RELATED APPLICATIONS
[01] This application also claims the benefit of U.S. Provisional Application No.
60/860,024, filed on November 20, 2006, and 60/964,026, filed on August 8, 2007, all of which are incorporated herein by reference in their entireties.
FIELD OF THE INVENTION
[02] The invention relates to methods and apparatus to input characters when the number of buttons on a keypad is less than the number of characters.
BACKGROUND OF THE INVENTION
[03] Patents 5,392,338 and 4,658,417 set the standard method of inputting an alphabet via the phone keypad, in which pushing a button one or more times during some period enters a character. The method is simple and easy to learn but is slow and limited in the number of characters.
[04] The most promising system to bypass the disadvantages of the above multipress method is the two-key system, in which each character is entered via two buttons, pressed simultaneously or sequentially. Typewriter and computer keyboards have always used the two- key system. Capitalization, for example, is accomplished by simultaneously pressing a shift button and another button. Most computer applications support control actions on simultaneously pressing a control button and another button, and many also allow menu selection by sequentially pressing an alt button and then typing another button. The two-key system is also used to input non-English letters in some languages.
[05] People have patented many variations of the two-key systems on small keyboards, such as 6,847,706; 6,802,661; 6,765,556; 5,392,338; 5,339,358; 5,117,455; 4,658,417; 3,967,273, all of which are incorporated herein by reference. [06] All patents, patent applications, provisional applications, and publications referred to or cited herein, or from which a claim for benefit of priority has been made, are incorporated herein by reference in their entirety to the extent they are not inconsistent with the explicit teachings of this specification.
BRIEF SUMMARY OF THE INVENTION
[07] This invention discloses an interactive sequential key system to input characters of many writing scripts. The system is easy to learn and may be used on portable devices such as PDAs, handheld computers, handheld text-messaging devices and telephones. This invention builds on four observations. First, the human mind can quickly recognize and process information when it is displayed in nine or fewer chunks at a time. Second, a writer can identify the location of a letter more quickly if it is presented in alphabetical order than in random or QWERTY order. Third, the mind can identify the location of a group of symbols more quickly if the symbols are grouped by similar shapes or functions. And fourth, keys on handheld devices are typically small and the symbols printed on the keys are frequently obscured by fingers.
[08] For ease of reference, as used throughout the specification, the representation
{CHAR} means a set of no letters, one letter or many characters. For example, {} represents an empty set; {A} represents the set of the single letter A; and { A,B,C,D,E,F} represents the set of the letters A, B, C, D, E and F. Moreover, (CHAR)(R, C) represents the character set at row R and column C. Similarly, key(R, C) represents the key at row R and column C.
[09] The invention includes a device for receiving input characters from a user, comprising a keypad with a plurality of keys arranged in rows and columns forming a keypad array; a display screen showing a plurality of character sets arranged in rows and columns forming a character set array wherein each element in the character set array (CHAR)(R, C) is mapped to each element in the keypad array key(R, C); and a processor for receiving a selection of one of the plurality of keys on the keypad to designate a character set by its corresponding location coordinate as mapped on the keypad array.
[010] Typing a letter involves interactively selecting a first character set from a character set array displayed on the display screen by pressing the corresponding button on the keypad and then selecting a second character set from a second character set array displayed on the display screen by pressing the corresponding button on the keypad. In some cases, selecting a third character-set from a third character-set displayed on the display screen is also needed.
[Oil] The invention can be implemented in numerous ways, including as a system, a device, a method, or a computer readable medium. Several embodiments of the invention are discussed below.
[012] As a device for receiving an input character from a user, the invention generally includes a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; a display operable to display an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; a processor for receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
[013] As a method for receiving an input character from a user, the invention generally includes providing a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
[014] As a computer program product for receiving an input character from a user, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism generally includes instructions for displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in a keypad array of a keypad; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
[015] Additional features may include one or more of providing a mode selection for selecting a writing script mode comprising one or more languages or functions; populating the characters and character sets for each language in the onscreen array in accordance with a convention for reading directions of the language; outputting a pre-selection indication upon receiving a pre-selection input from the keypad, wherein the pre-selection input comprises an input to the keypad distinguishable from the user selection; and predictive text functionality comprising displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
[016] Thus, by selecting a key on a physical keypad interface (keypad or touchscreen), the user provides input/commands to the device (e.g., input). The physical key selections correspond to selecting elements of the onscreen array (i.e., the icons displayed on the display as a keypad image). Each key in the physical keypad array is coordinately mapped to each element of the onscreen array resulting in a positional relationship between keys on the physical keypad interface and icon positions (array elements) on the keypad image (onscreen array) — e.g., the upper left key on the physical keypad corresponds to the upper left key icon in the keypad image. The user may select the respective key icon of the keypad image in the display by pressing down on the physical keypad interface.
BRIEF DESCRIPTION OF THE DRAWINGS
[017] A more particular description of the invention briefly described above will be rendered by reference to specific embodiments thereof, which are illustrated in the appended drawings. Understanding that these drawings depict only typical embodiments of the invention and are not therefore to be considered to be limiting of its scope, the invention will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
[018] Figure 1 shows an implementation of the first character-set array to type the English alphabet and various symbols.
[019] Figure 2 shows an implementation of the first character-set array to type the Spanish alphabet and various symbols.
[020] Figure 3 shows an implementation of the first character-set array to type the French alphabet and various symbols.
[021] Figure 4 shows an implementation of the first character-set array to type the German alphabet and various symbols.
[022] Figure 5 shows an implementation of the first character-set array to type the mathematical and miscellaneous characters.
[023] Figure 6 shows an implementation of an array to select writing scripts.
[024] Figure 7 shows an implementation of the second character-set array to type English letters after pressing button 500.
[025] Figure 8 shows an implementation of the second character-set array to type Spanish letters and various symbols after pressing button 504.
[026] Figure 9 shows an implementation of the third character-set array to type Spanish letters and various symbols after pressing button 504 twice.
[027] Figure 10 shows an implementation of the second character-set array to type French letters and various symbols after pressing button 504.
[028] Figure 11 shows an implementation of the second character-set array to type German letters and various symbols after pressing button 504.
[029] Figure 12 shows an implementation of the English alphabet arranged on display 400 in sequential order and the convention for reading directions of the English language (left to right and top to bottom).
[030] Figure 13 shows an implementation of the English alphabet arranged on display 400 with punctuation separately grouped on its own button. [031] Figure 14 shows an implementation arranged on display 400 where the convention for reading directions is different from that in English, namely Hebrew where the text is from right to left, top to bottom.
DETAILED DESCRIPTION OF THE INVENTION
[032] This invention discloses an interactive sequential key system to input characters of many writing scripts, hi a first embodiment, the invention comprises a device (such as a mobile phone, PDA, iPod® device, or other device, especially those with limited keys for data entry) for receiving an input character from a user. The device includes a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array (such as a cell phone keypad with 3 columns and 2 - 4 rows); a display (e.g., grayscale or color LCD) operable to display a graphical user interface which, in this embodiment, is represented as an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array. So, for example, if the onscreen array has 3 columns and 2 rows, the elements of the onscreen array are mapped to 3 columns and 2 rows of keys on the keypad having the same relative coordinate location.
[033] The "keys" for user input can be physical buttons (physical keypad) or buttons on touch-sensitive screens (touchscreens - display overlays which have the ability to display and receive information on the same screen) and provide the physical keypad interface with the device.
[034] The device further includes a processor for receiving an input character by first populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters [such as an English language character set shown in Figure 1 comprising array elements: "abc-def ; "ghi-jkl"; "mno~pqr"; "stuv— wx"; "yz? - \*;"; "(misc. punctuation or commands)". The "--" as used herein merely represents the start of the next row for this example if the contents are displayed as 3 columns and 2 rows]. Then, the processor receives a first user selection from the keypad to select one of the character sets mapped to the first user selection. So, if element 1:1 (i.e., row 1 column 1) of the onscreen array comprises "abc—def ', the user can select that element/character set by selecting key 1:1 (i.e., row 1 column 1) on the keypad array. In response thereto, the onscreen array is populated with a plurality of characters from the selected one of the character sets as elements of the onscreen array (See for Example Figure 7). So, in this example, the array is populated with the contents of the selected "abc— def" character set as individual array elements: "a"; "b"; "c"; "d"; "e"; "f '. Then the processor receives a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character. So, if the user wants to select "b", he selects key 1:2 (i.e., row 1 column 2) in order to select element 1:2 (i.e., row 1 column 2), which contains the character "b". Thus, character "b" is input by the user into the device.
[035] In an embodiment, the onscreen array can be graphically designed to simulate an image of a keypad having buttons to represent the elements of the onscreen array. This allows easier user association between the keypad and the onscreen array. The onscreen array can mimic the size, shape, color, layout, and/or design of the keypad or take on its own look and feel. Since the keys on a keypad are usually very small, the array elements can be made larger than the physical keys so that the contents of the array elements can be easily seen by the user, while still preserving the same overall look and feel. The onscreen array may be designed to look like a corresponding "keypad image" graphically designed to appear like buttons/keys similar to the physical keypad interface keys, making the association easier for the user. The displayed icons are preferably arranged in a pattern/array corresponding to a conventional physical keypad for a mobile phone, or the like.
[036] If the onscreen array only uses 6 elements, for example, then these six elements of the onscreen array would be coordinately mapped to only six of the keys available on the keypad, possibly leaving other keys not used and not mapped (which can be mapped or used for other functions). Preferably, the keys chosen to be mapped to the onscreen array comprise the same layout as the onscreen array. In most cases, this would be some combination of columns and rows of elements mapped to similar columns and rows of keys. Row 1 of the keypad would not necessarily need to be mapped to row 1 of the array (for example, you could map two onscreen rows to rows 3 and 4 of a keypad having 4 total rows). The layout could be a matter of design choice as long as the relative locations between the elements/keys are maintained. Alternately, should the onscreen array be designed to mimic a perimeter of keys, only a certain row, only a certain column, skipping a row or column, etc, for example, the key mapping would follow the same layout so the user can associate the onscreen array with the key mapping. In most cases, however, a similar row/column array would suffice, such as an onscreen array having up to six elements arranged in three columns and two rows. To keep with the familiarity of a certain layout, it is preferred that the characters inside the character sets are displayed in a similar manner, such as up to six characters arranged in three columns and two rows (so that the onscreen array appears and functions similar to a nested array).
[037] Since the contents of the onscreen array can be easily updated/changed through software, the device would be able to readily use different onscreen arrays. Thus, one onscreen array could be designed for the English language (See for example Figure 1) and others for different languages (See for example Figures 2 - 4) (i.e., "writing script"). Similarly, arrays could be designed for other types of functionality such as math functions (See for example Figure 5) or industry specific functions (real estate math, chemistry symbols, etc.). This invention preferably groups letters of a writing script into character set arrays. Thus, character sets may be designed to correspond to a selected writing script mode comprising one or more languages or functions. The processor could selectively populate the onscreen array with a plurality of writing script mode selections as elements of the onscreen array (See for example Figure 6), and receive input from the keypad so the user can select one of the writing script mode selections mapped to the received input. Upon receiving the writing script mode selection, the onscreen array populates the onscreen character set according to that mode. Other means for selecting modes of a device, as known in the art, may be utilized by the device to select the writing script mode.
[038] To keep the device simple for users, preferably the characters and character sets for each language are populated in the onscreen array in accordance with a convention for reading directions of the language. So, for English, since left to right, top to bottom is the reading direction, the array is populated in that manner. Preferably, each array element is filled before proceeding to fill the next element. So, if an element holds six characters, then it is filled with six characters before filling the next element. However, when switching between character type (letters, numbers, punctuation), a new element may be populated without completely filling the prior element (see for example, Figure 13) or the convention of filling the elements may be used as a matter of design, especially where space is a factor. The number of elements in a set and the number of sets in the set array is preferably limited to 6 or less in the embodiments to correspond with 2 rows/3 columns, hi grouping alphabetic characters into character sets, the preference is listing in alphabetical order or in groups of similar shapes and functions. In grouping non-alphabetic characters into character sets, the preference is grouping characters of similar shapes and functions.
[039] The onscreen array does not need to fill the entire screen of the display. In most cases, it comprises only a portion of the display, such as the lower half. This would leave room on the screen so that the input character may be output to the display, as well as other display outputs.
[040] The invention displays characters on the screen of the handheld device as a keypad image (onscreen array) representing a first character set array with the relative coordinates of the character sets mapped to the relative coordinates of the keys in the key array. Hence, pressing physical keypad interface key(R, C) results in selecting (CHAR)(R5C) from the character set array. The first character set array may be displayed in such a way as to preserve the alphabetical order of characters or grouping of characters of similar shapes and functions.
[041] After a character set is selected from the first character set array, the display screen shows a second character set array arranged again as a keypad image (onscreen array). Each character set in the second array is a subset of the previously selected character set and preferably has at most one character. An exception for this one-character rule is when a third character-set needs to be selected and this exception will be explained later. The union of all character sets in the second array is the selected character set of the first character set array. The display screen may show character sets in the second array in such a way as to preserve the alphabetical order and the grouping of shapes and functions of the previously selected character set. For example, if the character set selected from the first character set array is {A, B, C, D, E, F}, then the second character set array is {A}, (B), (C), (D), (E) and (F). The second character set array may be displayed such that the relative coordinates of elements of the array map to the relative coordinates of the key array. Hence pressing key(R,C) results in selecting character set (CHAR)(R5C).
[042] In this manner, typing a character comprises a) examining a first character set array displayed (preferably as a keypad image/onscreen array) on the screen, b) pressing a key on the physical keypad interface to select a first character set containing the desired character, c) examining a second character set array displayed (preferably as a keypad image/onscreen array) on the screen and d) pressing a key on the physical keypad interface to select a second character set containing only the desired character, resulting in character input.
[043] In this manner, it would not matter if the user's fingers block viewing the physical keypad interface itself, because the user looks to the keypad image on the screen for reference. This user interaction is similar to how a user can easily manipulate a mouse on a mouse pad by associating mouse movements with cursor movements on the screen without having to look at the mouse itself. Moreover, since the user need not look at the physical keypad interface, markings on the physical keypad can be eliminated (i.e., the character array does not necessarily need to appear on the physical key itself but, rather, is displayed on the keypad image on the screen). This is advantageous since many physical keypad buttons are too small to adequately print more than a couple of tiny, hard-to-see characters. The keypad image may be enlarged for easier viewing of the characters mapped to each key.
[044] Selecting a character set with only one element results in typing a character or executing a command associated with the character set. Frequently, the character is the same as the element of the character set. For example, selecting character set {A} results in typing character A. However, there are characters that either are not easily displayed or are not easily recognizable on a screen and the character-set must be set to display a related symbol, a word or a phrase. For examples, the characters for return, delete, tab, backspace, space, comma and period may be respectively displayed as "|", "delete", "tab", "<-" , "→", "comma" and "period", or the like.
[045] Many writing scripts have letters formed by adding one or more diacritics to a letter. These letters may be grouped into sets either by their diacritical sign or by their letter. Typing such a letter may take more than two key strokes. An option to type a letter with diacritics is to designate a special key. Pressing the key after or before typing a letter turns it into the letter with the diacritics. For example, numeric key 7 can be designated as the special key and pressing it after typing the letter u changes the letter u to umlaut u in German.
[046] Various color schemes may aid in separating characters and character sets displayed on the screen.
[047] When key repeating is enabled, holding a key down when the screen displays the first character set array implies using the same key for the second character set array. [048] When key repeating is enabled, holding a key down when the screen displays the second character set array implies retyping the same character in the second character set selected.
[049] One way to display character set arrays is to display each character set as a group of characters without separating commas and brackets used for set notation. Hence, the set {A,B,C,D,E,F} may be displayed as ABCDEF and the set {A} may be displayed as A. Blank spaces and tabs may be used to separate character sets.
[050] Another way to display a character-set that has more than one member is to display the members such that their relative positions correspond to the relative locations of the numeric keys of the standard phone keypad in the next keystroke. For example, the set {A,B,C,D,E,F} may be displayed in two rows; the first row shows ABC and the second row shows DEF.
[051] Additional lines and images can also be used to paint character-sets as buttons on the display.
[052] Care should be taken to display characters and character-sets using the reading and writing convention of the language. English, for example, is read from left to right, while Hebrew is read from right to left (See Figs. 12 - 14 for example).
[053] hi some cases, it is necessary for one or more second character-sets to have many members and they should be displayed in such a way to indicate further selection is needed. Selecting such a second character-set will present a third character-set array, and the relative coordinates of the third character-sets are mapped to the relative coordinates of the keys in the key array.
[054] The invention also proposes a pre-selection mode. Pre-selection functionality may provide an indication upon receiving a pre-selection input from the keypad, wherein the preselection input comprises an input to the keypad distinguishable from the user selection. The pre-selection input is distinguishable from the user selection based on key pressure, for example. The pre-selection indication comprises a visual indication of which element of the onscreen array is coordinately mapped to the corresponding key in the keypad array for which the pre-selection input was received. When a finger is lightly placed on a button on the physical keypad interface, the system provides a cue for that button. The cue can be visual by displaying the button with different colors, with a different size or shape, or with special effects. The cue can also be audible by playing a sound, speaking a word or phrase. Providing audible pre-selection cue is especially important for visually challenged users. The pre-selection mode is possible even when buttons are virtual buttons on a touch sensitive display and the button faces are the graphics of the buttons.
[055] Pressing harder on the button results in selecting the button. Providing a selection confirmation by playing a sound or speaking a word or phrase in addition to displaying the selection is an option. The optional feedback is especially important for visually challenged users.
[056] Different methods of detecting pre-selection and selection are possible. For example, a button may have two pressure sensitivity levels; light pressure sensitivity level is associated with pre-selection and high pressure sensitivity level is associated with button selection. Other sensory techniques and combination of techniques are also possible. For example, a form of pre-selection on keypads sensitive to only one detection level may include a technique such that the press provides information about the selection and the second press is the actual selection.
[057] This invention also proposes a method to ease selection in text predictive technology for mobile devices. Traditionally, taking cues from inputted text, a mobile device displays one or more predictive guesses which may be displayed either on the input text line or as a drop-down list. Li both cases, selection is by pressing cursor or "select" buttons. Predictive Text functionality may be provided by displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array. The invention proposes displaying a key label adjacent to each guess and selecting a guess is by pressing the key associated with the label adjacent to the guess. This association of labels to predictive guesses is feasible because the interactive sequential key system frequently uses 6 of the 12 buttons on the phone keypad, leaving 6 buttons for other functions. With the multi-tap technique, no spare buttons on the phone keypad are available for selecting predictive guesses. Similarly, on mobile devices equipped with "qwerty" keypad, no spare buttons are available for selecting predictive guesses.
[058] When pre-selection mode is active, light pressing of a button triggers cuing of the associated predictive guess. The processor outputs a pre-selection indication upon receiving a pre-selection input from the keypad corresponding to the user selection of one of the text prediction icons. The cue can be audible by reading aloud the predictive guess or visual by displaying the predictive guess with different colors, with a different size or shape, or with special effects. Hard pressing on a button results in selecting the associated predictive guess.
[059] The following naming applies to labels in the figures: 400 is the display screen; the 500s represent the physical keypad interface keys: 500 is key(l,l); 501 is key(l,2); 502 is key(l,3); 503 is key(2,l); 504 is key(2,2); 505 is key(2,3); 506 is key(3,l); 507 is key(3,2); 508 is key(3,3); 509 is key(4,l); 510 is key(4,2); 511 is key(4,3), the 600s represent the keypad images/icons on the screen: 600 is {CHAR}(1, 1); 601 is {CHAR}(1,2); 602 is {CHAR}(1,3); 603 is {CHAR} (2,1); 604 is {CHAR} (2,2); 605 is {CHAR} (2,3); 606 is {CHAR} (3,1); 607 is {CHAR}(3,2); 608 is {CHAR}(3,3); 609 is {CHAR}(4,1); 610 is {CHAR}(4,2); and 611 is {CHAR} (4,3). As previously mentioned, the keypad image on the screen may be a simple array or may be graphically designed to appear like buttons/keys similar to the physical keypad interface keys, making the association easier for the user.
[060] Pressing key(R, C) results in selecting {CHAR}(R,C). Hence, pressing key(l,l) results in selecting {CHAR}(1,1); pressing key(l,2) results in selecting {CHAR}(1,2); pressing key(l,3) results in selecting {CHAR}(1,3); pressing key(2,l) results in selecting {CHAR}(2,1); pressing key(2,2) results in selecting {CHAR} (2,2); pressing key(2,3) results in selecting {CHAR} (2,3); pressing key(3,l) results in selecting {CHAR} (3,1); pressing key(3,2) results in selecting {CHAR}(3,2); pressing key(3,3) results in selecting {CHAR}(3,3); pressing key(4,l) results in selecting {CHAR} (4,1); pressing key(4,2) results in selecting {CHAR} (4,2); and pressing key(4,3) results in selecting {CHAR} (4,3).
[061] Figure 1 shows an implementation of a device with a display 400 (such as a screen, LCD, or the like), a physical keypad interface with six keys shown (500 - 505) (such as a mobile phone or mobile device keypad or a touchscreen keypad or the like), and an image on the screen showing six icons arranged as an onscreen array (600 - 605), and in this example, graphically designed to appear as a keypad image. The physical keypad interface may actually comprise additional keys, not shown herein. The keys may be larger or smaller than represented. The physical keys may include indicia such as numbers for dialing, (or an array of numbers/letters that is arranged in an ITU Standard E.161 arrangement that most phones built today utilize), or other types of indicia (including the character arrays of the present invention). For the present invention, since a keypad image/onscreen array is displayed to the user on the screen, the indicia printed on the physical keys are immaterial. In this example, the icons of the keypad image (i.e., elements of the onscreen array) on the screen are shown near the bottom of the screen, which may be a desired location in that it is near the physical keypad interface. Other locations on the display area are contemplated herein. The unused portion of the screen may be used to display the output of the character selection, predictive text, or the like. Figure 1 represents a first character-set array to type the English alphabet and various symbols. Here, the symbol for new line is spelled out as "entr." Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing of the icons on the display also shows character-sets to appear as buttons, making the association easier for the user.
[062] Figure 2 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the Spanish alphabet and various symbols. Here, the symbol for new line is spelled out as "entr." Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as burtons.
[063] Figure 3 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the French alphabet and various symbols. Here, the symbol for new line is spelled out as "entr." Groups of special French letters and symbols are labeled as "accents." Whenever possible, symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons.
[064] Figure 4 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type the German alphabet and various symbols. Here, the symbol for new line is spelled out as "entr." Groups of special German letters and symbols are labeled as an umlaute. Whenever possible, symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons. [065] Figure 5 shows an implementation of a device with a display 400, a physical keypad interface with six keys (500 - 505), and a keypad image on the screen showing six icons arranged as an array (600 - 605) wherein the first character-set array is designed to type numeral, mathematical and miscellaneous characters. Here, the symbol for new line is spelled out as "entr." Symbols are displayed and positioned to facilitate selecting second keystrokes. Framing also shows character-sets as buttons.
[066] Figure 6 shows an implementation of an array to select different writing scripts (modes), such as those shown in Figures 1 - 5, for example, hi this example, selecting physical keypad interface key 500 will select icon 600 that represents English language writing script mode (Figure 1); selecting physical keypad interface key 501 will select icon 601 that represents Spanish language writing script mode (Figure 2); selecting physical keypad interface key 502 will select icon 602 that represents French language writing script mode (Figure 3); selecting physical keypad interface key 503 will select icon 603 that represents German language writing script mode (Figure 4); selecting physical keypad interface key 504 will select icon 604 that represents Math/Misc function mode (Figure 5) . hi this example, a button position (505) is reserved for caps lock (icon 605). The arrangement shown in Figure 6 will allow a user to switch between different languages/implementations/modes.
[067] Figure 7 shows an implementation of the second character-set array to type English letters after pressing button 500 in Figure 1. hi this example, each second character-set has exactly one member.
[068] Figure 8 shows an implementation of the second character-set array to type Spanish letters and various symbols after pressing button 504 in Figure 2. Here, except for icon 604, each second character-set has exactly one member. Icon 604 has the label "acento" and selecting it via pressing the 504 key on the physical keypad interface takes the user to a third character-set array shown in Figure 9.
[069] Figure 9 shows an implementation of the third character-set array to type unique Spanish letters and various symbols after pressing button 504 twice. Here, each second character-set has exactly one member.
[070] Figure 10 shows an implementation of the second character-set array to type French letters and various symbols after pressing button 504 in Figure 3. Two character-sets consist of one member each. Selecting other character-sets lead to third character sets. [071] Figure 11 shows an implementation of the second character-set array to type German letters and various symbols after pressing button 504 in Figure 4. Here, except for 604, each second character-set has exactly one member. Icon 604 has the label "umlaut" and selecting it via pressing 504 leads to a third character-set array. This is an example of further nesting of arrays. If upon receiving a second user selection from the keypad to select one of the characters mapped to the second user selection, more than one character remains, the device then populates the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receives a third user selection from the keypad to select one of the characters mapped to the third user selection as the input character. Sequential key selection drills down through nested arrays and is not necessarily limited by 2 or 3 inputs.
[072] Figure 12 shows the encoding of the English alphabet in accordance with the convention for reading directions of English on the keypad image on the screen showing six icons arranged as an array (600 - 605).
[073] Figure 13 shows the encoding of the English alphabet in accordance with the convention for reading directions of English, further including punctuation grouped together on the keypad image on the screen showing six icons arranged as an array (600 - 605).
[074] Figure 14 is an encoding example of a language where the convention for reading directions is different from that in English on the keypad image on the screen showing six icons arranged as an array (600 - 605). As reading of Hebrew text is from right to left then from top to bottom, aleph (N), the first letter of the alphabet is on the third character-set of the first row. The arrangement of letters on a character-set also follow the right to left then top to bottom usage, hence the letter beth (p. ) is on the left of the letter aleph. To follow the right to left convention, zayin (T), the seventh letter of the alphabet, is on the second character-set of the first row. Other letters are similarly arranged.
[075] Other key arrangements shown in co-pending U.S. Application No. 11/383,605 and incorporated herein by reference may be utilized on the onscreen array in accordance with the present invention. The physical buttons may or may not include the key arrangements printed thereon.
[076] A unique advantage to the present invention is that the displayed characters can be programmed in accordance with the various character arrays without having to change the physical keypad markings. The user can associate what is shown on the display (keypad image) with where his fingers should be positioned on the physical keypad interface, without ever having to look at the physical keypad (similar to knowing where to move a mouse or graphical pen by associating where the pointer is on the display screen and not looking at the mouse/pen).
[077] This invention is applicable to all languages and writing scripts and should not inferred from the figures as limited to only English, Spanish, French, German alphabets and mathematical symbols. The order and/or selection of languages is not limited to that shown in Figure 6.
[078] In addition to the 6-key arrangements shown (e.g., portable music players have about six buttons), the invention may utilize more or less keys as needed for the particular implementation. For example, in a 9-key embodiment, the keypad image includes up to nine keys arranged in three columns and three rows mapped to nine keys of the physical keypad interface. In a 12-key embodiment (e.g., standard phone keypad), the keypad image includes up to twelve keys arranged in three columns and four rows (or otherwise) mapped to twelve keys of the physical keypad interface. The twelve keys can be arranged to correspond to a standard phone keypad with numeric buttons and asterisk and pound buttons in their respective locations on the keypad array, the standard phone keypad separately accessible.
[079] Although the physical keypads described herein are generally in the context of a plurality of keys, the term physical keypad may also be used equally in the context of a touchscreen or other touch-type keyboards. The keys need not necessarily be arranged exactly in an array (rows and columns) but other layouts are contemplated herein where the onscreen array layout essentially mimics part or all of the keypad layout.
[080] The device may include a large or small screen as known in the art. The display screen may include gray-scale or color (such as an LCD).
[081] The present invention can be adapted for portable devices such as a personal digital assistant, a portable computer, a digital camera or other electronic devices provided with keypad buttons (e.g., mobile phones, music players, iPod ® devices, and the like). The housing for the device may be elongated vertically, or may take on other sizes and shapes, including a clamshell housing structure where the physical keypad is separated by a hinge from the display screen, among other structures. The keyboard may include well-known mode selection keys, or other hardware or software for switching between text entry and telephony entry. The output device shown in the examples is a display, which is preferably a full graphic LCD. Other types of output devices may alternatively be utilized. The output device may display the output so a user can visually see what characters are being selected and include tones, etc. A processing device is contained within the housing of the device and is coupled between the physical keyboard interface and the display. The processing device controls the operation of the display, as well as the overall operation of the device, in response to actuation of keys on the by the user.
[082] Computer program elements of the invention may be embodied in hardware and/or in software (including firmware, resident software, micro-code, etc.). The invention may take the form of a computer program product, which can be embodied by a computer-usable or computer-readable storage medium having computer-usable or computer-readable program instructions, "code" or a "computer program" embodied in the medium for use by or in connection with the instruction execution system, hi the context of this document, a computer- usable or computer-readable medium may be any medium that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The computer-usable or computer-readable medium may be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device. The computer program product and any software and hardware described herein form the various means for carrying out the functions of the invention in the example embodiments.

Claims

Claims:
1. A device for receiving an input character from a user, comprising a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; a display operable to display an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; a processor for receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
2. The device of claim 1 wherein the onscreen array is graphically designed to simulate an image of a keypad having buttons to represent the elements of the onscreen array.
3. The device of claim 1 wherein the each element of the onscreen array is coordinately mapped to only some of the keys available on the keypad.
4. The device of claim 1 wherein the onscreen array comprises up to six elements arranged in three columns and two rows.
5. The device of claim 4 wherein each of the a plurality of character sets in the onscreen array comprise up to six characters arranged in three columns and two rows.
6. The device of claim 1 wherein the plurality of character sets corresponds to a selected writing script mode comprising one or more languages or functions.
7. The device of claim 6 wherein the processor selectively populates the onscreen array with a plurality of writing script mode selections as elements of the onscreen array, and receives input from the keypad to select one of the writing script mode selections mapped to the received input.
8. The device of claim 1 wherein the characters and character sets for each language are populated in the onscreen array in accordance with a convention for reading directions of the language.
9. The device of claim 1 wherein the onscreen array comprises only a portion of the display.
10. The device of claim 1 wherein the input character is output to the display.
11. The device of claim 1 wherein the processor outputs a pre-selection indication upon receiving a pre-selection input from the keypad, wherein the pre-selection input comprises an input to the keypad distinguishable from the user selection.
12. The device of claim 11 wherein the pre-selection input is distinguishable from the user selection based on key pressure.
13. The device of claim 11 wherein the pre-selection indication comprises a visual indication of which element of the onscreen array is coordinately mapped to the corresponding key in the keypad array for which the pre-selection input was received.
14. The device of claim 1 wherein the processor further provides predictive text functionality by displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
15. The device of claim 14 wherein the processor outputs a pre-selection indication upon receiving a pre-selection input from the keypad corresponding to the user selection of one of the text prediction icons.
16. The device of claim 1 wherein, if upon receiving a second user selection from the keypad to select one of the characters mapped to the second user selection, more than one character remains, populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a third user selection from the keypad to select one of the characters mapped to the third user selection as the input character.
17. A method for receiving an input character from a user, comprising providing a keypad comprising a plurality of keys arranged in rows and columns forming a keypad array; displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in the keypad array; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
18. The method of claim 17 further comprising providing a mode selection for selecting a writing script mode comprising one or more languages or functions.
19. The method of claim 18 wherein the characters and character sets for each language are populated in the onscreen array in accordance with a convention for reading directions of the language.
20. The method of claim 17 further comprising outputting a pre-selection indication upon receiving a pre-selection input from the keypad, wherein the pre-selection input comprises an input to the keypad distinguishable from the user selection.
21. The method of claim 17 further comprising predictive text functionality comprising displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
22. A computer program product for receiving an input character from a user, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising instructions for displaying an onscreen array comprising a plurality of elements arranged in rows and columns, wherein each element of the onscreen array is coordinately mapped to a corresponding key in a keypad array of a keypad; receiving an input character by populating the onscreen array with a plurality of character sets as elements of the onscreen array, wherein each character set comprises a plurality of characters; receiving a first user selection from the keypad to select one of the character sets mapped to the first user selection; populating the onscreen array with a plurality of characters from the selected one of the character sets as elements of the onscreen array; and receiving a second user selection from the keypad to select one of the characters mapped to the second user selection as the input character.
23. The method of claim 22 further comprising providing a mode selection for selecting a writing script mode comprising one or more languages or functions.
24. The method of claim 23 wherein the characters and character sets for each language are populated in the onscreen array in accordance with a convention for reading directions of the language.
25. The method of claim 22 further comprising outputting a pre-selection indication upon receiving a pre-selection input from the keypad, wherein the pre-selection input comprises an input to the keypad distinguishable from the user selection.
26. The method of claim 22 further comprising predictive text functionality comprising displaying one or more text prediction icons to the user and allowing user selection of one of the text prediction icons by coordinately mapping the icons to a corresponding key on the keypad array.
PCT/US2007/085047 2006-11-20 2007-11-19 Interactive sequential key system to input characters on small keypads WO2008064142A2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US86002406P 2006-11-20 2006-11-20
US60/860,024 2006-11-20
US96402607P 2007-08-08 2007-08-08
US60/964,026 2007-08-08

Publications (2)

Publication Number Publication Date
WO2008064142A2 true WO2008064142A2 (en) 2008-05-29
WO2008064142A3 WO2008064142A3 (en) 2008-11-06

Family

ID=39430531

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2007/085047 WO2008064142A2 (en) 2006-11-20 2007-11-19 Interactive sequential key system to input characters on small keypads

Country Status (1)

Country Link
WO (1) WO2008064142A2 (en)

Cited By (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL2005235C2 (en) * 2010-08-16 2012-02-20 Albertus Petrus George Meeteren SYSTEM AND METHOD FOR PERFORMING INSTRUCTIONS AND IMPORT DEVICE.
WO2013169875A3 (en) * 2012-05-09 2014-03-27 Yknots Industries Llc Device, method, and graphical user interface for displaying content associated with a corresponding affordance
US9602729B2 (en) 2015-06-07 2017-03-21 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9612741B2 (en) 2012-05-09 2017-04-04 Apple Inc. Device, method, and graphical user interface for displaying additional information in response to a user contact
US9619076B2 (en) 2012-05-09 2017-04-11 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US9645732B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US9665206B1 (en) 2013-09-18 2017-05-30 Apple Inc. Dynamic user interface adaptable to multiple input tools
US9674426B2 (en) 2015-06-07 2017-06-06 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9778771B2 (en) 2012-12-29 2017-10-03 Apple Inc. Device, method, and graphical user interface for transitioning between touch input to display output relationships
US9785305B2 (en) 2015-03-19 2017-10-10 Apple Inc. Touch input cursor manipulation
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9886184B2 (en) 2012-05-09 2018-02-06 Apple Inc. Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9959025B2 (en) 2012-12-29 2018-05-01 Apple Inc. Device, method, and graphical user interface for navigating user interface hierarchies
US9990107B2 (en) 2015-03-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US9990121B2 (en) 2012-05-09 2018-06-05 Apple Inc. Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
US9996231B2 (en) 2012-05-09 2018-06-12 Apple Inc. Device, method, and graphical user interface for manipulating framed graphical objects
US10037138B2 (en) 2012-12-29 2018-07-31 Apple Inc. Device, method, and graphical user interface for switching between user interfaces
US10042542B2 (en) 2012-05-09 2018-08-07 Apple Inc. Device, method, and graphical user interface for moving and dropping a user interface object
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US10067653B2 (en) 2015-04-01 2018-09-04 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10073615B2 (en) 2012-05-09 2018-09-11 Apple Inc. Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US10078442B2 (en) 2012-12-29 2018-09-18 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or select content based on an intensity theshold
US10095391B2 (en) 2012-05-09 2018-10-09 Apple Inc. Device, method, and graphical user interface for selecting user interface objects
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US10126930B2 (en) 2012-05-09 2018-11-13 Apple Inc. Device, method, and graphical user interface for scrolling nested regions
US10162452B2 (en) 2015-08-10 2018-12-25 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10175864B2 (en) 2012-05-09 2019-01-08 Apple Inc. Device, method, and graphical user interface for selecting object within a group of objects in accordance with contact intensity
US10175757B2 (en) 2012-05-09 2019-01-08 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for touch-based operations performed and reversed in a user interface
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US10275087B1 (en) 2011-08-05 2019-04-30 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US10416800B2 (en) 2015-08-10 2019-09-17 Apple Inc. Devices, methods, and graphical user interfaces for adjusting user interface objects
US10437333B2 (en) 2012-12-29 2019-10-08 Apple Inc. Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture
US10496260B2 (en) 2012-05-09 2019-12-03 Apple Inc. Device, method, and graphical user interface for pressure-based alteration of controls in a user interface
US10620781B2 (en) 2012-12-29 2020-04-14 Apple Inc. Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5124940A (en) * 1983-01-21 1992-06-23 The Laitram Corporation Programmable hand held computers operable with two-strokes perentry alpha with instruction menus on temporary viewing screen

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5124940A (en) * 1983-01-21 1992-06-23 The Laitram Corporation Programmable hand held computers operable with two-strokes perentry alpha with instruction menus on temporary viewing screen

Cited By (119)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL2005235C2 (en) * 2010-08-16 2012-02-20 Albertus Petrus George Meeteren SYSTEM AND METHOD FOR PERFORMING INSTRUCTIONS AND IMPORT DEVICE.
US10664097B1 (en) 2011-08-05 2020-05-26 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10275087B1 (en) 2011-08-05 2019-04-30 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10338736B1 (en) 2011-08-05 2019-07-02 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10345961B1 (en) 2011-08-05 2019-07-09 P4tents1, LLC Devices and methods for navigating between user interfaces
US10365758B1 (en) 2011-08-05 2019-07-30 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10386960B1 (en) 2011-08-05 2019-08-20 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10540039B1 (en) 2011-08-05 2020-01-21 P4tents1, LLC Devices and methods for navigating between user interface
US10649571B1 (en) 2011-08-05 2020-05-12 P4tents1, LLC Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10656752B1 (en) 2011-08-05 2020-05-19 P4tents1, LLC Gesture-equipped touch screen system, method, and computer program product
US9753639B2 (en) 2012-05-09 2017-09-05 Apple Inc. Device, method, and graphical user interface for displaying content associated with a corresponding affordance
US9996231B2 (en) 2012-05-09 2018-06-12 Apple Inc. Device, method, and graphical user interface for manipulating framed graphical objects
US10191627B2 (en) 2012-05-09 2019-01-29 Apple Inc. Device, method, and graphical user interface for manipulating framed graphical objects
US11010027B2 (en) 2012-05-09 2021-05-18 Apple Inc. Device, method, and graphical user interface for manipulating framed graphical objects
US10996788B2 (en) 2012-05-09 2021-05-04 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
US9823839B2 (en) 2012-05-09 2017-11-21 Apple Inc. Device, method, and graphical user interface for displaying additional information in response to a user contact
US10969945B2 (en) 2012-05-09 2021-04-06 Apple Inc. Device, method, and graphical user interface for selecting user interface objects
US10942570B2 (en) 2012-05-09 2021-03-09 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
US10908808B2 (en) 2012-05-09 2021-02-02 Apple Inc. Device, method, and graphical user interface for displaying additional information in response to a user contact
US10884591B2 (en) 2012-05-09 2021-01-05 Apple Inc. Device, method, and graphical user interface for selecting object within a group of objects
US9886184B2 (en) 2012-05-09 2018-02-06 Apple Inc. Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object
US10782871B2 (en) 2012-05-09 2020-09-22 Apple Inc. Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object
US10775994B2 (en) 2012-05-09 2020-09-15 Apple Inc. Device, method, and graphical user interface for moving and dropping a user interface object
US10775999B2 (en) 2012-05-09 2020-09-15 Apple Inc. Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US11068153B2 (en) 2012-05-09 2021-07-20 Apple Inc. Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US9971499B2 (en) 2012-05-09 2018-05-15 Apple Inc. Device, method, and graphical user interface for displaying content associated with a corresponding affordance
US11221675B2 (en) 2012-05-09 2022-01-11 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
US9990121B2 (en) 2012-05-09 2018-06-05 Apple Inc. Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
US11314407B2 (en) 2012-05-09 2022-04-26 Apple Inc. Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object
US11023116B2 (en) 2012-05-09 2021-06-01 Apple Inc. Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
US11354033B2 (en) 2012-05-09 2022-06-07 Apple Inc. Device, method, and graphical user interface for managing icons in a user interface region
US10042542B2 (en) 2012-05-09 2018-08-07 Apple Inc. Device, method, and graphical user interface for moving and dropping a user interface object
US10592041B2 (en) 2012-05-09 2020-03-17 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
US11947724B2 (en) 2012-05-09 2024-04-02 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for operations performed in a user interface
US10496260B2 (en) 2012-05-09 2019-12-03 Apple Inc. Device, method, and graphical user interface for pressure-based alteration of controls in a user interface
US10073615B2 (en) 2012-05-09 2018-09-11 Apple Inc. Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US10481690B2 (en) 2012-05-09 2019-11-19 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for media adjustment operations performed in a user interface
US10095391B2 (en) 2012-05-09 2018-10-09 Apple Inc. Device, method, and graphical user interface for selecting user interface objects
US12045451B2 (en) 2012-05-09 2024-07-23 Apple Inc. Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input
US9619076B2 (en) 2012-05-09 2017-04-11 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
US10114546B2 (en) 2012-05-09 2018-10-30 Apple Inc. Device, method, and graphical user interface for displaying user interface objects corresponding to an application
US10126930B2 (en) 2012-05-09 2018-11-13 Apple Inc. Device, method, and graphical user interface for scrolling nested regions
US9612741B2 (en) 2012-05-09 2017-04-04 Apple Inc. Device, method, and graphical user interface for displaying additional information in response to a user contact
US12067229B2 (en) 2012-05-09 2024-08-20 Apple Inc. Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object
US10168826B2 (en) 2012-05-09 2019-01-01 Apple Inc. Device, method, and graphical user interface for transitioning between display states in response to a gesture
US10175864B2 (en) 2012-05-09 2019-01-08 Apple Inc. Device, method, and graphical user interface for selecting object within a group of objects in accordance with contact intensity
WO2013169875A3 (en) * 2012-05-09 2014-03-27 Yknots Industries Llc Device, method, and graphical user interface for displaying content associated with a corresponding affordance
US10175757B2 (en) 2012-05-09 2019-01-08 Apple Inc. Device, method, and graphical user interface for providing tactile feedback for touch-based operations performed and reversed in a user interface
US9996233B2 (en) 2012-12-29 2018-06-12 Apple Inc. Device, method, and graphical user interface for navigating user interface hierarchies
US10185491B2 (en) 2012-12-29 2019-01-22 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or enlarge content
US10915243B2 (en) 2012-12-29 2021-02-09 Apple Inc. Device, method, and graphical user interface for adjusting content selection
US12050761B2 (en) 2012-12-29 2024-07-30 Apple Inc. Device, method, and graphical user interface for transitioning from low power mode
US9857897B2 (en) 2012-12-29 2018-01-02 Apple Inc. Device and method for assigning respective portions of an aggregate intensity to a plurality of contacts
US9959025B2 (en) 2012-12-29 2018-05-01 Apple Inc. Device, method, and graphical user interface for navigating user interface hierarchies
US9778771B2 (en) 2012-12-29 2017-10-03 Apple Inc. Device, method, and graphical user interface for transitioning between touch input to display output relationships
US10101887B2 (en) 2012-12-29 2018-10-16 Apple Inc. Device, method, and graphical user interface for navigating user interface hierarchies
US9965074B2 (en) 2012-12-29 2018-05-08 Apple Inc. Device, method, and graphical user interface for transitioning between touch input to display output relationships
US10037138B2 (en) 2012-12-29 2018-07-31 Apple Inc. Device, method, and graphical user interface for switching between user interfaces
US10620781B2 (en) 2012-12-29 2020-04-14 Apple Inc. Device, method, and graphical user interface for moving a cursor according to a change in an appearance of a control icon with simulated three-dimensional characteristics
US10175879B2 (en) 2012-12-29 2019-01-08 Apple Inc. Device, method, and graphical user interface for zooming a user interface while performing a drag operation
US10078442B2 (en) 2012-12-29 2018-09-18 Apple Inc. Device, method, and graphical user interface for determining whether to scroll or select content based on an intensity theshold
US10437333B2 (en) 2012-12-29 2019-10-08 Apple Inc. Device, method, and graphical user interface for forgoing generation of tactile output for a multi-contact gesture
US9665206B1 (en) 2013-09-18 2017-05-30 Apple Inc. Dynamic user interface adaptable to multiple input tools
US10387029B2 (en) 2015-03-08 2019-08-20 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US9645709B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9645732B2 (en) 2015-03-08 2017-05-09 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10095396B2 (en) 2015-03-08 2018-10-09 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US10860177B2 (en) 2015-03-08 2020-12-08 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10402073B2 (en) 2015-03-08 2019-09-03 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US11112957B2 (en) 2015-03-08 2021-09-07 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US10338772B2 (en) 2015-03-08 2019-07-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10180772B2 (en) 2015-03-08 2019-01-15 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9990107B2 (en) 2015-03-08 2018-06-05 Apple Inc. Devices, methods, and graphical user interfaces for displaying and using menus
US10067645B2 (en) 2015-03-08 2018-09-04 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US9632664B2 (en) 2015-03-08 2017-04-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10048757B2 (en) 2015-03-08 2018-08-14 Apple Inc. Devices and methods for controlling media presentation
US11977726B2 (en) 2015-03-08 2024-05-07 Apple Inc. Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object
US10613634B2 (en) 2015-03-08 2020-04-07 Apple Inc. Devices and methods for controlling media presentation
US10268342B2 (en) 2015-03-08 2019-04-23 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10268341B2 (en) 2015-03-08 2019-04-23 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10599331B2 (en) 2015-03-19 2020-03-24 Apple Inc. Touch input cursor manipulation
US11550471B2 (en) 2015-03-19 2023-01-10 Apple Inc. Touch input cursor manipulation
US9639184B2 (en) 2015-03-19 2017-05-02 Apple Inc. Touch input cursor manipulation
US10222980B2 (en) 2015-03-19 2019-03-05 Apple Inc. Touch input cursor manipulation
US9785305B2 (en) 2015-03-19 2017-10-10 Apple Inc. Touch input cursor manipulation
US11054990B2 (en) 2015-03-19 2021-07-06 Apple Inc. Touch input cursor manipulation
US10152208B2 (en) 2015-04-01 2018-12-11 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10067653B2 (en) 2015-04-01 2018-09-04 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US9706127B2 (en) 2015-06-07 2017-07-11 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US11681429B2 (en) 2015-06-07 2023-06-20 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9602729B2 (en) 2015-06-07 2017-03-21 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10200598B2 (en) 2015-06-07 2019-02-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9860451B2 (en) 2015-06-07 2018-01-02 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9891811B2 (en) 2015-06-07 2018-02-13 Apple Inc. Devices and methods for navigating between user interfaces
US9916080B2 (en) 2015-06-07 2018-03-13 Apple Inc. Devices and methods for navigating between user interfaces
US11835985B2 (en) 2015-06-07 2023-12-05 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9830048B2 (en) 2015-06-07 2017-11-28 Apple Inc. Devices and methods for processing touch inputs with instructions in a web page
US11231831B2 (en) 2015-06-07 2022-01-25 Apple Inc. Devices and methods for content preview based on touch input intensity
US10705718B2 (en) 2015-06-07 2020-07-07 Apple Inc. Devices and methods for navigating between user interfaces
US10303354B2 (en) 2015-06-07 2019-05-28 Apple Inc. Devices and methods for navigating between user interfaces
US10455146B2 (en) 2015-06-07 2019-10-22 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US9674426B2 (en) 2015-06-07 2017-06-06 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US11240424B2 (en) 2015-06-07 2022-02-01 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10841484B2 (en) 2015-06-07 2020-11-17 Apple Inc. Devices and methods for capturing and interacting with enhanced digital images
US10346030B2 (en) 2015-06-07 2019-07-09 Apple Inc. Devices and methods for navigating between user interfaces
US11182017B2 (en) 2015-08-10 2021-11-23 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US10416800B2 (en) 2015-08-10 2019-09-17 Apple Inc. Devices, methods, and graphical user interfaces for adjusting user interface objects
US10162452B2 (en) 2015-08-10 2018-12-25 Apple Inc. Devices and methods for processing touch inputs based on their intensities
US11327648B2 (en) 2015-08-10 2022-05-10 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10698598B2 (en) 2015-08-10 2020-06-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10248308B2 (en) 2015-08-10 2019-04-02 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interfaces with physical gestures
US10754542B2 (en) 2015-08-10 2020-08-25 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US11740785B2 (en) 2015-08-10 2023-08-29 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10963158B2 (en) 2015-08-10 2021-03-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10235035B2 (en) 2015-08-10 2019-03-19 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US10209884B2 (en) 2015-08-10 2019-02-19 Apple Inc. Devices, Methods, and Graphical User Interfaces for Manipulating User Interface Objects with Visual and/or Haptic Feedback
US10203868B2 (en) 2015-08-10 2019-02-12 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback
US10884608B2 (en) 2015-08-10 2021-01-05 Apple Inc. Devices, methods, and graphical user interfaces for content navigation and manipulation
US9880735B2 (en) 2015-08-10 2018-01-30 Apple Inc. Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

Also Published As

Publication number Publication date
WO2008064142A3 (en) 2008-11-06

Similar Documents

Publication Publication Date Title
US7561072B2 (en) Interactive sequential key system to input characters on small keypads
WO2008064142A2 (en) Interactive sequential key system to input characters on small keypads
JP6000385B2 (en) Multilingual key input device and method
US5128672A (en) Dynamic predictive keyboard
JP3727399B2 (en) Screen display type key input device
US5574482A (en) Method for data input on a touch-sensitive screen
US20110141027A1 (en) Data entry system
US20020180797A1 (en) Method for a high-speed writing system and high -speed writing device
KR20120107110A (en) Features of data entry system
CN102103454A (en) Human-machine interface for predicting user input in real time
EP1807772A2 (en) Apparatus and method for providing visual indication of character ambiguity during text entry
WO2010099835A1 (en) Improved text input
WO2007121673A1 (en) Method and device for improving inputting speed of characters
WO2003014983A1 (en) Method of and apparatus for selecting symbols in ideographic languages
KR101046914B1 (en) Recursive key input apparatus and method thereof
US20120242583A1 (en) user interface for a hand held device
US8667391B2 (en) Handheld electronic device having multiple-axis input device, selectable language indicator, and menus for language selection, and associated method
Hirche et al. Adaptive interface for text input on large-scale interactive surfaces
JPH09128134A (en) Screen touch type input device
US8069029B2 (en) Handheld electronic device having multiple-axis input device and selectable language indicator for language selection, and associated method
WO2008055358A1 (en) Handheld electronic device having multiple-axis input device and selectable language indicator for language selection, and associated method
US20080114585A1 (en) Handheld Electronic Device Having Multiple-Axis Input Device and Selectable Input Mode Indicator, and Associated Method
JP3899337B2 (en) Character input system, character input method, character input program, and recording medium
JP4027964B2 (en) Keyboard sheet setting method
US20120120012A1 (en) Method for inputting digital characters

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07854688

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07854688

Country of ref document: EP

Kind code of ref document: A2