JP6574939B2 - Display control device, display control method, display control system, and head-mounted display - Google Patents

Description

  The present disclosure relates to a display control device, a display control method, a display control system, and a head-mounted display.

  As one of wearable terminals worn by a user, there is a head mounted display (Head Mounted Display; head mounted display; hereinafter referred to as “HMD”). The HMD is a display device that is worn on the user's head and used in recent years as a display device for a user to check information while working in a work environment in addition to a display device such as an AV device or a computer game. in use.

  For example, in a medical field, an HMD is used as a display device for projecting an endoscope image. The surgeon wears the HMD and performs an operation while viewing the video displayed on the HMD. Until now, it has been common for an endoscope image to be displayed on a monitor installed near the operator, so the operator has to move his / her line of sight frequently between the monitor and the affected area. By projecting the endoscope image on the HMD, the surgeon can confirm the endoscope image and the affected area displayed on the display unit of the HMD without greatly moving the line of sight.

  Here, when a plurality of users use the HMD in the operating room, display contents and display settings displayed on the display unit of the HMD are different according to each user's charge and preference. The display setting of the display unit can be set every time the normal HMD is mounted, but it takes time. Therefore, it has also been proposed to store in advance as display setting information and automatically set the display of the HMD based on the display setting information associated with the password when the password of the user who uses the HMD is identified. (For example, Patent Document 1).

JP 09-93513 A

  However, in the technique described in Patent Document 1, since the display setting is performed based on the display setting information of the user stored in the HMD, the HMD that is automatically set for the user is fixed. In addition, when it is desired that a plurality of users have the same HMD display setting, it is necessary to perform display setting in each HMD.

  Therefore, the present disclosure proposes a new and improved display control device, display control method, display control system, and head-mounted display that can easily perform display settings for a plurality of HMDs.

  According to the present disclosure, for each of the plurality of head-mounted displays, the display control device includes a display control unit that performs display setting of the head-mounted display based on display setting information associated with the acquired user identification information. Is provided.

  Further, according to the present disclosure, there is disclosed a display control method for performing display setting of the head mounted display based on display setting information associated with the acquired user identification information for each of the plurality of head mounted displays. The

  Further, according to the present disclosure, the head-mounted display includes a plurality of head-mounted displays and a display control device that performs display setting for each of the head-mounted displays, and the head-mounted display acquires at least user identification information. The display control device includes: an input unit that receives user identification information from each head-mounted display; and display control that performs display settings for the head-mounted display based on display setting information associated with the user identification information. And a display control system.

  According to the present disclosure, there is provided a head-mounted display including at least a reader unit that acquires user identification information and an output unit that outputs information acquired by the reader unit to a display control device.

  As described above, according to the present disclosure, it is possible to easily perform display settings for a plurality of HMDs. Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

1 is a system configuration diagram illustrating a configuration example of an endoscope system according to a first embodiment of the present disclosure. It is explanatory drawing explaining a user's operation | movement at the time of the display setting of HMD which concerns on the embodiment. It is a functional block diagram which shows the function structure of HMD and a processor unit which comprise the display control system which concerns on the embodiment. It is explanatory drawing explaining the display direction of the image | video which is one of the display setting information of HMD. It is explanatory drawing explaining the arrangement | positioning of the image | video which is one of the display setting information of HMD. It is a flowchart which shows the display process based on the display setting information in the display control system which concerns on the same embodiment. It is explanatory drawing which shows the example which displays a user name on a processor unit. It is explanatory drawing which shows the example which displays a user ID on a processor unit. It is explanatory drawing which shows the example which displays the image currently displayed on HMD on a processor unit. It is explanatory drawing which shows the example which displays a notification object on an external display. It is a functional block diagram showing functional composition of a HMD and a processor unit which constitute a display control system concerning a 2nd embodiment of this indication.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. First embodiment (when display setting information is held in a processor unit)
1.1. System configuration 1.2. Display setting method (1) Outline (2) Functional configuration (3) Display setting process Second embodiment (when display setting information is held in an IC card)
3. Summary

<1. First Embodiment>
[1.1. System configuration]
First, with reference to FIG. 1, an endoscope system will be described as an example of a system using an HMD according to the first embodiment of the present disclosure. FIG. 1 is a system configuration diagram illustrating a configuration example of the endoscope system 1 according to the present embodiment.

  The endoscope system 1 according to the present embodiment is a system used in endoscopic surgery, and an operator performs an operation while wearing an HMD and visually recognizing the state of an affected part imaged by an endoscope apparatus. As shown in FIG. 1, the endoscope system 1 includes an HMD 100 (100A, 100B), a display 300, and an external device 400 (400A, 400B) connected to a processor unit 200.

  The HMD 100 is a display device that displays information such as an input video from the external device 400. The HMD 100 is, for example, a goggle-shaped non-transparent HMD, and is used in a state where the user wears the head. HMD100 consists of a main-body part provided with the display part which shows information to the wearer of the HMD100, and an upper fixing part and a rear fixing part for fixing the main body part to the head. When fixed to the wearer's head by the fixing unit, the display unit of the main body is positioned in front of the left and right eyes of the wearer.

  The main body is a part that covers both eyes of the wearer. The main body may be configured to cover, for example, the vicinity of the left and right temples of the wearer. By adopting such a shape, the front of the wearer's eyes can be almost completely covered at the time of wearing, and external images are not incident on the wearer's eyes, making it easier to view the image. For example, an imaging unit for photographing the surrounding environment may be provided on the outer surface of the main body unit. As a result, the wearer of the HMD 100 can recognize information on the surrounding environment that is visible when the HMD 100 is not worn, in addition to information provided from the external device 400 or the like via the processor unit 200 (video see-through). .

  In the HMD 100 according to the present embodiment, for example, a main body is provided with a reader unit (reference numeral 170 in FIG. 2) for reading user identification information that is user-specific information. The reader unit is configured to be able to acquire information from an NFC-compatible device, for example, by NFC (Near field communication).

  Inside the main body, a first display element (reference numeral 165 in FIG. 3) that presents the image for the left eye on the first display unit, and a second image that presents the image for the right eye on the second display unit. A display element (reference numeral 166 in FIG. 3) is provided. Each display element presents, for example, an image of an endoscope apparatus provided by the processor unit 200, an image captured by an imaging unit of the main body, and the like. The display control process for images displayed on the display unit of the HMD 100 will be described later. The main body is provided with cables 140 (140A and 140B) connected to the processor unit 200 in order to transmit and receive information to and from the processor unit 200. In the present embodiment, the HMD 100 and the processor unit 200 are connected by wire, but the present disclosure is not limited to this example, and information communication between devices may be performed by wireless communication.

  Information displayed on the display unit of the HMD 100 may be switched by the remote controller 102 (102A, 102B). The remote controller 102 is provided as a pair with one HMD 100. For example, the remote controller may be a foot switch on which the wearer performs a stepping input operation with a foot. Input information from the remote controller 102 is output to the processor unit 200.

  The processor unit 200 is a control device that controls connected devices. In the present embodiment, the processor unit 200 controls the HMD 100 (100A, 100B), the display 300, and the external device 400 (400A, 400B) as shown in FIG. Specifically, the processor unit 200 processes information input from the external device 400 into information that can be displayed on the display unit of the HMD 100 or the display 300, and outputs the information to each display device. Further, the processor unit 200 switches information to be displayed on the display unit of the HMD 100 based on an operation input from the remote controller 102 of each HMD 100.

  The display 300 is an external display device for an unspecified user to view information. The display 300 is mainly used by a non-HMD 100 wearer who works with the HMD 100 wearer to view information. Input information from the external device 400 and other information can be displayed on the display 300. Information displayed on the display 300 is set by the wearer, the non-wearer, or the processor unit 200.

  The external device 400 is a device that outputs information to be displayed on a display device such as the HMD 100 or the display 300. In the endoscope system 1 of the present embodiment, for example, the external device A 400A is an endoscope apparatus, and an image captured by the camera of the endoscope apparatus is output to the processor unit 200.

  In such an endoscope system 1, information input from the external device 400 is processed by the processor unit 200 and displayed on a display device such as the HMD 100 or the display 300.

[1.2. Display setting method]
Next, a display setting method of each HMD 100 according to the present embodiment will be described based on FIGS.

(1) Overview First, an overview of a display setting method of the HMD 100 according to the present embodiment will be described based on FIG. FIG. 2 is an explanatory diagram for explaining a user's operation at the time of display setting of the HMD 100 according to the present embodiment.

  In the present embodiment, display setting of the display unit of the HMD 100 is performed by acquiring user identification information by the reader unit 170 that acquires information provided in the HMD 100. The user identification information is user-specific information such as a user ID, and is acquired from an ID card 500 or the like held by the user, for example, as shown in FIG. The ID card 500 is an NFC-compatible card, and stores a user ID, a user name, a user affiliation (department), and the like. By bringing the ID card 500 close to the reader unit 170 of the HMD 100, the reader unit 170 can read the user identification information stored in the ID card 500.

  In the medical field, there are many cases where the HMD 100 cannot be touched by hand for hygiene purposes. Therefore, by using a non-contact type IC card such as an NFC compatible card, for example, even when the ID card 500 is mounted under a surgical garment, the user can use the reader unit 170 of the HMD 100 to obtain user identification information without using a hand. It becomes possible to read. In addition to the ID card 500, user identification information may be acquired from an NFC-compatible device or the like.

  Further, the user identification information acquired from the ID card 500 can also be used to determine the user attributes. For example, it is assumed that an attribute indicating whether the user is a medical worker is associated with the user identification information. In this case, when the user identification information is read by the reader unit 170, it is determined whether the user of the user identification information is a medical worker, and the HMD 100 can be used only when the user is a medical worker. Also good.

  User identification information acquired by the reader unit 170 of the HMD 100 is input to the processor unit 200 via the cable 140. The processor unit 200 stores display setting information of the display unit of the HMD 100 in association with user identification information. The processor unit 200 acquires display setting information corresponding to the user identification information input from the HMD 100, and performs display setting of the HMD 100 based on the acquired display setting information. Thereby, even if a user uses different HMD100 each time, an image can be displayed with the display setting information preset by the user. Further, when it is desired to make the display settings of the HMD 100 of a plurality of users the same, the user's ID card 500 having the display settings to be set is simply read by the reader unit 170 of the HMD 100 used by another user. The display settings of the user's HMD 100 can be made the same.

  As described above, in the display setting method of the HMD 100 according to the present embodiment, the display setting of the display unit of the HMD 100 can be easily performed for each user, and it is not necessary to fix the HMD 100 used by the user. Further, even when the display settings of a plurality of users are the same, it is not necessary to perform a special operation, and the setting work can be omitted.

(2) Functional Configuration Next, functional configurations of the HMD 100 and the processor unit 200 configuring the display control system according to the present embodiment will be described based on FIGS. FIG. 3 is a functional block diagram showing functional configurations of the HMD 100 and the processor unit 200 that constitute the display control system according to the present embodiment. FIG. 4 is an explanatory diagram for explaining the display direction of video, which is one of the display setting information of the HMD 100. FIG. 5 is an explanatory diagram for explaining the arrangement of video, which is one of display setting information of the HMD 100.

  FIG. 3 shows functional units that function when display control of the display unit of the HMD 100 is performed, and it is assumed that other functional units are actually provided. The processor unit 200 functions as a display control device that performs display control of the HMD 100 based on display setting information associated with user identification information acquired from the ID card 500.

  First, regarding the display processing function of the HMD 100, as shown in FIG. 3, the HMD 100 includes a display port 162, an image generation unit 164, display elements 165 and 166, and a reader unit 170.

  The display port 162 is an interface that receives input information from the processor unit 200. A cable 140 that enables information communication with the processor unit 200 is connected to the display port 162. For example, image signals to be output to the display elements 165 and 166 and information visually recognized by the wearer of the HMD 100 are input to the display port 162, for example. Information input from the display port 162 is output to the image generation unit 164.

  The image generation unit 164 generates image signals to be output to the display elements 165 and 166 based on information acquired through the processor unit 200. When the image presented to the wearer is a 3D image, the image generation unit 164 outputs the left-eye image signal output to the first display element 165 and the right-eye image output to the second display element 166. A shift process that causes a shift in the image signal is performed. In the shift process, the shift amount between the left-eye image signal and the right-eye image signal is determined according to, for example, the distance between the display elements 165 and 166 and the wearer's eyes, the interval between the wearer's eyes, the virtual image position, and the like. Is done. The image generation unit 164 outputs the generated image signal to the first display element 165 and the second display element 166.

  The display elements 165 and 166 emit image light toward the display unit based on the image signal input from the image generation unit 164. For example, when the HMD 100 is worn, the display elements 165 and 166 are arranged to face the display unit in the front-rear direction of the wearer's face. Thereby, the optical axis of the image light emitted from the display elements 165 and 166 is substantially parallel to the direction of the line of sight when the wearer faces the front.

  The display elements 165 and 166 are composed of organic EL (Electroluminescence) elements, for example. By adopting organic EL elements as the display elements 165 and 166, it is possible to realize small size, high contrast, quick response, and the like. The display elements 165 and 166 have a configuration in which, for example, a plurality of red organic EL elements, green organic EL elements, blue organic EL elements, and the like are arranged in a matrix. Each of these elements is driven by an active matrix type or passive matrix type drive circuit to emit light at a predetermined timing, brightness, or the like. By controlling the drive circuit based on the image signal generated by the image generation unit 164, a predetermined image is displayed as a whole on the display elements 165 and 166, and the image is provided to the wearer via the display unit. Is done.

  Note that, for example, a plurality of eyepieces (not shown) may be disposed between the display elements 165 and 166 and the display unit as an optical system. By making these eyepieces and the wearer's eyes face each other at a predetermined distance, it becomes possible for the wearer to observe a virtual image that appears to display an image at a predetermined position (virtual image position). By presenting such a virtual image, a 3D image can be provided. The virtual image position and the size of the virtual image are set according to the configuration of the display elements 165 and 166 and the optical system.

  The reader unit 170 is a device that reads user identification information from the ID card 500. The reader unit 170 is provided on the outer surface of the main body unit, for example, as shown in FIG. The reader unit 170 acquires user identification information from the ID card 500 or the like brought closer to the reader unit 170 by a predetermined distance or more by NFC, and transmits the user identification information to the processor unit 200.

Next, the display processing function of the processor unit 200 will be described. The processor unit 200, as shown in FIG. 3, the images input unit 211, an image processing unit 212, an input unit 213, a display control unit 214, an output unit 215, an operation input unit 216, setting storage unit 217.

  The image input unit 211 is an interface that receives an image input from the external device 400 to the processor unit 200. In the example of FIG. 3, the endoscope apparatus 10 is illustrated as the external device 400, and an image captured by a camera (not shown) of the endoscope apparatus 10 is input to the image input unit 211 at this time. Is done. The image input unit 211 outputs the input image to the image processing unit 212.

  The image processing unit 212 processes the image input to the processor unit 200 into an image to be displayed on the HMD 100. In the image processing unit 212, for example, from an image captured by the camera of the endoscope apparatus 10, a left-eye image to be displayed on the first display unit of the HMD 100 and a right-eye image to be displayed on the second display unit Is generated. The image processed by the image processing unit 212 is output to the display control unit 214.

  The input unit 213 is an interface through which user identification information acquired by the reader unit 170 of the HMD 100 is input. The user identification information input to the input unit 213 is output to the display control unit 214.

The display control unit 214 controls information displayed on the display unit of the HMD 100. The display control unit 214 controls to display the instructed information based on the display switching instruction from the remote controller 102. In addition, the display control unit 214 acquires corresponding display setting information based on the user identification information input from the input unit 213, and performs display setting based on the acquired display setting information. The display control unit 214 has determined the information and its display setting is displayed on the HMD 100, via the output unit 215 to output the relevant information to each HMD 100.

The operation input unit 216 is an input unit that receives an operation input from a wearer of the HMD 100. In the present embodiment, information displayed on the display unit of the HMD 1 0 0 can be switched by the remote controller 102. Operation input to the remote controller 102 is output to the operation input unit 21 6, the operation input unit 215 outputs the operation input information to the display control unit 21 4. The display control unit 21 4, based on the display switching instruction from the remote controller 102, the information designated to output to HMD100 via the output unit 21 5.

  The setting storage unit 217 is a storage unit that stores display setting information of the HMD 100 corresponding to each user identification information. The display setting information stored in the setting storage unit 127 includes, for example, various setting information such as image quality, image orientation, and image arrangement. For example, the image quality setting information is information representing setting values such as image brightness and hue. The image orientation information is information representing the display orientation of the image displayed on the display unit. Here, the image display direction represents a change with respect to the display state of the reference image.

  For example, as shown in FIG. 4, four users P1 to P4 are working, and the user P1 operates the display unit of the HMD 100 worn by each user P1 to P4. Assume that an image captured by a camera is displayed. The normal mode image shown on the right side of FIG. 4 is displayed on the display unit of the HMD 100 worn by the user P1. This normal mode image is used as a reference. Here, when the users P1 to P4 surround the shooting target, the appearance of the shooting target varies depending on the standing position of the user. For example, for the users P3 and P4 that are in a position facing the user P1 across the shooting target, it is closer to the actual appearance when the image is displayed with the image rotated 180 degrees from the normal mode. In some cases, it is better for the user P2 next to the user P1 to display the image from the normal mode in the left-right reversal mode.

  The standing positions of the users P1 to P4 are often determined by the role of the user during work. Therefore, when the setting information is not frequently changed, it is possible to reduce the load of the user's display setting by storing in advance the setting of the display direction of the image in association with the user identification information of each user. it can.

  The image arrangement information is information indicating which image is arranged and displayed when one or a plurality of images can be simultaneously displayed in the display area by the PinP function. For example, in the example illustrated in FIG. 5, the user P <b> 1 is set to display the main screen on the entire display unit of the HMD 100 and to display a small sub screen on the upper right of the main screen. For example, if the main image is an endoscope camera image and the sub-image is a CT scan image, the endoscope camera image is displayed large on the main screen, and the CT scan image is displayed on the upper right of the image.

  Further, the user P3 is set to display the main screen on the left side of the display unit of the HMD 100 and to display two sub-screens on the right side of the main screen. For example, if the main image is an endoscopic camera image and the sub-image is an X-ray photograph and an external field of view image (video see-through image), the endoscopic camera image is displayed on the main screen, and the X-ray photograph and video are displayed on the right side. See-through images are displayed side by side. In this way, it is possible to present an image that each user wants to see in an easy-to-view arrangement.

  In the setting storage unit 217, display setting information of the image displayed on the display unit of the HMD 100 is stored in association with the user identification information. Note that the display setting information stored in the setting storage unit 217 may store the changed setting when the user changes the setting.

(3) Display setting process The display process based on the display setting information in the display control system according to the present embodiment will be described with reference to Figs. FIG. 6 is a flowchart showing display processing based on display setting information in the display control system according to the present embodiment. 7 to 9 are explanatory diagrams illustrating an example in which the display setting state is displayed on the processor unit 200. FIG.

In the display control system according to the present embodiment, in order to perform display setting of the display unit of the HMD 100, first, the user identification information is acquired by the reader unit 170 of the HMD 100 to be set (S100). The user, for example, as shown in FIG. 2, the reader unit 170 of the HMD 100, and ID card 500 close holding user identification information, Ru is acquired user identification information. The user identification information acquired by the reader unit 170 is output to the processor unit 200 via the cable 140.

  Next, the processor unit 200 that has received the input of the user identification information from the HMD 100 acquires the display setting information corresponding to the user identification information from the setting storage unit 217 by the display control unit 214 (S110). Then, when the display control unit 214 acquires the display setting information associated with the user identification information, the display control unit 214 controls the image processed by the image processing unit 212 to be displayed on the HMD 100 based on the display setting information ( S120). For example, the display control unit 214 sets the brightness and color of the image, the display direction of the image, the number of images to be displayed and the arrangement thereof, based on the contents set in the display setting information. Note that a predetermined value set in advance is set for the display setting information that is not specified in the display setting information.

When the display control unit 214 sets the image based on the display setting information, the image data is output to the HMD 100 via the output unit 215. At this time, the display control unit 214 may display on the notification unit provided in the processor unit 200 which user identification information the display setting of the HMD 100 is based on (S130).

  The processor unit 200 is provided with various notification units indicating the setting state of the HMD 100 connected to the processor unit 200 and various operation buttons for operating the HMD 100. For example, as shown in FIG. 7, in each of the processor units 200-1 and 200-2 to which two HMDs 100 are connected, an operation notification unit 230 is provided for each HMD 100.

  As shown in FIG. 7, the operation notification unit 230 includes, for example, an input signal selection button 231 for an image to be output to the HMD 100, an input image notification unit 232 for notifying an image output to the HMD 100, and display of a sub screen. There is a PinP button 233 for switching on / off. Further, the operation notification unit 230 is provided with a reverse display indicator 234 indicating the orientation of the displayed image, a reverse display switching button 235 for switching the orientation of the displayed image, and the like. Furthermore, when the setting of the display unit of the HMD 100 is automatically performed on the operation notification unit 230 based on the user identification information as in the present embodiment, based on which user (user identification information) the display setting is performed A setting notification unit 236 for notifying may be provided.

  The setting notification unit 236 can be configured by, for example, a display panel that can display information. For example, as shown in FIG. 7, the content displayed on the setting notification unit 236 may display a user name (for example, “AA doctor”) having user identification information associated with the display setting information. Alternatively, as shown in FIG. 8, a user ID (“A01”, “B01”, etc.) as user identification information may be displayed on the setting notification unit 236, and displayed on the HMD 100 as shown in FIG. The setting notification unit 236 may display the existing image.

  In this way, by displaying the display setting state of the HMD 100 on the processor unit 200, for example, when a third party changes the image displayed on the HMD 100, the display setting of another HMD 100 is erroneously changed. Such an erroneous operation can be prevented. Furthermore, the content displayed on the setting notification unit 236 of the processor unit 200 may be displayed on the HMD 100 to which the setting is made. As a result, people around the user wearing the HMD 100 can more reliably recognize the display settings of each HMD 100.

  Further, the processor unit 200 may display the display setting state of each HMD 100 on the external display 300. For example, as illustrated in FIG. 10, a notification object 610 indicating user identification information using the HMD 100 may be displayed on the display 300 together with an image 600 displayed on the HMD 100 of a certain user. The notification object 610 displays a user ID, a user name, etc. as shown in FIG. Thereby, it is possible to notify a person other than the wearer of the HMD 100 which user identification information is used for the display setting of each HMD 100.

  In addition, when the display surface of the external display 300 is configured by a touch panel or the like, it is also possible to operate the object representing the display setting state displayed on the display 300 so that the setting can be adjusted. it can. For example, the display settings of the HMD 100 may be changed collectively by changing a user ID that is one of the user identification information, and various setting states included in the display setting information may be changed. Thereby, for example, a person other than the wearer of the HMD 100 such as a nurse can easily perform operations such as switching the display setting of the HMD 100.

  The display setting process in the display control system according to the present embodiment has been described above. According to this embodiment, based on the user identification information acquired from the ID card 500 or the like by the reader unit 170 of the HMD 100, the display setting information set in advance is acquired, and the display setting of the HMD 100 is performed. Thereby, the user does not need to fix the HMD 100 to be used, and the display setting of the HMD 100 to be used can be easily performed. In addition, it is possible to easily share a display setting of a certain user among a plurality of users.

<2. Second Embodiment>
Based on FIG. 11, a display control system according to the second embodiment of the present disclosure will be described. FIG. 11 is a functional block diagram showing a functional configuration of the HMD and the processor unit constituting the display control system according to the present embodiment. Here, as in the first embodiment, the case where the display control system according to the present embodiment is applied to the endoscope system 2 will be described. The display control system according to the present embodiment is different from the display control system according to the first embodiment in that display setting information of each user's HMD 100 p is stored in the ID card 500 p . Hereinafter, differences from the first embodiment will be described, and a detailed description of functional units similar to those of the first embodiment will be omitted.

First, looking at the display processing functions of HMD100p, as shown in FIG. 11, HMD 100 p includes a display port 162, an image generator 164, a display device 165 and 166, and a reader unit 170. These functional configurations are the same as those of the HMD 100 according to the first embodiment.

In the present embodiment, the reader unit 170 acquires display setting information of the HMD 100 p in addition to the user identification information from the ID card 500 p . ID card 500p is provided with a memory for storing the setting storage unit 520, HMD 100 p display setting information that is set in advance each user in the setting storage unit 520 is assumed to be stored. The reader unit 170 transmits the acquired user identification information and display setting information to the processor unit 200p.

  On the other hand, the display processing function of the processor unit 200p is as shown in FIG. 11, in which the processor unit 200 includes an image input unit 211, an image processing unit 212, an input unit 213, a display control unit 214, and an output unit 215. And an operation input unit 216. These functional configurations are the same as those of the processor unit 200 according to the first embodiment. Note that the processor unit 200p according to the present embodiment may not include a setting storage unit that stores display setting information.

The input unit 213 according to the present embodiment is an interface through which user identification information and display setting information acquired by the reader unit 170 of the HMD 100 p are input. These pieces of information input to the input unit 213 are output to the display control unit 214.

The display control unit 214 controls information displayed on the display unit of the HMD 100 p . The display control unit 214 controls to display the instructed information based on the display switching instruction from the remote controller 102. The display control unit 214, based on the display setting information input from the input unit 213, HMD 100 performs p display settings, the input image from the image processing unit 212, the HMD 100 p via the output unit 215 to output to.

Thus, by holding the display setting information of the HMD 100 p together with the user identification information, it is not necessary to hold the display setting information of each user in the processor unit 200 p . Thus, the user first uses HMD100p, also the processor unit 200p, an image can be displayed on the HMD 100 p at the desired display setting of the user. Also in this embodiment, as in the first embodiment, may be caused to display the state of the display settings HMD 100 p in HMD 100 p and an external display 300.

<3. Summary>
The configuration of the display control system according to the embodiment of the present disclosure and the display setting process based on the configuration have been described above. According to the above-described embodiment, user identification information that specifies at least a user is acquired by the reader unit 170 provided in the HMD 100. Then, based on the display setting information of the HMD 100 associated with the user identification information, the display setting of the HMD 100 that acquired the user identification information is performed. Thereby, the user does not need to fix the HMD 100 to be used, and can easily perform desired display settings. Further, since the display setting of the HMD 100 can be performed by holding the ID card 500 over the reader unit 170 of the HMD 100, it is possible to easily share display setting information of a certain user among a plurality of users.

  In the above-described embodiment, the case where the proposed display control system is applied to an endoscope system has been described. However, the present disclosure is not limited to such an example. For example, it is conceivable to apply the display control system to display settings for in-vivo images acquired by other medical devices other than endoscopes. For example, when using an HMD for blood vessel observation in angiography (angiography examination method) or treatment performed at that time, or when viewing an optical microscope image with an HMD in brain surgery, the display setting is changed. You may perform with the said display control system. Further, the above display control is also used when an ultrasonic image or other image is simultaneously viewed using an HMD during work in a dark place such as an ultrasonic examination, or when the HMD is used during laparotomy using a magnifying glass. HMD display settings can also be made in the system.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, in the above embodiment, the reader unit 170 that reads user identification information acquires information by NFC, but the present technology is not limited to such an example. For example, a reader unit that acquires biometric information of a wearer of the HMD 100 as user identification information may be used. At this time, the user identification information may be, for example, an eye iris or a fingerprint.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
A display control apparatus comprising a display control unit configured to perform display setting of a head-mounted display based on display setting information associated with acquired user identification information for each of the plurality of head-mounted displays.
(2)
An input unit for inputting information from the head-mounted display;
A setting storage unit for storing the display setting information;
With
The input unit receives input of the user identification information acquired by a reader unit provided in the head-mounted display that performs display settings;
The display according to (1), wherein the display control unit acquires the display setting information associated with the user identification information from the setting storage unit based on the user identification information input to the input unit. Control device.
(3)
Comprising an input unit for inputting information from the head-mounted display;
The input unit receives input of the user identification information and the display setting information acquired by a reader unit provided in the head-mounted display that performs display settings,
The display control device according to (1), wherein the display control unit performs display setting of a head-mounted display based on the display setting information input to the input unit.
(4)
The display control apparatus according to any one of (1) to (3), further including a notification unit that notifies a display setting state of each head-mounted display.
(5)
The display control device according to any one of (1) to (4), wherein the display control unit causes an external display device to display a display setting state for the head-mounted display.
(6)
The display control device according to any one of (1) to (5), wherein the display control unit displays the user identification information of each head-mounted display on an external display device.
(7)
The display control apparatus according to any one of (1) to (6), wherein the display setting information is at least one of at least image quality, image arrangement, and image display direction.
(8)
The display control device according to any one of (1) to (7), wherein the user identification information is user-specific information stored in a non-contact type IC card.
(9)
The display control apparatus according to any one of claims (1) to (8), wherein the display setting information is information related to display of an in-vivo image on the head-mounted display.
(10)
A display control method for performing display setting of a head-mounted display based on display setting information associated with acquired user identification information for each of the plurality of head-mounted displays.
(11)
Multiple head mounted displays;
A display control device for performing display settings for each of the head-mounted displays;
Consists of
The head-mounted display includes a reader unit that acquires at least user identification information,
The display control device includes:
An input unit for inputting user identification information from each head-mounted display;
A display control unit configured to perform display setting of the head-mounted display based on display setting information associated with the user identification information;
A display control system comprising:
(12)
A reader unit for obtaining at least user identification information;
An output unit that outputs information acquired by the reader unit to a display control device;
A head mounted display.

1 Endoscopic system 100 HMD
102 remote controller
1 62 display port 164 image generation unit 165 first display element 166 second display element 170 reader unit 200 processor unit 211 image input unit 212 image processing unit 213 input unit 214 display control unit 215 output unit 216 operation input unit 217 setting Storage unit (processor unit)
300 Display 400 External Device 500 ID Card 520 Setting Storage Unit (ID Card)

Claims (11)

An input unit for inputting user identification information acquired from each of the plurality of head-mounted displays;
Display setting information including information indicating a display direction of an image displayed on the display unit of the plurality of head mounted displays based on the user identification information is acquired, and the plurality of head mounted are based on the display setting information A display control unit configured to perform display setting related to a display direction of an image displayed on the display unit of the display, and to display notification information based on the user identification information on an external display device different from the plurality of head mounted displays; ,
With
The display controller, among the plurality of head mounted display, for at least one head-mounted display, an image with the notification information displayed on the head-mounted display, along with displays on the display device A display control apparatus for displaying information indicating a display direction of the image with the display setting on the plurality of head mounted displays . A setting storage unit for storing the display setting information;
With
The input unit receives input of the user identification information acquired by a reader unit provided in the head-mounted display that performs display settings;
The display control according to claim 1, wherein the display control unit acquires the display setting information associated with the user identification information from the setting storage unit based on the user identification information input to the input unit. apparatus. The input unit receives input of the user identification information and the display setting information acquired by a reader unit provided in the head-mounted display that performs display settings,
The display control apparatus according to claim 1, wherein the display control unit performs display setting of a head-mounted display based on the display setting information input to the input unit.   The display control apparatus according to claim 1, wherein the display setting information is at least one of image quality, image arrangement, and image display direction.   The display control device according to claim 1, wherein the user identification information is user-specific information stored in a non-contact type IC card.   The display control apparatus according to claim 1, wherein the display setting information is information related to display of an in-vivo image on the head-mounted display. User identification information acquired from each of the plurality of head mounted displays is input,
Obtaining display setting information including information indicating a display direction of an image displayed on a display unit of the plurality of head-mounted displays based on the user identification information;
Performing display settings relating to the display orientation of images displayed on the display units of the plurality of head-mounted displays based on the acquired display setting information;
Displaying notification information based on the user identification information on an external display device different from the plurality of head mounted displays;
Including
Among the plurality of head mounted displays, for at least one head mounted display, the image displayed on the head mounted display and the notification information are displayed on the display device, and the plurality of heads are displayed. A display control method for displaying information indicating a display direction of the image with the display setting on a mounting display . Multiple head mounted displays;
A display control device for performing display settings for each of the head-mounted displays;
Consists of
The head-mounted display includes a reader unit that acquires at least user identification information,
The display control device includes:
An input unit for inputting user identification information acquired from each head-mounted display;
Display setting information including information indicating a display direction of an image displayed on the display unit of the plurality of head mounted displays based on the user identification information is acquired, and the plurality of head mounted are based on the display setting information A display control unit configured to perform display setting related to a display direction of an image displayed on the display unit of the display, and to display notification information based on the user identification information on an external display device different from the plurality of head mounted displays; ,
With
The display controller, among the plurality of head mounted display, for at least one head-mounted display, an image with the notification information displayed on the head-mounted display, along with displays on the display device A display control system for causing the plurality of head-mounted displays to display information indicating a display direction of the image with the display setting . A reader unit for obtaining at least user identification information;
An output unit that outputs information acquired by the reader unit to a display control device;
With
A head-mounted display that is controlled by the display control device according to claim 1. A medical imaging device;
A plurality of head-mounted displays for displaying images captured by the medical imaging device;
A display control device for performing display settings for each of the head-mounted displays;
Consists of
The display control device includes:
An input unit for inputting user identification information acquired from each head-mounted display;
Display setting information including information indicating a display direction of an image displayed on the display unit of the plurality of head mounted displays based on the user identification information is acquired, and the plurality of head mounted are based on the display setting information A display control unit configured to perform display setting related to a display direction of an image displayed on the display unit of the display, and to display notification information based on the user identification information on an external display device different from the plurality of head mounted displays; ,
With
The display controller, among the plurality of head mounted display, for at least one head-mounted display, an image with the notification information displayed on the head-mounted display, along with displays on the display device A display control system for causing the plurality of head-mounted displays to display information indicating a display direction of the image with the display setting .   The display control system according to claim 10, wherein the medical imaging apparatus is an endoscope apparatus.

Images