WO2015088468A1

WO2015088468A1 - Device for representation of visual information

Info

Publication number: WO2015088468A1
Application number: PCT/UA2014/000116
Authority: WO
Inventors: Mykhailo MOSKALENKO; Galyna POTAPOVA; Olav SANDNES
Original assignee: Moskalenko Mykhailo; Potapova Galyna; Sandnes Olav
Priority date: 2013-12-09
Filing date: 2014-10-23
Publication date: 2015-06-18

Abstract

In the proposed device for representation of visual information containing a screen and a mirror the reflecting surface of which is a surface of revolution, according to the present invention, the axis of revolution of the mirror reflecting surface passes through the center of revolution of the eye, and the screen surface is a surface that approximates points which are optically conjugated with specified points of the image observed by the eye. At that, the screen surface is a surface of revolution the axis of which coincides with the reflecting surface's revolution axis, while the generatrix thereof is a curve that approximates points, which optically conjugate with specified points of the meridional cross-section of the image observed by the eye. In addition, the mirror is executed in a manner to be one-sidedly transparent in the direction towards the pupil of the eye. Added to the device for representation of visual information is a second identical device for representation of visual information, in such a manner that optical surfaces of their elements are symmetrical to each other relative to the plane of symmetry of the observer's eyes.

Description

DEVICE FOR REPRESENTATION OF VISUAL INFORMATION

TECHNICAL FIELD

The invention relates to devices for representation of visual information, mainly glasses virtual or augmented reality, or to on-helmet devices for representation of visual information.

BACKGROUND ART

A known device for representation of visual information currently in use in visualization systems of flight simulators featuring collimated image, contains a spherical screen and a spherical mirror (refer, e.g., to Barry G. Blundell, 3D Displays and Spatial Interaction, Vol. I, ISBN: 978-0-473- 17702-7, « WALKER & WOOD», 2010).

Drawbacks of the known device for representation of visual information are the dependence of the formed observer's notion of his/her spatial position on the position of the observer's pupils of the eyes, because of the dependence of the observed image geometry on the location of the observation point, and the fact that the specified collimation of the observed image in such a device may be obtained solely for a single observation point.

A device for representation of visual information that is closest to the hereby claimed device for representation of visual information is the device containing a screen the diffusing surface of which is a surface of revolution, and a mirror the reflecting surface of which is a surface of revolution (refer, e.g., to Potapova G. K. and Moskalenko M. A., Correction of Geometrical Distortions of Images in Visualization Systems of Flight Simulators, Proceedings of the 7^th International Conference Applied Optics - 2006, Vol. 3. Computer Technologies in Optics. S. -Petersburg, 2006, p.p. 127- 132).

Said device for representation of visual information functions in the following manner. At the surface of the screen that reflects diffusively, a primary optical image is generated in some way or another, this primary optical image being the visual information subject to be transmitted as image to be perceived by the observer. This image may be generated by means of direct or reciprocal projection of the respective image onto the screen. Beams emerging from points of the primary optical image are reflected by concave reflecting surface of the mirror and are reaching the observer's pupils of the eyes. At that, an image forms at the observer' s eye retinae, this image matching the primary optical image at the surface of the screen that reflects diffusively.

Drawbacks of the above-described known device for representation of visual information are the insufficient accuracy of the formed observer's notion of his/her spatial position, and the fact that in such a device, the specified collimation of the observed image can only be obtained for a single point of observation.

DISCLOSURE OF THE INVENTION

The purpose of the present invention is to provide a device for representation of visual information with enhanced accuracy of the formed observer's

•i notion of his/her spatial position and of specified collimation of the image in the area of the possible location of observer's pupil (pupils) of the eye (eyes), owing to the reduced dependence of the observed image geometry on the location of the observer's pupil (pupils) of the eye (eyes). The technical result is achieved due to the fact that in the proposed device for representation of visual information containing a screen and a mirror the reflecting surface of which is a surface of revolution, according to the present invention, the axis of revolution of the mirror reflecting surface passes through the center of revolution of the eye, and the screen surface is a surface that approximates points which are optically conjugated with specified points of the image observed by the eye.

At that, the screen surface is a surface of revolution the axis of which coincides with the reflecting surface's revolution axis, while the generatrix thereof is a curve that approximates points, which optically conjugate with specified points of the meridional cross-section of the image observed by the eye. n addition, the mirror is executed in a manner to be one-sidedly transparent in the direction towards the pupil of the eye.

Added to the device for representation of visual information is a second identical device for representation of visual information, in such a manner that optical surfaces of their elements are symmetrical to each other relative to the plane of symmetry of the observer's eyes.

Features listed above form the substance of the proposed technical solution. The cause-and-effect relation between the aggregate of the substantial features of the proposed technical solution and the achieved technical result consists of the following.

The cause of the dependence of the observed image geometry on the location of the observer's pupils of the eyes in the prototype is that shifting of the observer's pupil of the eye in relation to its nominal position causes the distortion of the observed image geometry (refer to Aerospace Systems for Monitoring and Control: Materials of the VI International Scientific and Technical Conference "AVIA-2004". - Vol. 2.-K. : NAU, 2004, p.p. 23-54, Fig. 2 - 5). Where the reflecting surface of the mirror and the surface of the screen are executed as surfaces of revolution with common axis that passes through the center of revolution of the eye, when the pupil moves, at least, in the plane of vision (when the pupil revolves around the common axis of the reflecting mirror surface and the screen surface), the configuration of the device for representation of visual information's optical system in relation to pupils does not change, and therefore, both the collimation and the geometry of the image observed by the eye, are kept unchanged. Precisely this feature serves to assure higher accuracy of the formed observer's notion of his/her spatial position and the specified collimation of the observed image, at least in the process of horizontal shifting of the observer's pupil (pupils) of the eye (eyes).

BRIEF DESCRIPTION OF DRAWINGS

Substance of the invention is made clear by layout drawings of the proposed device for representation of visual information shown in Figures 1 - 3. Fig. 1 shows a layout drawing of the invention: the monocular device for representation of visual information: the virtual reality for the left eye, according to claim 1 of the formula of the invention. The device features screen 1 and spherical mirror 2. Reflecting surface 3 of mirror 2 is generated by revolution of circular arc 4 round vertical axis 5 that passes through the center of revolution 6 of eye 7. Within the field of vision 8, image 9 observed by eye 7 is determined by the aggregate of points thereof {P'i } . In Fig. 1 , one of the specified points {Ρ',·} is shown: the central point 10 of image 9 observed by eye 7. Point 10 optically conjugates with point 1 1 . Point 1 1 is determined as the point of convergence of bundle of beams 12 reflected by surface 3 of mirror 2 (in reciprocal direction) that emerge from pupil 1 3 of eye 7 and are directed towards point 10. Point 1 1 is the preimage of point 10. In this manner, all points {Pi} optically conjugated with specified points [P'i] of image 9 observed by eye 7, are determined. Points {Pi} are preimages of the respective points {P'i} . Diffusing surface 14 of screen 1 is the surface that approximates points {Pi} optically conjugated with specified points {P'i} of image 9 observed by eye 7.

Fig. 2 shows a layout drawing of monocular device for representation of visual information: the virtual reality for the left eye, according to claim 2 of the formula of the invention. It features screen l and spherical mirror 2.

Reflecting surface 3 of mirror 2 is generated by revolution of circular arc 4 round vertical axis 5 that passes through the center of revolution 6 of eye 7.

Within the field of vision 8, image 9 observed by eye 7 is determined by the aggregate of points {P } of its meridional cross-section 1 5. In Fig. 2, three of the specified points {P } are shown: central point 1 0 and extreme points 16 and 17 of the meridional cross-section 15 of image 9 observed by eye 7. Points 1 0, 16 and 17 optically conjugate with points 1 1 , 1 8 and 19, respectively. Points 1 1 , 18 and 19 are determined as the points of convergence of bundles of beams 12, 20 and 21 reflected by surface 3 of mirror 2 (in reciprocal direction) that emerge from pupil 13 of eye 7 and are directed towards points 10, 1 6 and 17, respectively. Points 1 1 , 18 and 19 are the preimages of points 10, 16 and 17, respectively. In this manner, all points {Pj} optically conjugated with specified points {P } of meridional cross-section 1 5 of image 9 observed by eye 7, are determined. Points {Pj} are preimages of the respective points {P'_j} . Diffusing surface 22 of screen 1 is the surface of revolution the axis of which coincides with the axis 5 of revolution of the reflecting surface 3 of mirror 2. Generatrix 23 of diffusing surface 22 of screen 1 is a curve, in this particular case, a circular arc with center in point 24, that approximates points {Pj } optically conjugated with specified points {P'j } of meridional cross-section 1 5 of image 9 observed by eye 7.

Fig. 3 shows a layout drawing (top view) of binocular device for representation of visual information: virtual or augmented reality, according to claim 4 of the formula of the invention. It features two monocular devices for representation 25 and 26 for the left and right eyes, respectively. The monocular device 25 for representation of visual information features screen 1 with diffusing surface 22 and mirror 2 with reflecting surface 3. The monocular device for representation 26 features screen 27 with diffusing surface 28 and mirror 29 with reflecting surface 30. Diffusing surfaces 22 and 28 of the screens and reflecting surfaces 3 and 30 of mirrors 2 and 29, are pairwise symmetrical in relation to planes of symmetry 3 1 of the observer's eyes 7 and 32. Plane 3 1 passes through the median point of the line segment linking centers of revolution 6 and 33 of the observer's left and right eyes, and is perpendicular to said line segment.

In the device for representation of visual information according to claim 4 of the formula of the invention, each of mirrors 2 and 29 can be made both transparent and non-transparent in the direction towards pupils 13 and 34 of a left-eyed and right-eyed observer. The device for representation of visual information the mirrors 2 and 29 of which are executed as non-transparent in the direction towards pupils 13 and 34, can be used as a binocular device for representation of virtual reality. The device for representation featuring even one of the mirrors 2 or 29 executed to be transparent in the direction towards the respective pupil can be used as a device for representation of augmented reality.

THE BEST MODE FOR CARRYING OUT THE INVENTION The proposed device for representation of visual information executed in the configuration shown in Fig. 1 as a monocular device that is a monocular device for representation of virtual reality intended for observation with the observer's left eye, functions in the following manner. At the diffusing surface 14 of screen 1 , a primary optical image is formed by whatever method. For instance, screen 1 can be a screen of direct (or reciprocal) projection, a non-flat liquid-crystal display. Beams from the primary. optical image at the diffusing surface 14 of screen 1 , reach the reflecting surface 3 of mirror 2, are reflected by it, and reach pupil 1 3 of the observer's eye 7. As a result, the observer sees a virtual image of the primary optical image, formed at the diffusing surface 14 of screen 1 , as reflected by mirror 2. In the process, collimation of image 9 observed by eye 7, is determined by the distance to the virtual image in mirror 2.

While image 9 observed by eye 7 within the field of vision 8 is determined by the aggregate of its points {P'i} , the optical conjunction, at least partial, of primary optical image points at the diffusing surface 14 of screen 1 with the image 9, determined by the observing eye 7, is assured owing to the fact that diffusing surface 14 of screen 1 is executed as the surface that approximates points {Pi} which are optically conjugated with specified points points {P'i } of image 9 observed by eye 7. Coordinates of any of the points { Pi } can be calculated, e.g., as coordinates of intersection point (in general case, convergence point) of two beams reflected by surface 3 of reflecting mirror 2, these beams emerging from the upper and lower edges of pupil 13 of the observer's eye 7 and directed to the respective point among the specified points {P'i } of image 9 observed by eye 7.

The number of specified points {/>',·} may vary depending on the required accuracy of collimation of image 9 observed by eye 7. For example, calculations of coordinates of 25 points {Pi} optically conjugated with 25 points {P'i} of image 9 observed by eye 7, at a spherical surface 100 meters in diameter, with center in the center of revolution 6 of eye 7, with the 0.072 meter diameter of the reflecting spherical surface 3 of mirror 2, the center of which is located 0.033 meter above the center of revolution 6 of eye 7, yield the following results: 0.04119 0.04104 0.04107 0.04128 0.04166

0.03323 0.03317 0.03318 0.03327 0.03344

X = 0.02600 0.02606 0.02605 0.02597 0.02586

0.01977 0.01994 0.01991 0.01967 0.01926

0.01456 0.01483 0.01477 0.01441 0.01377

0.01851 -0.00475 0.00945 0.02277 0.03385

0.01876 -0.00480 0.00956 0.02310 0.03454

0.01830 -0.00468 0.00932 0.02255 0.03383

0.01728 -0.00442 0.00880 0.02130 0.03201

0.01585 -0.00405 0.00807 0.01954 0.02936

0.04252 0.04625 0.04550 0.04032 0.03111

0.04299 0.04665 0.04591 0.04083 0.03171

0.04179 0.04527 0.04457 0.03972 0.03099

0.03925 0.04250 0.04184 0.03733 0.02918

0.03574 0.03870 0.03810 0.03398 0.02656

where X, Y, and Z are the coordinates of the right-hand rectangular system of coordinates, with axes X and Z located in the plane of symmetry of the observer's eyes, with horizontal position of axis Z in the direction of view, axis X directed up, and axis Y directed horizontally from left to right.

These 25 points {Pi} are approximated by a surface described by the following equations, with polynomial approximation applied: 0. 1 13 \ 4xy + 2.38557A- + 0.00001 y + 14.8 1 552 A/ + 2.7286 1 x² y - 32.57961

+ 9.47204 10⁵ A⁴ / + 2.93 140 I 0⁵ x/ + 1 71 .42086 x² / - 1.85476 lo /

- 24629.40054A³ / + 1.94261 10^{5 3} / - 1.66086 10⁶ A⁴ y - 1.14190 10⁷ A² /

- 10999.95695A² + 312.77651 A/ + 95.93761 x y + 2.17817 10⁸ x³ / - 68.98370 A² + 0.01576 + 997.10332A³ - 7021 .68003 A⁴ - 13.57205/ + 5.88838/

Since the diffusing surface 14 of screen 1 , described by an equation obtained with polynomial interpolation, passes precisely via points used in the interpolation, the virtual image in mirror 2, based on the principle of reciprocity of geometrical optics, will be perceived at the specified distance. In case of approximation by four points {Pi} optically conjugated with four specified points { P',} of image 9 observed by eye 7, the diffusing surface 1 4 of screen 1 may be spherical.

In the configuration of the visual information representation system shown in Fig. 2, the device for representation of visual information functions in a manner similar to that of the device for representation of visual information in the configuration shown in Fig. 1. The only difference is that in this case, the generatrix 23 of the diffusing surface 22 of screen 1 is a plane curve that approximates points {Pj } (including points 1 1 , 18 and 19) optically conjugated with the specified points {Pj } (including with points 10, 16 and 17) of the meridional cross-section 1 5 of image 9 observed by eye 7. At that, each of the points {Pj } of generatrix 23 of the diffusing surface 22, is determined as the convergence point of the bundle of beams (in reciprocal direction) reflected by reflecting surface 3 of mirror 2 that emerge from pupil 1 3 of eye 7 and are directed towards the respective point {P'j } of the meridional cross-section 15 of image 9 observed by eye 7. Thus, e.g., points 1 1 , 18 and 19 are optically conjugated with points 1 0, 1 6 and 17 of the meridional cross-section 15 of image 9 observed by eye. Diffusing surface 22 of screen 1 is executed as the surface of revolution of the generatrix 23 round the axis 5 of revolution of the reflecting surface 3 of mirror 2.

The device for representation of visual information according to claim 3 of the formula of this invention, functions in a manner similar to that of the device for representation of visual information in the configurations shown in Fig. 1 and 2, differing in that, additionally, beams from the surrounding space of objects within the field of vision 8 pass through mirror 2 which is made one-sidedly transparent in the direction towards pupil 1 3, and reach pupil 13 of the observer's eye 7. At that, the observer sees in mirror 2 not just the virtual image of the primary optical image at the diffusing surface 14 or 22 of screen 1 , but also the real image of surrounding objects within the field of vision 8. Thus, the device for representation of visual information according to claim 3 of the formula of this invention, is a monocular device for representation of augmented reality.

In the configuration of the visual information representation system shown in Fig. 3, the device for representation of visual information 26 added to the device for representation of visual information 25, functions in exactly the same manner as the device for representation of visual information 25, the only difference being that it generates image of virtual or augmented reality for the observer's another eye, the right eye 32.

The cause-and-effect relation between the aggregate of the substantial features of the proposed technical solution and the achieved technical result consists in the following. The cause of the dependence of the observed image geometry on the location of the observer's pupils of the eyes in the prototype is that shifting of the observer's pupil of the eye in relation to its nominal position causes a distortion of the observed image geometry (refer to Potapova G. K. and Moskalenko M. A., Correction of Geometrical Distortions of Images in Visualization Systems of Flight Simulators, Proceedings of the 7 International Conference Applied Optics - 2006, Vol. 3. Computer Technologies in Optics. S. -Petersburg, 2006, p.p. 127- 132).

Where the reflecting surface of the mirror and the surface of the screen are executed as surfaces of revolution with common axis that passes through the center of revolution of the eye, when the pupil moves, at least, in the plane of vision (when the pupil revolves around the common axis of the reflecting mirror and the screen surface), the configuration of the device for representation of visual information's optical system in relation to pupils does not change, and therefore, both the collimation and the geometry of the image observed by the eye, are preserved unchanged. That is why, owing to the reduction of the dependence of the observed image geometry on the position of the observer's pupil (pupils) of the eye (eyes), the observer can have more precise perception of his/her spatial position.

INDUSTRIAL APPLICABILITY

The invention may be used in devices for representation of visual information, mainly glasses virtual or augmented reality, or to on-helmet devices for repre^'sentation of visual information.

Claims

1 . A device for representation of visual information, containing a screen and a mirror the reflecting surface of which is a surface of revolution, distinguishing itself in that the axis of revolution of the reflecting surface of the mirror passes through the center of revolution of the eye, while the surface of the screen is a surface that approximates points that are optically conjugated with specified points of the image observed by the eye.

2. A device for representation of visual information according to claim 1 , distinguishing itself in that the surface of the screen is a surface of revolution the axis of which coincides with the axis of revolution of the reflecting surface of the mirror, and the generatrix thereof is a curve that approximates points which are optically conjugated with specified points of the meridional cross-section of the image observed by the eye.

3. A device for representation of visual information according to claim 1 , distinguishing itself in that the mirror is executed to be one-sidedly transparent in the direction towards the pupil of the eye.

4. A device for representation of visual information according to claim 1 , distinguishing itself in that a second identical device for representation of visual information is added to it, in such a manner that optical surfaces of elements of both devices are symmetrical to each other relative to the plane of symmetry of the observer's eyes.