CN100586403C - Visual sense prosthesis image processing device and method - Google Patents
Visual sense prosthesis image processing device and method Download PDFInfo
- Publication number
- CN100586403C CN100586403C CN200810034286A CN200810034286A CN100586403C CN 100586403 C CN100586403 C CN 100586403C CN 200810034286 A CN200810034286 A CN 200810034286A CN 200810034286 A CN200810034286 A CN 200810034286A CN 100586403 C CN100586403 C CN 100586403C
- Authority
- CN
- China
- Prior art keywords
- image
- information
- module
- circuit
- video signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Image Processing (AREA)
Abstract
The invention relates to a visual false body image processing device and the method, belonging to the field of biological engineering. In the invention, an image collecting module is a CMOS digital image sensor which converts the obtained image information into digital mode; a wireless transmission module is responsible for the communication of the image collecting module and the image processingmodule, then transmits the image information collected by the image collecting module to the image processing module; the image processing module has an image information precorrection to the obtainedimage to improve the image quality, having image information simplifying, strengthening or coding treatment to transform the obtained image information into the pulse encouraging mode accepted by thevisual system to provide for an internal stimulation module, and providing the function of self regulation for users. The method is showed as follows: firstly executing image pretreatment, then through an image complexity judgment, the image is divided into three kinds and the corresponding treatment procedure is adopted. The invention resolves the prior disadvantage to be applied in all types ofvisual false body.
Description
Technical field
The present invention relates to the device and method in a kind of biomedical engineering technology field, be specifically related to a kind of visual sense prosthesis image processing device and method.
Background technology
The scientific and technical personnel of a lot of countries adopt the method for vision prosthesis to repair blind person's visual performance in research at present.Vision prosthesis is a kind of artificial organ that utilizes the electricity irritation visual system to recover blind person's vision, mainly comprises following process: the optical signal of the external image information obtained is converted to the signal of telecommunication; The image information of obtaining is carried out Flame Image Process, and be converted to corresponding stimulus modelity; Energy and signal are transferred to stimulator and the microelectrode array thereof that implants, and microelectrode array stimulates the neurocyte on the pathways for vision to produce phosphene.No matter be that retina stimulates vision prosthesis, visual cortex to stimulate vision prosthesis, or optic nerve stimulation vision prosthesis, all need to comprise visual pattern processing system.Vision prosthesis is made up of two parts in external and the body: outer body is mainly finished image information acquisition, be converted to visual system acceptable stimulus modelity through a series of Flame Image Process and picture coding then, by wired or radio frequency transmission the image information of handling well be sent to body internal stimulus device then; Part is main in the body is responsible for the reception of stimulus signal and produces little current drives stimulating electrode array.
The pick off of pickup image and image processor have constituted the front end image processing system of vision prosthesis, and their effect is that the image information that will import is converted to the pulse information that can carry out electricity irritation.Image information need be passed through processing such as image simplification, figure image intensifying, edge extracting, picture coding, is converted to the stimulus modelity that visual system can be accepted, and then delivers to the stimulating electrode array and inspire visual hallucination, and the part vision can be repaired.Therefore, the vision prosthesis image processing system is an indispensable ingredient in artificial vision's prosthese.
Find through literature search prior art, U.S.'s patent of invention publication number is US20020095193A1, open day is on July 18th, 2002, this patent readme is " contain and strengthen the vision prosthesis that receives with the electrode stimulating part ", it gathers external image information by a ccd image sensor earlier, then the original image that collects is carried out the image transmitted information that is easy to that pixel is simplified, picture coding obtains simplifying, import intravital stimulating electrode array into by wireless radio-frequency then and produce electricity irritation.Its deficiency is: (1) adopts ccd sensor as image collecting device, ccd sensor is difficult to integrated drive circuit, signal processing circuit and imaging array monolithic, system is made up of the multicore sheet, its volume is big than cmos sensor, disguised relatively poor, be applied in be unfavorable in the vision prosthesis attractive in appearance and convenient; (2) ccd sensor is the passive type collection, must move to transmission channel by the electric charge in each pixel by applied voltage, and this applied voltage needs 12-18V usually, therefore CCD also must have more accurate power circuit design and compressive resistance, and high driving voltage makes the power consumption of CCD far above cmos sensor; (3) lack the image pre-correction functionality in this patent, picture quality is unfavorable for the processing of rear end; (4) do not consider vision prosthesis implantation person's self-regulating function; (5) there is not the Flame Image Process strategy of system perfecting.
Summary of the invention
The present invention is directed to the deficiencies in the prior art, a kind of visual sense prosthesis image processing device and method are provided, make it solve above-mentioned deficiency, be applied to all types (retina stimulating type, visual cortex stimulating type, optic nerve stimulation type) vision prosthesis.
The present invention is achieved by the following technical solutions:
Visual sense prosthesis image processing device involved in the present invention comprises image capture module, wireless transport module and image processing module.These three modules connect successively, wherein:
Described image capture module is a cmos digital imageing sensor, and it converts the image information of obtaining to figure pattern;
Described wireless transport module is responsible for the communication of image capture module and image processing module, and it is transferred to image processing module with the image information that image capture module collects;
Described image processing module carries out image information precorrection to the image that obtains, improve picture quality, adopting the video signal process chip to carry out image information then simplifies, strengthen, coding is handled, make the image information of obtaining be converted into the receptible pulse excitation pattern of visual system so that donor internal stimulus module to be provided, and control the transmission of image information in the image processing module by senior reduced instruction set computer microprocessor, for the function that the user provides self regulation, make the user regulate the brightness of image voluntarily by the manual adjustments circuit, contrast and picture coding code check.Image processing module improves prior art, has adopted the video signal process chip to carry out the processing of image information, and its operational capability is enough finished a series of visual pattern Processing Algorithm, and can vacate the control that a part of resource is finished other function.
Described image processing module comprises video signal process chip (DSP), senior reduced instruction set computer microprocessor (ARM), synchronous dynamic random access memory (SDRAM), flash memory (FLASH), specific information memorizer, correction processing circuit, manual adjustments circuit, electric power controller.The video signal process chip is to the processing of simplifying, strengthen, encode of the image information in the synchronous dynamic random access memory, image information after information simplification, image enhancement processing leaves in the dynamic synchronization memorizer, and the image coding information after the encoded processing leaves in the specific information memorizer; Senior reduced instruction set computer microprocessor and digital signal processing chip interconnect and communication, and be connected with synchronous dynamic random access memory, image correction process circuit, manual adjustments circuit, data transmission interface, data receiving interface, be responsible for the transmission of control information and regulation and control image correction process circuit, manual adjustments circuit; Correction processing circuit carries out image rectification to the original image information of depositing in the synchronous dynamic random access memory, thereby improves picture quality; The manual adjustments circuit is connected with senior reduced instruction set computer microprocessor, and brightness, contrast and the picture coding code check of image are regulated.Electric power controller provides corresponding work voltage for video signal process chip, senior reduced instruction set computer microprocessor, image correction process circuit, manual adjustments circuit.
Described video signal process chip reads the information that feeds back from the internal electrode stimulating module in the specific information memorizer, and adjusts; Read the image correction information that the process correction processing circuit in the specific information memorizer is handled well, adjust the control parameter of front end image capture module; Accept the conditioning signal of manual adjustments circuit and handle; Interconnect and communication senior reduced instruction set computer microprocessor control image information input and output video signal process chip with senior reduced instruction set computer microprocessor.
Described senior reduced instruction set computer microprocessor, interconnect and communication with digital signal processing chip, and and synchronous dynamic random access memory, the image correction process circuit, the manual adjustments circuit, the data transmission interface, the data receiving interface connects, thereby senior reduced instruction set computer microprocessor is responsible for the image coding information of control store in the specific information memorizer and is passed to intravital electrode stimulating module by the radio frequency transmission module that the data transmission interface is transferred to the back, and the information that feeds back of control rear end electrode stimulating device module is stored in the specific information memorizer by data receiving interface input picture processing module and reads for digital signal processing chip, and plays the control correction processing circuit, thereby the effect that response manual adjustments circuit is regulated and control.
Described synchronous dynamic random access memory, be connected with video signal process chip, senior reduced instruction set computer microprocessor, correction processing circuit, be used for image information that the memory image acquisition module obtains and through the image information after video signal process chip image simplification, the image enhancement processing.
Described flash memory is connected with the video signal process chip, and storage is used for the program of artificial vision's prosthese Flame Image Process strategy and the video signal process chip control sequence to imageing sensor, manual adjustments circuit, correction processing circuit.
Described specific information memorizer is stored different information according to the difference of address, is respectively the revised image information of calibrated treatment circuit, the image coding information after the video signal process chip is handled, the feedback information of body internal stimulus electrode.
Described correction processing circuit, connect the specific information memorizer, senior reduced instruction set computer microprocessor, synchronous dynamic random access memory, play the effect that improves picture quality, it carries out image rectification to the original image information of depositing in the synchronous dynamic random access memory, image information parameter after the correction stores in the specific information memorizer and reads for digital signal processing chip, the original image information input correction processing circuit of depositing in the senior reduced instruction set computer microprocessor invoke synchronous dynamic memory, correction processing circuit carries out image rectification to it, revised image parameter input specific information memorizer, the video signal process chip after with the correction of depositing in the specific information memorizer image parameter information and synchronous dynamic random access memory in the original image information deposited compare, if there are differences, video signal process chip and imageing sensor communication, adjust the acquisition parameter of image capture module, and control figure image-position sensor images acquired information again.
Described manual adjustments circuit receives the instruction of user's manual adjustments, manual adjustments comprises the adjusting to brightness of image, contrast and picture coding code check, the manual adjustments circuit is connected with senior reduced instruction set computer microprocessor, peripheral hardware button input adjusting information enters the manual adjustments circuit, after the manual adjustments processing of circuit conditioning signal is flowed to senior reduced instruction set computer microprocessor, senior reduced instruction set computer microprocessor is communicated by letter with the video signal process chip video signal process chip is regulated image according to conditioning signal.
Vision prosthesis image processing method involved in the present invention is specially: earlier the image that obtains is removed noise through the image preprocessing process, and enhancing contrast ratio, thus improve picture quality.Through after the image pretreatment, carry out image complexity and judge, according to the complexity of image image is divided three classes: simple image, medium complicated image, complicated image.
For simple image, directly image is carried out earlier pixel and simplify, simplify desired pixel count, then with image binaryzation, carry out the image information extraction at last and obtain a result.
For medium complicated image, carry out the pixel simplification first time earlier, secondly with image binaryzation, and carry out image information and extract, carry out image repair then, carry out the pixel simplification second time at last, reach the requirement pixel count, obtain result.
For complicated image, use the location and the local refinement of target in the image, numeral is carried out in some zone of giving position fixing arbitrarily amplify, under the situation of given pixel, improve identification to the image local characteristic.
The present invention is with respect to the advantage of existing scheme: 1, according to the complexity of image the image that obtains is classified, and use different Flame Image Process strategies and carry out Flame Image Process.2, selected suitable chip, device for use, Preliminary Exploitation be suitable for the image processing system hardware of all types artificial vision prosthese, for the industrialization of vision prosthesis provides prerequisite.3, adopted the cmos digital imageing sensor as image collecting device, it is easy to be connected communication with other devices such as DSP, and low in energy consumption, and size is little.4, selected the master chip of special-purpose video signal process chip as the visual pattern processing module for use, it provides the abundant video processing interface that multimedia is handled that is used for, and operational capability is enough finished a series of visual pattern Processing Algorithm.5, the imageing sensor of image capture module is connected communication by wireless transport module with DSP in the image processing module, has reduced the connecting line in the system.6, use ARM in the image processing module, ARM controls correction processing circuit, manual adjustments circuit and realizes the input/output function of image information.7, by correction processing circuit the image information of input picture processing module is proofreaied and correct, remove noise, strengthen the contrast of image, improve the picture quality of the original image that obtains.8, increase the manual adjustments circuit, the user can mediate to brightness, the contrast of image, and code check is mediated.
System of the present invention realizes that simply complete function can be used for the research and development of vision prosthesis Flame Image Process, for the industrialization of artificial vision prosthesis is laid a good foundation.
Description of drawings
Fig. 1 is the connection layout of apparatus of the present invention and vitro system
Fig. 2 is the structured flowchart of image processing apparatus of the present invention
Fig. 3 is the inventive method flow chart
The specific embodiment
Below in conjunction with accompanying drawing embodiments of the invention are elaborated: present embodiment is being to implement under the prerequisite with the technical solution of the present invention, provided detailed embodiment and concrete operating process, but protection scope of the present invention is not limited to following embodiment.
As shown in Figure 1, at first obtain external image information by image capture module, image information after obtaining is by wireless transport module input picture processing module, in image processing module by DSP carry out image information simplification, cut apart, processing such as enhancing, coding, the image information output image processing module after the processing also is sent to the internal electrode stimulating module by the radio frequency transmission module.
As shown in Figure 2, the image capture module among the present invention is a cmos digital imageing sensor, and the sharpest edges of cmos image sensor are and the affinity of other devices such as DSP, more easily make system-on-a-chip, and power consumption are lower.
Described cmos image sensor (can adopt 0V6650 or the performance parameter imageing sensor similar with it) size is little, is suitable for portable application, adopts advanced algorithm to eliminate fixed pattern noise, reduces holder tail effect.Cmos image sensor is communicated by letter with DSP in the image processing module by wireless transport module, the image information that collects is by wireless module input picture processing module, form with regulation is stored among the SDRAM, is carried out processing such as image information simplification, enhancing, coding then by DSP.
As shown in Figure 2, the wireless transport module among the present invention is responsible for the communication of image capture module and image processing module, and the image information that image capture module is collected is transferred to image processing module.Wireless transport module adopts sophisticated blue tooth wireless technology.
As shown in Figure 2, the image processing module among the present invention comprises digital signal processing chip (DSP), senior reduced instruction set computer microprocessor (ARM), synchronous dynamic random access memory (SDRAM), flash memory (FLASH), specific information memorizer, correction processing circuit, manual adjustments circuit, data transmission interface, data receiving interface, electric power controller.
DSP receives primary image information that acquisition module collects and it is left among the SDRAM, ARM control correction processing circuit is proofreaied and correct the raw information of depositing among the SDRAM, revise the parameter of required image information, these parameters are stored in the control information part of specific information memorizer, front end image capture module control parameter is adjusted in DSP control, gathers suitable image information again and is stored among the SDRAM; DSP reads the data image signal that leaves among the SDRAM and carries out processing such as image simplification, enhancing, coding, to leave in through the image information after image simplification, the enhancement process among the SDRAM, the image coding information after will handling through image compression encoding leaves in the specific information memorizer; Image coding information in the ARM control specific information memorizer is input to the radio frequency transmission module and is stored in the specific information memorizer from the information that the electrode stimulating module feeds back to, and is entered among the DSP; The manual adjustments circuit is connected with ARM, and it receives the instruction of user's manual adjustments, and conditioning signal is flowed to ARM, and ARM communicates by letter with DSP DSP is regulated image according to conditioning signal.
Described digital signal processing chip (DSP) is the master chip of image processing module in the vision prosthesis, adopt the dedicated video digital signal processing chip TMS320DM642 of TI company, TMS320DM642 provides the abundant video processing interface that multimedia is handled that is used for, dominant frequency reaches 600MHz, its operational capability is enough finished a series of visual pattern Processing Algorithm, and can vacate the control that a part of resource is finished other function.The cmos image sensor communication of DSP and front end is connected with ARM, FLASH, SDRAM, specific information memorizer in the image processing module.The cmos image sensor of front end image capture module, leaves among the SDRAM the data image signal input picture processing module of obtaining by wireless transport module; DSP reads the data image signal that leaves among the SDRAM and carries out processing such as image simplification, enhancing, coding, to leave in through the image information after image simplification, the enhancement process among the SDRAM, the image coding information after will handling through image compression encoding leaves the encoding information storage area of specific information memorizer in; DSP reads the information that feeds back from the internal electrode stimulating module in the specific information memorizer, and adjusts accordingly; DSP reads the image correction information that the process correction processing circuit in the specific information memorizer is handled well, adjusts the control parameter of front end image capture module; DSP accepts the conditioning signal of manual adjustments circuit and handles accordingly; DSP and ARM interconnect and communication, ARM control image information input and output DSP.The DSP of image processing module need 3.3V and+running voltage of 1.4V, provide by the supply unit in the image processing module.
Described senior reduced instruction set computer microprocessor (ARM) adopts the LPC2214FBD144 chip of PHILIPS company, and work dominant frequency is the highest can reach 60MHz for it, has PLL in the sheet, can realize self-defining frequency multiplication/frequency division ability.ARM mainly has the input and output communication function of control image information, thereby and plays the effect that control correction processing circuit, response manual adjustments circuit are regulated and control.ARM and DSP interconnect and communication, and are connected with SDRAM, image correction process circuit, manual adjustments circuit, data transmission interface, data receiving interface.ARM control correction processing circuit is proofreaied and correct the raw information of depositing among the SDRAM, revise the parameter of required image information, these parameters are stored in the control information part of specific information memorizer, adjust front end image capture module control parameter in order to DSP control; ARM makes DSP make corresponding processing the regulating command input DSP that the manual adjustments circuit sends; The image coding information of depositing in the ARM control specific information memorizer of handling well through DSP is input to the radio frequency transmission module by the data transmission interface; The information that feeds back to from the electrode stimulating module that ARM control receives by the data receiving interface is stored in the electrode message part of specific information memorizer, and is entered among the DSP.The running voltage of ARM needs+1.8V is provided by the supply unit in the image processing module.
Described synchronous dynamic random access memory (SDRAM) is connected with DSP, ARM, correction processing circuit, is mainly used to image information that the memory image acquisition module obtains and through the image information after DSP image simplification, the image enhancement processing.Sdram size is 20Mb, according to 1 second storage 24 width of cloth image, and every width of cloth image 100,000 pixels, 1 pixel, 8 bits calculate, and the capacity of SDRAM is enough to satisfy the image memory requirement of artificial vision's prosthese.
Described flash memory (FLASH) is connected with DSP, and main storage is used for the program of artificial vision's prosthese Flame Image Process strategy and the DSP control sequence to parts such as imageing sensor, manual adjustments circuit, correction processing circuits.
Described specific information memorizer is respectively the revised image information of calibrated treatment circuit, the image coding information after DSP handles, feedback information and other information of body internal stimulus electrode according to the different information of difference storage of address.
Described correction processing circuit carries out image rectification (removing noise, enhancing contrast ratio) to the original image information of depositing among the SDRAM, plays the effect that improves picture quality.Correction processing circuit connects specific information memorizer, ARM, SDRAM.ARM calls the original image information input correction processing circuit of depositing among the SDRAM, correction processing circuit carries out image rectification to it, revised image parameter input specific information memorizer, DSP after with the correction of depositing in the specific information memorizer image parameter information and SDRAM in the original image information deposited compare, if there are differences, the acquisition parameter of image capture module is adjusted in DSP and imageing sensor communication, and control figure image-position sensor images acquired information again.
Described manual adjustments circuit receives the instruction of user's manual adjustments, manual adjustments comprises the adjusting to brightness of image, contrast and picture coding code check, the manual adjustments circuit is connected with ARM, peripheral hardware button input adjusting information enters the manual adjustments circuit, after the manual adjustments processing of circuit conditioning signal is flowed to ARM, ARM communicates by letter with DSP DSP is regulated image according to conditioning signal.
Described data transmission interface and data receiving interface are as the passage of image information transmission, and the image coding information that DSP handles well sends to the radio frequency transmission module by the data transmission interface from image processing module; Pass through the specific information memorizer that the data transmission interface receives the input picture processing module from the information that the electrode stimulating module feeds back to.
The described electric power controller that voltage is provided provides+voltage of 1.4V for DSP, for I/O provides+voltage of 3.3V, for ARM provides+voltage of 1.8V.
As shown in Figure 3, the Flame Image Process flow process is as follows: the image information of obtaining extraneous scene earlier by an image acquisition device, resulting original image is carried out the image pretreatment, the image pretreatment is that the original image that obtains is carried out primary processing, main purpose is the picture quality of improving under the extreme case, the effect that guarantee information is extracted.The image preprocessing process is removed noise, is used the method for histogram equalization to strengthen picture contrast with the method for medium filtering, and realizes the illuminance adjustment by the depositor of optimizing hardware.Through after the image pretreatment, carry out image complexity and judge, according to the complexity of image image is divided three classes: simple image, medium complicated image, complicated image.The standard of image complexity classification is: the definition simple image is the single object in the single background, such as common the articles for daily use, adopts MIG complexity algorithm computation to get the complexity value of simple image less than 0.4; Define the profile that medium complicated image is behaved, the scene of simply living and the combination that is less than 3 simple objects, adopt complexity value that MIG complexity algorithm computation gets medium complicated image greater than 0.4 less than 0.6; The definition complicated image be a complicated life scene and more than the combination of 3 objects, and employing MIG complexity algorithm computation gets the complexity value of complicated image greater than 0.6.
The different image of three classes is taked different Flame Image Process strategies.
For simple image, directly image is carried out earlier pixel and simplify, be simplified to desired pixel count, then with image binaryzation, carry out the image information extraction at last and obtain a result.For medium complicated image, carry out the pixel simplification first time earlier, secondly with image binaryzation, and carry out image information and extract, carry out image repair then, carry out the pixel simplification second time at last, reach the requirement pixel count, obtain result.For complicated image, use the location and this thought of local refinement of target in the image, numeral is carried out in some zone of giving position fixing arbitrarily amplify, help under the situation of given pixel, improving identification to the image local characteristic.The present invention has at length proposed the different disposal flow process to simple image and medium complicated image.
Described at simple image, its processing method is specifically: will judge that sorted simple image carries out pixel and simplify through image complexity earlier, directly pixel is simplified to desired pixel level, the image that to simplify produces bianry image by the method for maximum kind spacing thresholding then, thereby reduce the computation complexity of successive image Processing Algorithm, again image is carried out information retrieval, adopt during information retrieval the four directions to the edge extracting algorithm, obtain result at last, the computation complexity of this Flame Image Process strategy is very low.Pixel is simplified the consideration that this process is based on the speed of limited stimulating electrode number of artificial vision's prosthese and radio frequency transmission, and image must obtain maximum simplification before finally being sent to electrode, and it is one of them necessary process that pixel is simplified.
Described at medium complicated image, its processing method is specifically: the medium complicated image after will judging through image complexity earlier carry out initial pixel and simplify, the image that initial pixel was simplified produces bianry image by the method for maximum kind spacing thresholding then, and carry out information retrieval, adopt during information retrieval the four directions to the edge extracting algorithm; Again the image behind the information retrieval is carried out image mending, this process mainly is that utilization is expanded, etch state is learned image processing method for establishing than complex image; Image after at last morphology being handled carries out once more pixel and simplifies, and makes the pixel of image be simplified to desired pixel level, obtains final result.
Described at complicated image, its processing method is specifically: earlier the zone of being paid close attention in the image is positioned as target, then localized image is carried out image thinning, main method of amplifying by numeral, thereby convert complicated image to medium complicated image, take again to carry out Flame Image Process, obtain final result at medium complicated image Flame Image Process strategy.
System of the present invention realizes simple, and complete function can be used for the research and development of vision prosthesis Flame Image Process, for the industrialization of artificial vision prosthesis is laid a good foundation.
Claims (10)
1, a kind of visual sense prosthesis image processing device comprises image capture module, wireless transport module and image processing module, and these three modules connect successively, it is characterized in that:
Described image capture module is a cmos digital imageing sensor, and this cmos digital imageing sensor converts the image information of obtaining to figure pattern;
Described wireless transport module is responsible for the communication of image capture module and image processing module, and this wireless transport module is transferred to image processing module with the image information that image capture module collects;
Described image processing module carries out image information precorrection to the image that obtains, improve picture quality, adopting the video signal process chip to carry out image information then simplifies, strengthen, coding is handled, make the image information of obtaining be converted into the receptible pulse excitation pattern of visual system so that donor internal stimulus module to be provided, and control the transmission of image information in the image processing module by senior reduced instruction set computer microprocessor, for the function that the user provides self regulation, make the user regulate the brightness of image voluntarily by the manual adjustments circuit, contrast and picture coding code check.
2, visual sense prosthesis image processing device according to claim 1, it is characterized in that, described image processing module comprises the video signal process chip, senior reduced instruction set computer microprocessor, synchronous dynamic random access memory, flash memory, the specific information memorizer, correction processing circuit, the manual adjustments circuit, electric power controller, wherein: the video signal process chip is simplified the image information in the synchronous dynamic random access memory, strengthen, coding is handled, simplify through information, image information after the image enhancement processing leaves in the synchronous dynamic random access memory, and the image coding information after the encoded processing leaves in the specific information memorizer; Senior reduced instruction set computer microprocessor and video signal process chip interconnect and communication, and be connected with synchronous dynamic random access memory, correction processing circuit, manual adjustments circuit, data transmission interface, data receiving interface, be responsible for the transmission of control information and regulation and control correction processing circuit, manual adjustments circuit; Correction processing circuit carries out image rectification to the original image information of depositing in the synchronous dynamic random access memory, improves picture quality; The manual adjustments circuit is connected with senior reduced instruction set computer microprocessor, and brightness, contrast and the picture coding code check of image are regulated; Electric power controller provides running voltage for video signal process chip, senior reduced instruction set computer microprocessor, correction processing circuit, manual adjustments circuit.
3, visual sense prosthesis image processing device according to claim 2 is characterized in that, described video signal process chip reads the information that feeds back from the internal electrode stimulating module in the specific information memorizer, and adjusts; Read the image correction information that the process correction processing circuit in the specific information memorizer is handled well, adjust the control parameter of front end image capture module; Accept the conditioning signal of manual adjustments circuit and handle; Interconnect and communication senior reduced instruction set computer microprocessor control image information input and output video signal process chip with senior reduced instruction set computer microprocessor.
4, according to claim 2 or 3 described visual sense prosthesis image processing devices, it is characterized in that, described senior reduced instruction set computer microprocessor, interconnect and communication with digital signal processing chip, and and synchronous dynamic random access memory, correction processing circuit, the manual adjustments circuit, the data transmission interface, the data receiving interface connects, thereby senior reduced instruction set computer microprocessor is responsible for the image coding information of control store in the specific information memorizer and is passed to intravital electrode stimulating module by the radio frequency transmission module that the data transmission interface is transferred to the back, and the information that feeds back of control rear end electrode stimulating device module is stored in the specific information memorizer by data receiving interface input picture processing module and reads for the video signal process chip, and plays the control correction processing circuit, thereby the effect that response manual adjustments circuit is regulated and control.
5, visual sense prosthesis image processing device according to claim 2, it is characterized in that, described synchronous dynamic random access memory, be connected with video signal process chip, senior reduced instruction set computer microprocessor, correction processing circuit, be used for image information that the memory image acquisition module obtains and through the image information after video signal process chip image simplification, the image enhancement processing;
Described flash memory, be connected with the video signal process chip, storage is used for the program of artificial vision's prosthese Flame Image Process strategy and the video signal process chip control sequence to cmos digital imageing sensor, manual adjustments circuit, correction processing circuit;
Described specific information memorizer is stored different information according to the difference of address, is respectively the revised image information of calibrated treatment circuit, the image coding information after the video signal process chip is handled, the feedback information of body internal stimulus electrode.
6, visual sense prosthesis image processing device according to claim 2, it is characterized in that, described correction processing circuit, connect the specific information memorizer, senior reduced instruction set computer microprocessor, synchronous dynamic random access memory, play the effect that improves picture quality, it carries out image rectification to the original image information of depositing in the synchronous dynamic random access memory, image information parameter after the correction stores in the specific information memorizer and reads for the video signal process chip, the original image information input correction processing circuit of depositing in the senior reduced instruction set computer microprocessor invoke synchronous dynamic memory, correction processing circuit carries out image rectification to it, revised image parameter input specific information memorizer, the video signal process chip after with the correction of depositing in the specific information memorizer image parameter information and synchronous dynamic random access memory in the original image information deposited compare, if there are differences, video signal process chip and imageing sensor communication, adjust the acquisition parameter of image capture module, and control figure image-position sensor images acquired information again;
Described manual adjustments circuit receives the instruction of user's manual adjustments, manual adjustments comprises the adjusting to brightness of image, contrast and picture coding code check, the manual adjustments circuit is connected with senior reduced instruction set computer microprocessor, peripheral hardware button input adjusting information enters the manual adjustments circuit, after the manual adjustments processing of circuit conditioning signal is flowed to senior reduced instruction set computer microprocessor, senior reduced instruction set computer microprocessor is communicated by letter with the video signal process chip video signal process chip is regulated image according to conditioning signal.
7, a kind of vision prosthesis image processing method, it is characterized in that, earlier the image that obtains is removed noise through the image preprocessing process, enhancing contrast ratio, thereby improve picture quality, through after the image pretreatment, carry out image complexity and judge, according to the complexity of image image is divided three classes: simple image, medium complicated image, complicated image:
For simple image, directly image is carried out earlier pixel and simplify, simplify desired pixel count, then with image binaryzation, carry out the image information extraction at last and obtain a result;
For medium complicated image, carry out the pixel simplification first time earlier, secondly with image binaryzation, and carry out image information and extract, carry out image repair then, carry out the pixel simplification second time at last, reach the requirement pixel count, obtain result;
For complicated image, use the location and the local refinement of target in the image, numeral is carried out in some zone of giving position fixing arbitrarily amplify, under the situation of given pixel, improve identification to the image local characteristic.
8, vision prosthesis image processing method according to claim 7, it is characterized in that, described at simple image, its processing method is specifically: will judge that sorted simple image carries out pixel and simplify through image complexity earlier, directly pixel is simplified to desired pixel level, the image that to simplify produces bianry image by the method for maximum kind spacing thresholding then, thereby reduce the computation complexity of successive image Processing Algorithm, again image is carried out information retrieval, adopt during information retrieval the four directions to the edge extracting algorithm, obtain result at last, the computation complexity of this Flame Image Process strategy is very low, pixel is simplified the consideration that this process is based on the speed of limited stimulating electrode number of artificial vision's prosthese and radio frequency transmission, image is before finally being sent to electrode, must obtain maximum simplification, it is one of them necessary process that pixel is simplified.
9, vision prosthesis image processing method according to claim 7, it is characterized in that, described at medium complicated image, its processing method is specifically: the medium complicated image after will judging through image complexity earlier carry out initial pixel and simplify, the image that initial pixel was simplified produces bianry image by the method for maximum kind spacing thresholding then, and carry out information retrieval, adopt during information retrieval the four directions to the edge extracting algorithm; Again the image behind the information retrieval is carried out image mending, this process is that utilization is expanded, etch state is learned image processing method for establishing than complex image; Image after at last morphology being handled carries out once more pixel and simplifies, and makes the pixel of image be simplified to desired pixel level, obtains final result.
10, vision prosthesis image processing method according to claim 7, it is characterized in that, described at complicated image, its processing method is specifically: earlier the zone of being paid close attention in the image is positioned as target, then localized image is carried out image thinning,, thereby convert complicated image to medium complicated image by the method for numeral amplification, take again to carry out Flame Image Process, obtain final result at medium complicated image Flame Image Process strategy.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810034286A CN100586403C (en) | 2008-03-06 | 2008-03-06 | Visual sense prosthesis image processing device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810034286A CN100586403C (en) | 2008-03-06 | 2008-03-06 | Visual sense prosthesis image processing device and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101239008A CN101239008A (en) | 2008-08-13 |
| CN100586403C true CN100586403C (en) | 2010-02-03 |
Family
ID=39931030
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810034286A Expired - Fee Related CN100586403C (en) | 2008-03-06 | 2008-03-06 | Visual sense prosthesis image processing device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100586403C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI451863B (en) * | 2010-11-06 | 2014-09-11 | Nat Univ Tsing Hua | Retina stimulation apparatus and a manufacturing method thereof |
Families Citing this family (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102858402B (en) | 2010-02-26 | 2016-03-30 | 康奈尔大学 | Retina prosthese |
| CN101879348A (en) * | 2010-06-18 | 2010-11-10 | 中国人民解放军第三军医大学第一附属医院 | Visual function restoration system based on external electrical stimulation by endocranium |
| EP2611401A4 (en) | 2010-08-31 | 2014-03-19 | Univ Cornell | Retina prosthesis |
| US9302103B1 (en) | 2010-09-10 | 2016-04-05 | Cornell University | Neurological prosthesis |
| WO2013029008A1 (en) | 2011-08-25 | 2013-02-28 | Cornell University | Retinal encoder for machine vision |
| CN102813999B (en) * | 2012-08-10 | 2015-06-17 | 上海交通大学 | Visual prosthesis wireless transmission system with self-adaptive power regulation function and visual prosthesis wireless transmission method |
| JP7016522B2 (en) | 2015-04-20 | 2022-02-07 | コーネル ユニヴァーシティー | Machine vision with dimensional data reduction |
| CN104825248B (en) * | 2015-05-25 | 2016-09-28 | 浙江诺尔康神经电子科技股份有限公司 | A kind of retinal prosthesis system |
| CN106137532B (en) * | 2016-09-19 | 2019-01-25 | 清华大学 | A kind of image processing method |
| CN106385536A (en) * | 2016-09-19 | 2017-02-08 | 清华大学 | Binocular image collection method and system for visual prosthesis |
| CN107749053A (en) * | 2017-10-24 | 2018-03-02 | 郑州布恩科技有限公司 | A kind of binocular image collection and pretreatment unit and method for vision prosthesis |
| CN112972889B (en) * | 2017-12-29 | 2024-06-25 | 深圳硅基仿生科技股份有限公司 | Image processing device and method, and retina stimulator |
| CN109146985B (en) * | 2018-09-09 | 2019-06-14 | 深圳硅基仿生科技有限公司 | Image processing method, device and the retina stimulator of retina stimulator |
| CN109660808B (en) * | 2018-12-21 | 2020-05-05 | 信通达智能科技有限公司 | Video encoder based on big data storage and corresponding terminal |
| CN110200748A (en) * | 2019-06-03 | 2019-09-06 | 上海海洋大学 | Functional assessment simulator and its operating method under a kind of prosthetic vision |
| CN110584835A (en) * | 2019-09-20 | 2019-12-20 | 京东方科技集团股份有限公司 | Artificial eye display device and control method thereof |
| CN110969995B (en) * | 2019-12-13 | 2021-03-19 | 湖南国科微电子股份有限公司 | Display method and device, electronic equipment and readable storage medium |
| CN111445527B (en) * | 2019-12-31 | 2021-09-07 | 深圳硅基仿生科技有限公司 | Method for detecting bar-grid vision of retina stimulator |
-
2008
- 2008-03-06 CN CN200810034286A patent/CN100586403C/en not_active Expired - Fee Related
Non-Patent Citations (2)
| Title |
|---|
| 视觉假体的发展与研究. 李莹辉，吴开杰，柴新禹，任秋实.中国医学物理学杂志，第24卷第5期. 2007 |
| 视觉假体的发展与研究. 李莹辉，吴开杰，柴新禹，任秋实.中国医学物理学杂志，第24卷第5期. 2007 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI451863B (en) * | 2010-11-06 | 2014-09-11 | Nat Univ Tsing Hua | Retina stimulation apparatus and a manufacturing method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101239008A (en) | 2008-08-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100586403C (en) | Visual sense prosthesis image processing device and method | |
| CN106137532B (en) | A kind of image processing method | |
| CN104825248B (en) | A kind of retinal prosthesis system | |
| CN102663376A (en) | Near-infrared multi-intensity finger vein image acquisition and integration system, and method | |
| CN106333769A (en) | Artificial retinal system, extraocular optical device, and intraocular implant chip | |
| CN104398325A (en) | Brain-myoelectricity artificial limb control device and method based on scene steady-state visual evoking | |
| US20110202132A1 (en) | Visual prosthesis implant | |
| CN103150565A (en) | Portable two-eye iris image acquisition and processing equipment | |
| CN105005390A (en) | Terminal adjusting method, terminal adjusting device, and terminal | |
| CN108600649A (en) | A kind of Intelligent House Light brightness acquisition and control method | |
| CN112972889B (en) | Image processing device and method, and retina stimulator | |
| CN110139449A (en) | A kind of full room lighting system of intelligence based on human body attitude identification | |
| CN103491312A (en) | Automatic exposure control method and automatic exposure control device used for iris recognition | |
| CN1849993B (en) | Artificial vision emulation and experiment system | |
| CN109146985B (en) | Image processing method, device and the retina stimulator of retina stimulator | |
| CN106385536A (en) | Binocular image collection method and system for visual prosthesis | |
| CN117653907A (en) | Electrical stimulation defibrillation method and device based on eye movement tracking | |
| CN106267551B (en) | The wearable facial paralysis of intelligence synchronizes Motor stimulation equipment | |
| CN108391356A (en) | A kind of Intelligent House Light control system | |
| CN204734580U (en) | Artificial retina system | |
| CN101879348A (en) | Visual function restoration system based on external electrical stimulation by endocranium | |
| CN207022096U (en) | A kind of image collecting device | |
| CN107302819A (en) | A kind of meeting room light intelligent adjusting method | |
| CN201462479U (en) | Controllable human body venous image gathering infrared lighting device | |
| CN1752990A (en) | Portable iris image acquiring device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20100203 Termination date: 20180306 |