CN106647765B - Planning platform based on mowing robot - Google Patents
Planning platform based on mowing robot Download PDFInfo
- Publication number
- CN106647765B CN106647765B CN201710025383.1A CN201710025383A CN106647765B CN 106647765 B CN106647765 B CN 106647765B CN 201710025383 A CN201710025383 A CN 201710025383A CN 106647765 B CN106647765 B CN 106647765B
- Authority
- CN
- China
- Prior art keywords
- information
- positioning
- platform
- boundary
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims abstract description 41
- 238000000034 method Methods 0.000 claims abstract description 30
- 230000008569 process Effects 0.000 claims abstract description 22
- 238000012937 correction Methods 0.000 claims description 18
- 230000001133 acceleration Effects 0.000 claims description 12
- 230000004927 fusion Effects 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000007499 fusion processing Methods 0.000 claims description 2
- 230000004888 barrier function Effects 0.000 claims 1
- 238000010276 construction Methods 0.000 abstract description 10
- 239000011159 matrix material Substances 0.000 description 10
- 239000003550 marker Substances 0.000 description 8
- 238000004364 calculation method Methods 0.000 description 7
- 238000012423 maintenance Methods 0.000 description 7
- 238000005259 measurement Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 4
- 238000000605 extraction Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 244000025254 Cannabis sativa Species 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 239000004020 conductor Substances 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 241000238631 Hexapoda Species 0.000 description 1
- 241001465754 Metazoa Species 0.000 description 1
- 241000270295 Serpentes Species 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 239000004568 cement Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005485 electric heating Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000026676 system process Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/243—Means capturing signals occurring naturally from the environment, e.g. ambient optical, acoustic, gravitational or magnetic signals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0231—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
- G05D1/0246—Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/02—Control of position or course in two dimensions
- G05D1/021—Control of position or course in two dimensions specially adapted to land vehicles
- G05D1/0276—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle
- G05D1/0278—Control of position or course in two dimensions specially adapted to land vehicles using signals provided by a source external to the vehicle using satellite positioning signals, e.g. GPS
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/20—Control system inputs
- G05D1/24—Arrangements for determining position or orientation
- G05D1/247—Arrangements for determining position or orientation using signals provided by artificial sources external to the vehicle, e.g. navigation beacons
- G05D1/248—Arrangements for determining position or orientation using signals provided by artificial sources external to the vehicle, e.g. navigation beacons generated by satellites, e.g. GPS
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D1/00—Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
- G05D1/60—Intended control result
- G05D1/648—Performing a task within a working area or space, e.g. cleaning
- G05D1/6484—Performing a task within a working area or space, e.g. cleaning by taking into account parameters or characteristics of the working area or space, e.g. size or shape
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2105/00—Specific applications of the controlled vehicles
- G05D2105/15—Specific applications of the controlled vehicles for harvesting, sowing or mowing in agriculture or forestry
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2107/00—Specific environments of the controlled vehicles
- G05D2107/20—Land use
- G05D2107/23—Gardens or lawns
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2109/00—Types of controlled vehicles
- G05D2109/10—Land vehicles
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
- G05D2111/10—Optical signals
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05D—SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G05D2111/00—Details of signals used for control of position, course, altitude or attitude of land, water, air or space vehicles
- G05D2111/50—Internal signals, i.e. from sensors located in the vehicle, e.g. from compasses or angular sensors
- G05D2111/52—Internal signals, i.e. from sensors located in the vehicle, e.g. from compasses or angular sensors generated by inertial navigation means, e.g. gyroscopes or accelerometers
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Aviation & Aerospace Engineering (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Electromagnetism (AREA)
- Control Of Position, Course, Altitude, Or Attitude Of Moving Bodies (AREA)
- Guiding Agricultural Machines (AREA)
Abstract
The invention is suitable for the field of robots, and provides a planning platform based on a mowing robot, which comprises: the image boundary identification device is used for acquiring an image of the area to be planned, processing the image to identify the boundary of the area to be planned and outputting the information of the boundary image formed after processing to the control device; the positioning device is used for acquiring main positioning data of the platform to form first positioning information and outputting the first positioning information to the control device; the inertial device is used for acquiring inertial data in the motion process of the platform, processing the inertial data into second positioning information of the platform and outputting the second positioning information to the control device; and the control device processes the boundary image information, the second positioning information and the first positioning information to form a map of the area to be planned, plans a path according to the map and controls the platform to move according to the planned path. The invention has low requirement on an operation field, less construction amount, reduced equipment complexity, reduced cost, higher mowing efficiency and higher mowing coverage rate.
Description
Technical Field
The invention belongs to the field of robots, and particularly relates to a planning platform based on a mowing robot.
Background
With the development of economy, the area of the lawn is rapidly increased in China, the lawn must be mowed regularly, otherwise the overall attractiveness of the lawn is affected, and regular mowing can promote tillering of the lawn, so that the lawn is denser, and the influence of inhabitation of insects, snakes and other animals on human health is avoided.
One common scheme for boundary identification of mowing areas today is: the lawn electric heating device is characterized in that wires are buried in the lawn boundary and the periphery of the obstacle, two ends of each wire are connected with a charging station, and the charging stations conduct alternating current with certain frequency to the wires to enable the wires to generate electromagnetic signals. An electromagnetic signal can be sensed when the mowing robot approaches the wire so that the boundary can be identified. Still another is to provide a signal emitting device on the boundary, and when the mowing robot approaches the boundary, the signal of the emitting device is received so as to identify the boundary. However, in the mode, the wires need to be embedded and constructed, and the engineering quantity is large under the conditions that the lawn area is large and the boundary is complex; if the boundary condition of the lawn is changed, construction needs to be carried out again, the original conducting wire can not be used again, and the flexibility is poor; for the condition of longer boundary, a large number of wires are needed, the cost is higher, and the power is always on when the power is used, so that the energy is not saved and the environment is protected; due to the limitations of the power supply of the charging station and the internal resistance of the conductor itself, the total length of the laid conductor is limited, and the application of a relatively large total boundary length is limited.
The other scheme is as follows: the signal transmitting device arranged on the boundary also needs certain construction, the cost of the signal transmitting device is higher, and the maintenance cost of the signal transmitting device is also higher. If the signal transmitting device adopts the battery to supply power, the battery needs to be replaced regularly, and if the cable is adopted to supply power, the laying of the cable per se needs a relatively large project.
Therefore, the existing mowing robots have the common disadvantages that: the construction amount is large, the flexibility is poor, the laying and maintenance cost is high, and accurate and intelligent mowing operation cannot be carried out.
Disclosure of Invention
The embodiment of the invention provides a planning platform based on a mowing robot, and aims to solve the problems of large construction amount, poor flexibility, high laying and maintenance cost and incapability of accurate and intelligent mowing operation.
The embodiment of the invention is realized in such a way that a planning platform based on a mowing robot comprises: the image boundary identification device, the inertia device, the positioning device and the control device;
the image boundary identification device can be used for acquiring an image of the area to be planned, processing the image to identify the boundary of the area to be planned and outputting the information of the boundary image formed after processing to the control device;
the inertial device can be used for acquiring inertial data in the motion process of the platform, processing the inertial data into second positioning information of the platform and outputting the second positioning information to the control device;
the positioning device can be used for acquiring main positioning data of the platform, forming first positioning information and outputting the first positioning information to the control device;
the control device can process the boundary image information, the second positioning information and the first positioning information to form a map of an area to be planned, plan a path according to the map, and control the platform to move according to the planned path.
The embodiment of the invention determines the boundary of the area to be planned in an image recognition mode, and obtains the positioning information through the combination of the inertial device and the positioning device, thereby forming a map of the area to be planned and carrying out path planning and movement control; by adopting the planning platform based on the mowing robot, the lawn does not need to be buried with wires, the requirement on an operation field is further reduced, the construction amount is less, the complexity of applying the mowing robot is reduced, the laying and maintenance cost is greatly reduced, the equipment can automatically identify the boundary of a mowing area, automatically generate a map and plan a movement path, the mowing robot can construct the map of the lawn and determine the position of the mowing robot, the mowing efficiency of the mowing robot is greatly improved, and the mowing coverage rate is improved.
Drawings
FIG. 1 is a diagram of an implementation environment provided by an embodiment of the invention;
FIG. 2 is a block diagram of a planning platform based on a mowing robot according to an embodiment of the invention;
fig. 3 is a structural diagram of another planning platform based on a mowing robot according to an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The embodiment of the invention determines the boundary of the area to be planned in an image recognition mode, and obtains the positioning information through the combination of the inertial device and the positioning device, thereby forming a map of the area to be planned and carrying out path planning and movement control; by adopting the planning platform based on the mowing robot, the lawn does not need to be buried with wires, the requirement on an operation field is further reduced, the construction amount is less, the complexity of applying the mowing robot is reduced, the laying and maintenance cost is greatly reduced, the equipment can automatically identify the boundary of a mowing area, automatically generate a map and plan a movement path, the mowing robot can construct the map of the lawn and determine the position of the mowing robot, the mowing efficiency of the mowing robot is greatly improved, and the mowing coverage rate is improved.
As shown in fig. 1, in an embodiment of the present invention, a planning platform based on a mowing robot may move in a certain direction (e.g., counterclockwise) along a boundary by using an image boundary identification method, and position the robot in real time by positioning calculation and correction calculation during the movement, and record position information of the boundary to form a boundary path; and when the mowing robot finishes a complete circle, the whole grassland/lawn map is drawn.
The charging station in the figure can provide electric energy supplement so as to ensure the endurance of the planning platform.
Fig. 2 is a structural diagram of a planning platform based on a mowing robot according to an embodiment of the present invention, where the planning platform includes: an image boundary recognition device 1, a positioning device 2, an inertial device 3, and a control device 4.
The image boundary identifying device 1 may be configured to acquire an image of an area to be planned, process the image to identify a boundary of the area to be planned, and output boundary image information formed after the processing to the control device 4. The boundary image information here includes at least the relevant position information of the already identified boundary. It can be understood that the area to be planned in the present invention mainly refers to a lawn, and the boundary of the lawn mainly includes: transition zones for lawn and non-lawn areas (e.g., fences, cement lands, etc.); or the intersection of a cut lawn area with an uncut lawn area; or the boundary between a lawn area where grass has been cut and a lawn area where grass has not been cut, etc. The image boundary recognition device can recognize the boundary of each state, and output the recognized boundary image information to the control device 4 for further processing.
And the positioning device 2 can be used for acquiring main positioning data of the platform, forming first positioning information and outputting the first positioning information to the control device 4.
The inertia device 3 can be used for acquiring inertia data in the motion process of the platform, processing the inertia data into second positioning information of the platform and outputting the second positioning information to the control device 4.
The control device 4 can process the boundary image information, the second positioning information and the first positioning information to form a map of the area to be planned, plan a path according to the map, and control the platform to move according to the planned path.
In the embodiment of the present invention, the control device 4 may be, but is not limited to, a microprocessor or a microcontroller, an STM32f4 microcontroller of ruyi method semiconductor corporation, and the like, and may also be other types of single-chip microcomputers, DSPs, FPGAs, and the like, which are not limited specifically.
As shown in fig. 3, in an embodiment of the present invention, the control device 4 further includes: a modification unit 41 and a planning processing unit 42.
The correction unit 41 is coupled to the inertial device and the positioning device, and configured to process the second positioning information and the first positioning information according to a preset correction algorithm to obtain third positioning information including position information of the platform.
And the planning processing unit 42 is used for constructing a map of the area to be planned according to the third positioning information of the correction unit and the boundary image information of the image boundary identification device, planning a path and controlling the platform to move according to the planned path.
In the embodiment of the present invention, the modification unit 41 and the planning processing unit 42 may be integrated modules on the control device 4, or may be separate chips, and the functions thereof may be implemented by software, hardware, or a combination thereof, and the specific implementation form is not limited.
The planning platform based on the mowing robot provided by the embodiment of the invention further reduces the requirements on an operation field, has less construction amount, greatly reduces the laying and maintenance cost, can automatically identify the boundary of a mowing area, automatically generates a map and plans a movement path, and has the advantages of flexible operation, accurate positioning and higher intelligent degree.
As an embodiment of the present invention, the image boundary recognition apparatus 1 recognizes the boundary of the lawn by using a visual boundary recognition method, and includes: an image acquisition unit 11 and an image processing unit 12.
The image acquisition unit 11 is configured to acquire an image of an area to be planned. The image processing unit 12 is configured to perform preprocessing, effective information extraction, and calculation on an image of the region to be planned, form boundary image information, and output the boundary image information to the control device.
It is understood that the image acquisition unit 11 may be a camera, such as a CCD camera or a CMOS camera, etc. For example, in a specific implementation environment, a CCD camera or a CMOS camera may be mounted on the upper portion of the mowing robot, and image acquisition may be performed on the area in front of the robot at a certain frequency.
The image processing unit 12 performs preprocessing, such as filtering, on the image acquired by the image acquisition unit 11, which may include distortion correction, noise reduction, image enhancement, and the like.
Of course, as an important functional module of the present invention, the image processing unit 12 is also used for extracting and calculating effective information from the image. In detail, the extraction of the effective information may be feature information extraction, where the image corresponding to the boundary of the lawn is mainly captured and extracted, and the image processing unit 12 acquires color information, brightness information, and the like in the image and performs processing according to a preset rule. For example, the image processing unit 12 may count the color information in the image and calculate the distribution of the colors, for example, the dominant color of the lawn is green, which can be distinguished from other objects in the environment, so that the probability of green appearing in all colors can be calculated in the RGB color mode, and whether the color is a lawn boundary can be determined according to the probability distribution. Of course, in the present invention, whether the image is a boundary may be determined by the texture of the lawn, for example, the image processing unit 12 may count up the shading information in the image, calculate the distribution of the shading, and further determine whether the image includes the boundary information of the lawn based on the distribution. Secondly, the image processing unit 12 may also calculate the relative position of the boundary of the area to be planned (lawn) and the planning platform.
In the embodiment of the present invention, the positioning device 2 may be configured to collect main positioning data of the platform to form first positioning information, and output the first positioning information to the control device 4 for processing by the control device 4; the main positioning data collected by the positioning device 2 can determine the position information of the planning platform, and the control device 4 can determine the position of the planning platform according to the data and record the position so as to facilitate subsequent map construction and path planning.
In an embodiment of the present invention, the positioning device 2 is a GPS positioning unit 201, and the main positioning data is GPS positioning data. The GPS positioning unit 201 can acquire the current GPS positioning data of the platform in real time, process the GPS positioning data into first positioning information including the position information of the platform, and output the first positioning information to the correction unit 41 of the control device 4.
In another embodiment of the present invention, the positioning device 2 is a binocular positioning unit 202, which can acquire image information of markers preset on the boundary of the area to be planned, wherein the main positioning data is the image information of the markers preset on the boundary of the area to be planned. Therefore, the binocular positioning unit 202 may be configured to acquire and recognize image information of a marker preset on a boundary of the area to be planned, and form first positioning information including at least position information of the platform to be output to the correction unit 41 of the control device.
In an embodiment of the present invention, an inertial device 3 is further introduced into the planning platform to collect and process the motion state information of the planning platform.
In a conventional robot, an inertial system is generally not used as an independent positioning means, because the inherent integral accumulated error of the inertial system can only ensure positioning accuracy in a short time, and if a corresponding auxiliary positioning method or a corresponding accumulated error correction measure is not available, the inertial system cannot be independently used as a positioning device in the general robot. The inertial device 3 is introduced, and the characteristics of high short-time positioning accuracy and stable and continuous data of the inertial device 3 are utilized, so that short-time positioning interference which may occur when the planning platform is positioned by the GPS positioning unit 201 or the binocular positioning unit 202 can be solved. Specifically, for example, when the GPS positioning unit 201 is used for positioning, a situation (such as multipath effect) may occur where a GPS signal is not good or local area interference is large, which may cause unstable positioning, and thus the system may not work properly. Or, when the positioning is performed by the binocular positioning unit 202, the shooting view field is often blocked by other objects (such as trees) due to image acquisition by the camera, so that the marker cannot be normally captured.
Therefore, for the reasons mentioned above, the embodiment of the present invention performs combined positioning by the inertial device 3 and the GPS positioning unit 201 or the binocular positioning unit 202, so that the system can obtain highly accurate and stable positioning information even when some of the above-mentioned abnormal factors occur.
In one embodiment of the invention, the inertial device 3 comprises:
the inertial data acquisition unit 31 is used for acquiring inertial data formed by the planning platform in the motion process; and
the inertial data processing unit 32 is configured to process the inertial data to form second positioning information including the motion state information and the position information of the planning platform, and output the second positioning information to the control device 4.
In an embodiment of the present invention, inertial data includes, but is not limited to: acceleration data, angular velocity data, and geomagnetic data. Accordingly, the inertial data acquisition unit 31, which may be an inertial sensor, may include:
the acceleration acquisition module for acquiring the acceleration data of the platform can be an acceleration sensor, such as a MEMS accelerometer and the like;
the angular velocity acquisition module for acquiring the angular velocity data of the platform can be an angular velocity sensor, such as a MEMS gyroscope and the like; and
the geomagnetic acquisition module for acquiring geomagnetic data of the platform may be a magnetic sensor, such as a MEMS magnetometer.
The above modules of the inertial data acquisition unit 31 realize measurement of the acceleration, the geomagnetism, and the angular velocity of the planning platform, and the measured data is further sent to the inertial data processing unit 32, and the inertial data processing unit 32 further processes the data into second positioning information including orientation information, attitude information, and velocity information of the planning platform, so that the inertial data processing unit 32 further includes:
and the data fusion module is configured to perform fusion processing on the inertial data to obtain second positioning information including orientation information, attitude information, speed information, and position information of the platform, output the second positioning information to the correction unit 41, perform fusion and correction processing on the second positioning information and the first positioning information to obtain stable third positioning information with higher positioning accuracy, and output the third positioning information to the planning processing unit 42.
For the fusion and correction processing of data or information, in detail, when the GPS positioning device 201 is used, for example, the position information of the platform based on inertial measurement, the position information based on GPS positioning data measured by the GPS positioning device 201, and the accurate position information of the platform by fusing the two position information by a certain data fusion algorithm can be obtained by performing secondary integration on the processed acceleration data.
For another example, when the binocular positioning apparatus 202 is used, the position information of the robot can be obtained by performing a quadratic integration on the processed acceleration to obtain the position information of the platform based on inertial measurement, obtaining the position information based on the binocular camera based on the binocular distance measurement, and fusing the two position information by a certain data fusion algorithm, for example.
The following illustrates a calculation method for fusing inertial data and GPS positioning data according to an embodiment of the present invention:
1. and (3) state prediction:
X(k|k-1)＝AX(k-1|k-1)+BU(k)
where X (k | k-1) is a prediction of the current state based on the state at the previous time, U (k) is the current input, and in this embodiment, the state takes the position and velocity in two directions on a horizontal plane, and the input is the corrected acceleration on the horizontal plane, i.e., the acceleration
X＝(Px Py Vx Vy)T
U＝(ax ay)T
A is a state transition matrix, B is a control input matrix, and Δ t is a sampling time interval
2. And (3) error prediction:
P(k|k-1)＝AP(k-1|k-1)AT+Q(k)
in the formula, P (k | k-1) is the prediction estimation of the current error based on the error of the last time, and Q (k) is the error covariance matrix of the system process, and is determined according to the process model of the system.
3. Kalman gain calculation:
where kg (k) is the kalman gain matrix at the current time, H is the observation matrix, r (k) is the observation error covariance matrix, where we select the observation vector as the position and velocity on the horizontal plane for GPS measurements, then:
Y＝(Px Py Vx Vy)T
because the state vector is consistent with the observation vector, the observation matrix is an identity matrix, and the observation error covariance matrix is determined according to the measurement error of the GPS.
4. And (3) updating the state:
X(k|k)＝X(k|k-1)+Kg(k)(Y(k)-HX(k|k-1))
5. and (3) error updating:
P(k|k)＝(I-Kg(k)H)P(k|k-1)
in the formula, I is an identity matrix.
Of course, the above description is only an example of a calculation rule that can be used by the present invention, and is used to embody the realizability of the solution provided by the embodiment of the present invention, and is not limited specifically.
Then, the planning processing unit 42 acquires the third positioning information, constructs a map of the area to be planned according to the third positioning information and the boundary image information of the image boundary recognition device 1, plans a path, and controls the platform to move according to the planned path.
Therefore, the embodiment of the invention determines the boundary of the area to be planned in an image recognition mode, and obtains accurate positioning information through the inertia auxiliary positioning device, so as to form a map of the area to be planned and carry out path planning and movement control; by adopting the planning platform based on the mowing robot, the lawn does not need to be buried with wires, the requirement on an operation field is further reduced, the construction amount is less, the complexity of applying the mowing robot is reduced, the laying and maintenance cost is greatly reduced, the equipment can automatically identify the boundary of a mowing area, automatically generate a map and plan a movement path, the mowing robot can construct the map of the lawn and determine the position of the mowing robot, the mowing efficiency of the mowing robot is greatly improved, and the mowing coverage rate is improved.
In a preferred embodiment of the present invention, the control device 4 further comprises:
and the multi-task control unit controls the platform to move to the next to-be-planned area without executing operation according to the preset task information and the positioning information of the to-be-planned area if the current to-be-planned area is operated completely. For example, after the mowing robot carrying the planning platform finishes mowing on a certain lawn, if the task information in the task list has mowing tasks of other lawns, the mowing robot automatically moves forward to the next lawn to execute mowing operation according to the GPS positioning information of the lawn until all mowing operations are finished, the intelligent degree is high, and the user experience is good.
In a preferred embodiment of the present invention, the control device 4 further comprises:
and the electric quantity control unit is used for charging the charging station according to the preset position information of the charging station and the positioning information of the platform if the electric quantity is insufficient in the operation process of the platform.
In an embodiment of the present invention, if the positioning device 2 is a GPS positioning unit 201, the mowing robot having the planning platform provided in the above embodiment of the present invention is implemented by performing the following steps of image boundary recognition and positioning:
A1. after the mowing robot is started, the position of the mowing robot is determined according to the GPS positioning unit 201, then whether a map of the current lawn exists or not is detected, if not, the step B1 is executed, otherwise, the step C1 is executed;
B1. the mowing robot searches for the boundary along a certain fixed direction (such as north), and after the boundary is found, the mowing robot walks for a circle along the boundary in a certain direction (such as anticlockwise), and the position information of the boundary is recorded while walking. After one turn, the control device 4 determines whether the border is the outer border of the lawn or the border of an obstacle (e.g. a central flower bed, etc.) in the lawn. The judgment method is that according to whether the mowing robot is in the closed boundary or outside the closed boundary, if the mowing robot is in the closed boundary, the boundary is indicated to be the outer boundary of the lawn, and otherwise, the boundary is the boundary of an obstacle in the lawn. If the found boundary is the boundary of an obstacle, the mowing robot changes direction (e.g., south facing), and step B1 is repeated until the outer boundary of the lawn is found;
C1. the mowing robot plans a mowing path according to the shape of the lawn and then executes mowing operation according to the planned path;
preferably, the method further comprises the following two steps:
D1. after the mowing robot finishes mowing operation of a certain lawn, if mowing tasks of other lawns exist in the task list, the mowing robot automatically goes to the next lawn to execute mowing operation according to the GPS coordinates of the lawn until all mowing operations are finished;
E1. in the process of executing the mowing task by the mowing robot, if the electric quantity is insufficient, the mowing robot can automatically go to charge according to the recorded position of the charging station.
In another embodiment of the present invention, the positioning device 2 is a binocular positioning unit 202, and the mowing robot having the planning platform provided in the above embodiment of the present invention is implemented by performing the following steps of image boundary identification and positioning (in the example, the number of benches is 2):
A2. after the mowing robot is started, whether a map of the current lawn exists or not is detected, if not, the step B2 is executed, otherwise, the step C2 is executed;
B2. the binocular camera holder of the mowing robot scans for a circle in a rotating manner, searches for a marker post (the marker post is used as a marker), finds a marker post which is closest to the marker post, and measures the distance between the mowing robot and the other marker post according to a binocular distance measuring principle. Then walking along the boundary in a certain direction (such as anticlockwise) by an image boundary identification method, positioning the robot in real time by a positioning calculation and correction unit in the walking process, and simultaneously recording the position information of the boundary; when the mowing robot finishes a complete circle, the whole lawn is mapped;
C2. the mowing robot plans a mowing path according to the shape of the lawn and then executes mowing operation according to the planned path;
preferably, the method further comprises the following two steps:
D2. in the process of executing the mowing task by the mowing robot, if the electric quantity is insufficient, the mowing robot can automatically go to charge according to the recorded position of the charging station.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent substitutions and improvements made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (9)
1. A robot lawnmower-based planning platform, comprising: the image boundary identification device, the inertia device, the positioning device and the control device;
the image boundary identification device can be used for acquiring an image of the area to be planned, processing the image to identify the boundary of the area to be planned and outputting the information of the boundary image formed after processing to the control device;
the positioning device can be used for acquiring main positioning data of the platform to form first positioning information and outputting the first positioning information to the control device;
the inertial device can be used for acquiring inertial data in the motion process of the platform, processing the inertial data into second positioning information of the platform and outputting the second positioning information to the control device;
the control device can process the boundary image information, the second positioning information and the first positioning information to form a map of an area to be planned, plan a path according to the map and control the platform to move according to the planned path;
the control device comprises a multi-task control unit, a positioning unit and a control unit, wherein the multi-task control unit is used for controlling the platform to move to the next to-be-planned area which does not execute the operation according to the preset task information and the positioning information of the to-be-planned area until all the mowing operations are finished if the current to-be-planned area is operated completely;
the control device is further configured to:
when the mowing robot searches for a boundary along a certain fixed direction, walking a circle along the boundary in the certain direction when the boundary is found, and recording position information of the boundary while walking; after one circle is finished, judging that the boundary is the outer boundary of the area to be planned according to the condition that the mowing robot is in the closed boundary; and when the mowing robot is outside the closed boundary, judging that the boundary is the boundary of the barrier in the area to be planned, and controlling the mowing robot to change the direction until the outer boundary of the area to be planned is found.
2. The platform of claim 1, wherein the control means comprises:
the correction unit is coupled with the inertial device and the positioning device and used for processing the second positioning information and the first positioning information according to a preset correction algorithm to obtain third positioning information containing the position information of the platform;
and the planning processing unit is used for constructing a map of the area to be planned according to the third positioning information of the correction unit and the boundary image information of the image boundary identification device, planning a path and controlling the platform to move according to the planned path.
3. The platform of claim 1, wherein the boundary identifying means comprises: the device comprises an image acquisition unit and an image processing unit;
the image acquisition unit is used for acquiring an image of an area to be planned; and
and the image processing unit is used for preprocessing the image of the area to be planned, extracting and calculating effective information, forming boundary image information and outputting the boundary image information to the control device.
4. The platform of claim 2, wherein the positioning device comprises a GPS positioning unit, the primary positioning data being GPS positioning data;
and the GPS positioning unit is used for acquiring the GPS positioning data of the platform, processing the GPS positioning data into first positioning information containing the position information of the platform and outputting the first positioning information to the correction unit of the control device.
5. The platform of claim 2, wherein the positioning means comprises a binocular positioning unit which collects image information of markers preset on the boundary of the area to be planned;
and the binocular positioning unit is used for acquiring and identifying image information of the markers preset on the boundary of the area to be planned, and forming first positioning information at least comprising the position information of the platform so as to output the first positioning information to the correction unit of the control device.
6. The platform of claim 1, wherein the inertial device comprises:
the inertial data acquisition unit is used for acquiring inertial data formed in the motion process of the platform; and
and the inertial data processing unit is used for processing the inertial data to form second positioning information comprising the motion state information and the position information of the platform and outputting the second positioning information to the control device.
7. The platform of claim 6, wherein the inertial data comprises: acceleration data, angular velocity data, and geomagnetic data;
the inertial data acquisition unit includes:
the acceleration acquisition module is used for acquiring acceleration data of the platform;
the angular velocity acquisition module is used for acquiring angular velocity data of the platform; and
and the geomagnetic acquisition module is used for acquiring geomagnetic data of the platform.
8. The platform of claim 2 or 6, wherein the motion state information comprises: orientation information, attitude information, speed information;
the inertial data processing unit includes:
and the data fusion module is used for carrying out fusion processing on the inertial data to obtain second positioning information comprising orientation information, attitude information, speed information and position information of the platform, and outputting the second positioning information to the correction unit.
9. The platform of claim 1, wherein the control means further comprises:
and the electric quantity control unit is used for charging the charging station according to the preset position information of the charging station and the positioning information of the platform if the electric quantity is insufficient in the operation process of the platform.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710025383.1A CN106647765B (en) | 2017-01-13 | 2017-01-13 | Planning platform based on mowing robot |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710025383.1A CN106647765B (en) | 2017-01-13 | 2017-01-13 | Planning platform based on mowing robot |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106647765A CN106647765A (en) | 2017-05-10 |
| CN106647765B true CN106647765B (en) | 2021-08-06 |
Family
ID=58844382
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710025383.1A Active CN106647765B (en) | 2017-01-13 | 2017-01-13 | Planning platform based on mowing robot |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106647765B (en) |
Families Citing this family (32)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10140530B1 (en) * | 2017-08-09 | 2018-11-27 | Wipro Limited | Method and device for identifying path boundary for vehicle navigation |
| CN107976998A (en) * | 2017-11-13 | 2018-05-01 | 河海大学常州校区 | A kind of grass-removing robot map building and path planning system and method |
| WO2019096263A1 (en) * | 2017-11-16 | 2019-05-23 | 南京德朔实业有限公司 | Intelligent mowing system |
| CN108423141B (en) * | 2018-02-05 | 2020-03-31 | 浙江大学 | Underwater operation robot and control method thereof |
| CN108337987A (en) * | 2018-02-13 | 2018-07-31 | 杭州慧慧科技有限公司 | A kind of automatic mowing system and grass trimmer control method |
| CN108919814A (en) * | 2018-08-15 | 2018-11-30 | 杭州慧慧科技有限公司 | Grass trimmer working region generation method, apparatus and system |
| CN108490932B (en) * | 2018-03-09 | 2021-01-26 | 东南大学 | Control method of mowing robot and automatic control mowing system |
| CN108614558B (en) * | 2018-05-31 | 2020-12-25 | 北京智行者科技有限公司 | Cleaning track planning method |
| CN109343533A (en) * | 2018-11-09 | 2019-02-15 | 深圳蓝胖子机器人有限公司 | A kind of robot system and its control method of golf course lawn maintenance |
| CN111273648B (en) * | 2018-11-19 | 2021-11-16 | 苏州宝时得电动工具有限公司 | Automatic walking equipment and control method thereof |
| CN109584258B (en) * | 2018-12-06 | 2021-10-15 | 南京苏美达智能技术有限公司 | Grassland boundary identification method and intelligent mowing device applying same |
| CN110134147A (en) * | 2019-06-20 | 2019-08-16 | 安阳全丰航空植保科技股份有限公司 | A kind of autonomous paths planning method and device of plant protection drone |
| CN110320915A (en) * | 2019-07-15 | 2019-10-11 | 上海速标智能科技有限公司 | With the job platform and its control method for building figure and path planning function automatically |
| CN112764416B (en) * | 2019-10-18 | 2024-06-18 | 南京泉峰科技有限公司 | Self-walking mowing system and outdoor walking equipment |
| CN111028658A (en) * | 2019-11-18 | 2020-04-17 | 杭州晶一智能科技有限公司 | Mowing robot electronic map construction method based on GPS and online map |
| US20230015335A1 (en) * | 2019-12-13 | 2023-01-19 | Positec Power Tools (Suzhou), Co., Ltd. | Working map construction method and apparatus, robot, and storage medium |
| CN113064408B (en) * | 2019-12-13 | 2023-03-10 | 苏州宝时得电动工具有限公司 | Autonomous robot, control method thereof, and computer storage medium |
| CN111199677B (en) * | 2019-12-25 | 2022-02-18 | 邦鼓思电子科技（上海）有限公司 | Automatic work map establishing method and device for outdoor area, storage medium and working equipment |
| CN113128747B (en) * | 2019-12-30 | 2024-03-19 | 南京泉峰科技有限公司 | Intelligent mowing system and autonomous image building method thereof |
| CN113296495B (en) * | 2020-02-19 | 2023-10-20 | 苏州宝时得电动工具有限公司 | Path forming method and device of self-mobile equipment and automatic working system |
| CN114111779B (en) * | 2020-08-26 | 2024-06-28 | 深圳市杉川机器人有限公司 | Method for establishing working area map and self-mobile device |
| EP4224268A4 (en) * | 2020-12-10 | 2024-03-20 | Nanjing Chervon Industry Co., Ltd. | Intelligent mower and intelligent mowing system |
| CN114265405A (en) * | 2021-09-26 | 2022-04-01 | 深圳市商汤科技有限公司 | Mobile robot, edgewise moving method thereof and computer storage medium |
| CN113885495B (en) * | 2021-09-29 | 2024-08-20 | 上海菲蒽蔓机器人科技有限公司 | Outdoor automatic work control system, method and equipment based on machine vision |
| CN114489083A (en) * | 2022-02-11 | 2022-05-13 | 松灵机器人(深圳)有限公司 | Working area construction method and related device |
| CN116088533B (en) * | 2022-03-24 | 2023-12-19 | 未岚大陆(北京)科技有限公司 | Information determination method, remote terminal, device, mower and storage medium |
| CN114937258B (en) * | 2022-04-22 | 2023-08-04 | 未岚大陆(北京)科技有限公司 | Control method for mowing robot, and computer storage medium |
| CN115291613A (en) * | 2022-09-16 | 2022-11-04 | 未岚大陆(北京)科技有限公司 | Autonomous mobile device, control method thereof, and computer-readable storage medium |
| CN115500143B (en) * | 2022-11-02 | 2023-08-29 | 无锡君创飞卫星科技有限公司 | Mower control method and device with laser radar |
| CN116203606B (en) * | 2023-03-03 | 2024-02-20 | 上海筱珈数据科技有限公司 | RTK and vision fusion technology-based grass cutting robot navigation method and device |
| CN117191030A (en) * | 2023-09-08 | 2023-12-08 | 深圳市鑫旭源环保有限公司 | Path planning method and device for cleaning robot |
| CN117516513A (en) * | 2024-01-08 | 2024-02-06 | 锐驰激光(深圳)有限公司 | Intelligent mower path planning method, device, equipment and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662400A (en) * | 2012-05-10 | 2012-09-12 | 慈溪思达电子科技有限公司 | Path planning algorithm of mowing robot |
| CN103472823A (en) * | 2013-08-20 | 2013-12-25 | 苏州两江科技有限公司 | Raster map creating method for intelligent robot |
| CN105204505A (en) * | 2015-09-22 | 2015-12-30 | 深圳先进技术研究院 | Positioning video acquiring and drawing system and method based on sweeping robot |
| CN105928514A (en) * | 2016-04-14 | 2016-09-07 | 广州智能装备研究院有限公司 | AGV composite guiding system based on image and inertia technology |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101281512B1 (en) * | 2007-04-06 | 2013-07-03 | 삼성전자주식회사 | Robot cleaner and control method thereof |
| CN104704979B (en) * | 2013-12-17 | 2016-12-07 | 苏州宝时得电动工具有限公司 | A kind of mowing-apparatus automatically |
| CN105988470A (en) * | 2015-02-15 | 2016-10-05 | 苏州宝时得电动工具有限公司 | Automatic mower |
| JP6716910B2 (en) * | 2015-12-25 | 2020-07-01 | 井関農機株式会社 | Autonomous traveling system for work vehicles |
| CN205704223U (en) * | 2016-04-06 | 2016-11-23 | 王方明 | Public sweeping robot path planning system |
| CN106155053A (en) * | 2016-06-24 | 2016-11-23 | 桑斌修 | A kind of mowing method, device and system |
-
2017
- 2017-01-13 CN CN201710025383.1A patent/CN106647765B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102662400A (en) * | 2012-05-10 | 2012-09-12 | 慈溪思达电子科技有限公司 | Path planning algorithm of mowing robot |
| CN103472823A (en) * | 2013-08-20 | 2013-12-25 | 苏州两江科技有限公司 | Raster map creating method for intelligent robot |
| CN105204505A (en) * | 2015-09-22 | 2015-12-30 | 深圳先进技术研究院 | Positioning video acquiring and drawing system and method based on sweeping robot |
| CN105928514A (en) * | 2016-04-14 | 2016-09-07 | 广州智能装备研究院有限公司 | AGV composite guiding system based on image and inertia technology |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106647765A (en) | 2017-05-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106647765B (en) | Planning platform based on mowing robot | |
| CN113791641B (en) | Facility detection method and control equipment based on aircraft | |
| CN204515530U (en) | Automatic running gear | |
| CN104180805B (en) | Smart phone-based indoor pedestrian positioning and tracking method | |
| CN106843230B (en) | Virtual wall system and its implementation applied to mobile device | |
| CN109901590B (en) | Recharging control method of desktop robot | |
| US10444760B2 (en) | Robotic vehicle learning site boundary | |
| CN108012326A (en) | The method and chip of robot monitoring pet based on grating map | |
| CN107831777A (en) | A kind of aircraft automatic obstacle avoiding system, method and aircraft | |
| CN108846325A (en) | Planing method, device, storage medium and the processor of target area operation | |
| CN106168805A (en) | The method of robot autonomous walking based on cloud computing | |
| WO2020030066A1 (en) | Self-mobile device, automatic operating system and control method thereof | |
| CN104197934B (en) | A kind of localization method based on earth magnetism, apparatus and system | |
| CN113675923B (en) | Charging method, charging device and robot | |
| CN213424010U (en) | Mowing range recognition device of mowing robot | |
| CN111199677B (en) | Automatic work map establishing method and device for outdoor area, storage medium and working equipment | |
| CN107832655A (en) | A kind of take photo by plane system and output of cotton estimating and measuring method based on unmanned plane imaging near the ground | |
| CN110081873A (en) | Recognition methods is got in region ready and agricultural machinery gets identifying system ready | |
| CN110286670A (en) | The driving path planning system and its method of more automatic harvesters | |
| CN106352871A (en) | Indoor visual positioning system and method based on artificial ceiling beacon | |
| CN110702101A (en) | Positioning method and system for power inspection scene | |
| CN111540013B (en) | Indoor AGV trolley positioning method based on multi-camera visual slam | |
| CN108536146A (en) | The intelligent control method of localization for Mobile Robot recharging base based on path and RSSI | |
| CN112068572A (en) | Unmanned harvesting system and method | |
| CN114371726A (en) | Unmanned aerial vehicle air-ground integrated detection positioning method, device, system and equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |