KR20010056528A - Data tiling method for retrieving and handling large volume of data - Google Patents

Abstract

PURPOSE: A method for tiling data is provided to search and process data effectively and rapidly without separating the original large-sized capacity data physically by separating the data into logical blocks. CONSTITUTION: The number of blocks is calculated by dividing the original large-sized capacity data into fixed-sized blocks(400). Loop control variable 'i' and 'j' are set(401). The 'i' denotes the number of the vertical direction block of separated from the original large-sized capacity data, and the 'j' denotes the number of the horizontal direction block of separated from the original large-sized capacity data. If the 'i' is not more than the number of the vertical direction(402), a vertical direction minimum position of each block is calculated(403). I If the 'i' is identified with the number of the vertical direction(404), a vertical direction maximum position of the corresponding block is set as a vertical direction maximum position of the original large-sized capacity data, and the number of the actual vertical pixels of the corresponding block is calculated(405). If the 'i' is not identified with the number of the vertical direction(407), the maximum position of the corresponding block and the number of actual vertical pixels are calculated(406). If the 'j' is not more than the number of the horizontal direction, a horizontal direction minimum position of each block is calculated(408). If the 'j' is more than the block number of the horizontal direction(409), the 'i' is increased by '1'(414).

Description

DATA TILING METHOD FOR RETRIEVING AND HANDLING LARGE VOLUME OF DATA}

The present invention relates to a data tiling method for retrieving and processing a large data file, and in particular, by dividing a large file into logical data blocks of a certain size, a large capacity that can significantly reduce the time required to retrieve the data block. A data tiling method for retrieving and processing a data file and a computer readable recording medium having recorded thereon a program for realizing the method.

In general, a method of searching and processing a large amount of data reads data directly from a data file since all data cannot be read and processed in memory. Therefore, in order to search for specific data from the data file, the file must be searched from the beginning to the position where the desired data exists.

As described above, a large data search and processing method has a problem that it takes a very long time to search for data to be searched. In order to improve this, a method of searching and operating a large data as a plurality of files has been proposed and used. .

However, the large data retrieval and processing method for dividing and operating large data into a large number of files has a problem in that the data cannot be normally retrieved and processed according to the data reading method by physically dividing the file.

Accordingly, the present invention devised to solve the above problems, by dividing a large amount of data into logical blocks, by using a header that stores information for each block, without having to physically partition the original large data It is an object of the present invention to provide a data tiling method that can efficiently and quickly perform data retrieval and processing, and a computer-readable recording medium having recorded thereon a program for realizing the method.

1 is an exemplary configuration of a data tiling device for searching and processing a large data file to which the present invention is applied.

2 is an exemplary diagram of header information of a data block according to the present invention;

3 is an explanatory diagram illustrating a process of generating a logical data block according to the present invention;

4 is an embodiment processing flow diagram for a data tiling method for retrieval and processing of large data files in accordance with the present invention.

* Explanation of symbols for the main parts of the drawings

100: central processing unit 101: main memory device

102: auxiliary storage device 103: input and output device

The method of the present invention for achieving the above object is a data tiling method for searching and processing a large data file applied to a data tiling system for searching and processing a large data file, the original data is divided into logical blocks First step; A second step of constructing information on the divided block and storing the information in a header; And a third step of searching for the divided block by using the information stored in the header.

The present invention also provides a data tiling system for retrieving and processing a large data file having a microprocessor, comprising: a first function of dividing original data into logical blocks; A second function of constructing information about the divided block and storing the information in a header; And a computer-readable recording medium having recorded thereon a program for realizing a third function of searching for the divided block using the information stored in the header.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is an exemplary configuration diagram of a data tiling apparatus for searching and processing a large data file to which the present invention is applied.

As shown in FIG. 1, a data tiling apparatus for searching and processing a large data file to which the present invention is applied includes a central processing unit 100 for controlling and managing an overall operation, and a central processing unit 100. A main memory 101 for storing a program to be executed and storing various data used during or performing a task and an auxiliary memory 102 and an input / output device 103 for inputting / outputting data to and from a user. .

The auxiliary memory device 102 stores a large amount of data, and the input / output device 103 includes a general keyboard, a display device, a printer, and the like.

However, since the computer hardware environment having the configuration as described above is only a technique well known in the art, detailed description thereof will be omitted herein.

Now, a process of performing data tiling for searching and processing a large data file mounted on the main memory 101 will be described in more detail.

2 is an exemplary diagram of header information of a data block according to the present invention, taking header information of a raster file of a geographic information system as an example.

As shown in the figure, the header information of the data block is "Version" which means the generation version of the file, "Type" which indicates the type of the file, "Area" which indicates the area of the entire area of the data, and generation of the data file. "Date" which represents one, "Coordinate" which represents the coordinate system of the data, "Description" which describes the user about the file, "Base Point" which indicates the position information of the first pixel at the bottom left, and the width and height of one pixel. "Distance" representing length information, "Count" representing the number of horizontal and vertical pixels for the entire data, "Size" representing the length of actual data representing one pixel, "Value" representing the highest and lowest values in the entire data "," Scale "indicating the data size and" Data "information indicating where the actual data is stored.

3 is an explanatory diagram illustrating a process of generating a logical data block according to the present invention.

In the drawing, "300" denotes a large amount of original large data, "301" denotes a logical data block obtained by dividing original large data, and "302" denotes the number of pixels constituting data for the logical data block 301, and header information (data block). The number of pixels constituting the?, The number of blocks constituting the entire data, the position at which the block starts, etc.), and "303" indicates a logical data block in which the header information 302 is configured in the logical data block 301. it means.

Now, the data tiling method for retrieving and processing a large data file according to the present invention will be described in detail with reference to the accompanying FIG. 4.

4 is a flowchart illustrating an embodiment of a data tiling method for searching and processing a large data file according to the present invention.

First, the original large-capacity data is divided into blocks of a predetermined size, the number of blocks is calculated (400), and the loop control variables 'i' and 'j' are set to 0 (401). Here, 'i' means the number of vertical blocks of blocks divided from the original large data, and 'j' means the number of horizontal blocks.

It is determined whether 'i' is less than or equal to the number of vertical blocks (402).

As a result of the determination 402, if 'i' is less than or equal to the number of vertical blocks, the vertical minimum position of each block is calculated (403), and it is determined whether 'i' is equal to the number of vertical blocks (404). ).

As a result of the determination 404, if 'i' is equal to the number of blocks in the vertical direction, the vertical maximum position of the block is set as the vertical maximum position of the original mass data, and the actual number of vertical pixels of the current block is calculated. After that (405), it is determined whether 'j' is less than or equal to the number of blocks in the horizontal direction (407).

As a result of the determination 404, if 'i' is not equal to the number of blocks in the vertical direction, after calculating the maximum horizontal position of the block and the number of actual vertical pixels (406). Step 407 is performed.

As a result of the determination 407, if 'j' is less than or equal to the number of blocks in the horizontal direction, the horizontal minimum position of each block is calculated (408), and it is determined whether 'j' is equal to the number of blocks in the horizontal direction ( 409).

As a result of the determination 407, if 'j' is larger than the number of blocks in the horizontal direction, 'i' is increased by 1 (414), and step 402 is performed.

As a result of the determination (409), if 'j' is equal to the number of blocks in the horizontal direction, the horizontal maximum position of the block is set to the maximum position of the original mass data, and the actual number of horizontal pixels of the current block is calculated. 410 stores the number of horizontal and vertical pixels and the position of the block in the original large data file in the header of each block (412).

In the determination result 409, if 'j' is not equal to the number of blocks in the horizontal direction, the vertical maximum position of the block and the actual number of horizontal pixels of the current block are calculated (411), and the process 412 is performed. After increasing 'j' by 1 (413), the process 407 is performed.

The data tiling method for searching and processing a large data file of the present invention sequentially performs the above-described process on all horizontal and vertical blocks of logically divided blocks.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains. It is not limited to the drawing.

According to the present invention as described above, by dividing a large amount of data into logical blocks and using a header that stores information for each block, the search unit is reduced, so that the search speed is improved, and the data divided into logical blocks. Since it is not necessary to read all the data into the memory, memory can be saved, and the original data can be preserved as it is without physically modifying the original large data.

Claims (4)

A data tiling method for retrieving and processing a large data file applied to a data tiling system for retrieving and processing a large data file, A first step of dividing original data into logical blocks; A second step of constructing information on the divided block and storing the information in a header; And A third step of searching for the divided block by using the information stored in the header Data tiling method for searching and processing large data files comprising a. The method of claim 1, The second step, A fourth step of obtaining a longitudinal minimum position of each divided block; A fifth step of obtaining a horizontal maximum position of each divided block and obtaining the number of vertical pixels of the corresponding block; A sixth step of obtaining a horizontal minimum position of each divided block; A seventh step of obtaining the maximum vertical position of each divided block and obtaining the number of horizontal pixels of the current block; And And an eighth step of storing the number of horizontal and vertical pixels and the position of the block in each of the divided block headers. The method according to claim 1 or 2, The information of the divided block, the number of pixels constituting the data block, the number of blocks constituting the entire data, the data tiling method for the search and processing of a large file, characterized in that the block starts position. In the data tiling system, for retrieval and processing of large data files with a microprocessor, A first function of dividing original data into logical blocks; A second function of constructing information about the divided block and storing the information in a header; And A third function of searching for the divided block using information stored in the header A computer-readable recording medium having recorded thereon a program for realizing this.