SEOUL, Nov. 15 (Korea Bizwire) – South Korean researchers at the Korea Institute of Science and Technology Information (KISTI) have successfully participated in the development of “BigData Express”, a data transfer tool that can accommodate large-scale transfers.
As supercomputers become ever more powerful, the amount of data they can process has accordingly ballooned in scale. This advantage has raised its own problems, namely the lack of sufficient infrastructure to transfer petabytes of data in a speedy and accurate manner between multiple computers.
One petabyte is approximately equivalent to one million gigabytes. The world’s fastest computer is the Sunway TaihuLight in China, which earned the title with a LINPACK benchmark of 93 petaFLOPS. FLOP is a measuring stick for computing power used in the computing industry.
Through testing, BigData Express was able to transfer data 100 times faster than the widely used grid computing system GridFTP, with a 33 percent higher operating performance.
Research into the BigData Express project was led by Fermilab and supported by the Oak Ridge National Laboratory.
Kevin Lee (kevinlee@koreabizwire.com)