Metrics
7 File views/ downloads
83 Record Views
Journal article
Reducing the disk IO bandwidth bottleneck through fast floating point compression using accelerators
International Journal of Advanced Computer Research, Vol.4, pp.134-144
4
2014
Abstract
Compute-intensive tasks in high-end high performance computing (HPC) systems often generate large amounts of data, especially floating point data that need to be transmitted over the network. Although computation speeds are very high, the overall performance of these applications is affected by the data transfer overhead. Moreover, as data sets are growing in size rapidly, bandwidth limitations pose a serious bottleneck in several scientific applications. Fast floating point compression can ameliorate the bandwidth limitations. If data is compressed well, then the amount of data transfer is reduced. This reduction in data transfer time comes at the expense of the increased computation required by compression and decompression. It is important for compression and decompression rates to be greater than the network bandwidth; otherwise, it will be faster to transmit uncompressed data directly [1]. Accelerators such as Graphics Processing Units (GPU) provide much computational power. In this paper, we show that the computational power of GPUs and CellBE processor can be harnessed to provide sufficiently fast compression and decompression for this approach to be effective for data produced by many practical applications. In particularly, we use Holt`s Exponential smoothing algorithm from time series analysis, and encode the difference between its predictions and the actual data. This yields a lossless compression scheme. We show that it can be implemented efficiently on GPUs and CellBE to provide an effective compression scheme for the purpose of saving on data transfer overheads.
Files and links (1)
CC BY V4.0, Open Access
Related links
Details
- Title
- Reducing the disk IO bandwidth bottleneck through fast floating point compression using accelerators
- Publication Details
- International Journal of Advanced Computer Research, Vol.4, pp.134-144
- Resource Type
- Journal article
- Publisher
- A C C E N T Social and Welfare Society; India
- Series
- 4
- Copyright
- Permission granted to the University of West Florida Libraries to digitize and/or display this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires the permission of the copyright holder. Creative Commons Attribution 4.0 International License.
- Identifiers
- 99380090600606600
- Academic Unit
- Hal Marcus College of Science and Engineering ; Computer Science
- Language
- English