Fast online predictive compression of radio astronomy data
| dc.contributor.author | Hugo, Benjamin | |
| dc.date.accessioned | 2016-08-13T18:45:54Z | |
| dc.date.available | 2016-08-13T18:45:54Z | |
| dc.date.issued | 2013 | |
| dc.date.updated | 2016-08-13T18:25:43Z | |
| dc.description.abstract | This report investigates the fast, lossless compression of 32-bit single precision floating-point values. High speed compression is critical in the context of the MeerKAT radio telescope currently under construction in Southern Africa and Australia, which will produce data at rates up to 1 Petabyte every 20 seconds. The compression technique being investigated is based on predictive compression, which has proven successful at achieving high-speed compression in previous research. Several different predictive techniques (which includes polynomial extrapolation), along with CPU- and GPU-based parallelization approaches are discussed. The implementation successfully achieves throughput rates in excess of 6 GiB/s for compression and much higher rates for decompression using a 64-core AMD Opteron machine, achieving file-size reductions of, on average 9%. Furthermore the results of concurrent investigations into block-based parallel Huffman encoding and Zero-length Encoding are compared to the predictive scheme and it was found that the predictive scheme obtains approximately 4%-5% better compression ratios than the Zero-Length Encoder and is 25 times faster than Huffman encoding on an Intel Xeon E5 processor. The scheme may be well-suited to address the large network bandwidth requirements of the MeerKAT project. | en_ZA |
| dc.identifier.apacitation | Hugo, B. (2013). <i>Fast online predictive compression of radio astronomy data</i>. (ThesesThesis). University of Cape Town ,Unknown ,Computer Science. Retrieved from http://hdl.handle.net/11427/21225 | en_ZA |
| dc.identifier.chicagocitation | Hugo, Benjamin. <i>"Fast online predictive compression of radio astronomy data."</i> ThesesThesis., University of Cape Town ,Unknown ,Computer Science, 2013. http://hdl.handle.net/11427/21225 | en_ZA |
| dc.identifier.citation | Hugo, H. 2013. Fast online predictive compression of radio astronomy data. Honours Thesis. University of Cape Town. | en_ZA |
| dc.identifier.ris | TY - Thesis / Dissertation AU - Hugo, Benjamin AB - This report investigates the fast, lossless compression of 32-bit single precision floating-point values. High speed compression is critical in the context of the MeerKAT radio telescope currently under construction in Southern Africa and Australia, which will produce data at rates up to 1 Petabyte every 20 seconds. The compression technique being investigated is based on predictive compression, which has proven successful at achieving high-speed compression in previous research. Several different predictive techniques (which includes polynomial extrapolation), along with CPU- and GPU-based parallelization approaches are discussed. The implementation successfully achieves throughput rates in excess of 6 GiB/s for compression and much higher rates for decompression using a 64-core AMD Opteron machine, achieving file-size reductions of, on average 9%. Furthermore the results of concurrent investigations into block-based parallel Huffman encoding and Zero-length Encoding are compared to the predictive scheme and it was found that the predictive scheme obtains approximately 4%-5% better compression ratios than the Zero-Length Encoder and is 25 times faster than Huffman encoding on an Intel Xeon E5 processor. The scheme may be well-suited to address the large network bandwidth requirements of the MeerKAT project. DA - 2013 DB - OpenUCT DP - University of Cape Town LK - https://open.uct.ac.za PB - University of Cape Town PY - 2013 T1 - Fast online predictive compression of radio astronomy data TI - Fast online predictive compression of radio astronomy data UR - http://hdl.handle.net/11427/21225 ER - | en_ZA |
| dc.identifier.uri | http://hdl.handle.net/11427/21225 | |
| dc.identifier.vancouvercitation | Hugo B. Fast online predictive compression of radio astronomy data. [ThesesThesis]. University of Cape Town ,Unknown ,Computer Science, 2013 [cited yyyy month dd]. Available from: http://hdl.handle.net/11427/21225 | en_ZA |
| dc.language | eng | en_ZA |
| dc.publisher.department | Computer Science | en_ZA |
| dc.publisher.faculty | Unknown | en_ZA |
| dc.publisher.institution | University of Cape Town | en_ZA |
| dc.publisher.institution | University of Cape Town | |
| dc.title | Fast online predictive compression of radio astronomy data | en_ZA |
| dc.type | Master Thesis | |
| dc.type.qualificationlevel | Masters | |
| dc.type.qualificationname | Hons | en_ZA |
| uct.type.filetype | Text | |
| uct.type.filetype | Image | |
| uct.type.publication | Research | en_ZA |
| uct.type.resource | ThesesThesis | en_ZA |