Determining the optimal protocols for transfer of large data files
| dc.contributor.author | van Rooyen, Andrew | |
| dc.date.accessioned | 2016-09-01T09:37:16Z | |
| dc.date.available | 2016-09-01T09:37:16Z | |
| dc.date.issued | 2015 | |
| dc.date.updated | 2016-08-31T09:08:12Z | |
| dc.description.abstract | The transfer of large data files remains a necessity for scientific research, including Bioinformatics, despite alternate solutions like cloud computing. When transferring large files, there are many transfer protocols to choose from. In this paper, a lightweight testbed is developed and used to test the SCP, FTP, HPN-SCP and GridFTP protocols for transfer of large files between the Universities of Cape Town and the Western Cape. A comparison of GridFTP’s ‘UDT’ mode (built on UDP) and its default mode is also done using the same testbed. We investigate the effect of a congested network on transfers. Speed and data efficiency are compared on a stable network to determine if any one protocol is significantly better than the rest. We find that for network speeds of around 200Mbit/s, the protocols achieve very similar speeds. The TCP based protocols achieved very similar efficiency, while GridFTP in UDT mode had much higher overhead. | |
| dc.identifier.apacitation | 2015. <i>Determining the optimal protocols for transfer of large data files.</i> http://hdl.handle.net/11427/21639 | en_ZA |
| dc.identifier.chicagocitation | . 2015. <i>Determining the optimal protocols for transfer of large data files.</i> http://hdl.handle.net/11427/21639 | en_ZA |
| dc.identifier.citation | Andrew van Rooyen.. (Dec 2015). Determining the optimal protocols for transfer of large data files, | |
| dc.identifier.ris | TY - AU - van Rooyen, Andrew AB - The transfer of large data files remains a necessity for scientific research, including Bioinformatics, despite alternate solutions like cloud computing. When transferring large files, there are many transfer protocols to choose from. In this paper, a lightweight testbed is developed and used to test the SCP, FTP, HPN-SCP and GridFTP protocols for transfer of large files between the Universities of Cape Town and the Western Cape. A comparison of GridFTP’s ‘UDT’ mode (built on UDP) and its default mode is also done using the same testbed. We investigate the effect of a congested network on transfers. Speed and data efficiency are compared on a stable network to determine if any one protocol is significantly better than the rest. We find that for network speeds of around 200Mbit/s, the protocols achieve very similar speeds. The TCP based protocols achieved very similar efficiency, while GridFTP in UDT mode had much higher overhead. DA - 2015 DB - OpenUCT DP - University of Cape Town LK - https://open.uct.ac.za PB - University of Cape Town PY - 2015 T1 - Determining the optimal protocols for transfer of large data files TI - Determining the optimal protocols for transfer of large data files UR - http://hdl.handle.net/11427/21639 ER - | en_ZA |
| dc.identifier.uri | http://hdl.handle.net/11427/21639 | |
| dc.identifier.vancouvercitation | . 2015. <i>Determining the optimal protocols for transfer of large data files.</i> http://hdl.handle.net/11427/21639 | en_ZA |
| dc.language.iso | eng | |
| dc.publisher.department | Department of Computer Science | en_ZA |
| dc.publisher.faculty | Faculty of Science | en_ZA |
| dc.publisher.institution | University of Cape Town | |
| dc.title | Determining the optimal protocols for transfer of large data files | |
| dc.type | Other | |
| dc.type.qualificationlevel | Hounors | |
| uct.type.filetype | Text | |
| uct.type.filetype | Image | |
| uct.type.publication | Dissertation |