A comparative evaluation of high-performance file transfer systems for data-intensive grid applications

Cosimo Anglano; Massimo Canonico

A comparative evaluation of high-performance file transfer systems for data-intensive grid applications

Department of Science and Technological Innovation

Research output: Contribution to journal › Conference article › peer-review

Abstract

The ability of transferring very large files in the shortest amount of time is crucial for data-intensive Grid applications. Experimental evidence has shown that the mere availability of high-capacity wide-area networks is not sufficient to obtain adequate performance if vanilla TCP is used to transport data. Consequently, many alternative solutions are being explored, and a variety of data transfer tools have appeared. In this paper we experimentally compare some of these tools in various network scenarios. Our results show that solutions based on UDP, adopting rate-based algorithms, result in better performance than other alternatives in most cases, while solutions based on TCP are effective only under specific circumstances.

Original language	English
Pages (from-to)	283-288
Number of pages	6
Journal	Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE
Volume	13
Publication status	Published - 2004
Event	Proceedings - Thirteenth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2004 - Modena, Italy Duration: 14 Jun 2004 → 16 Jun 2004

Keywords

Data-intensive Grid applications
File transfer tools
High Bandwidth-Delay-Product Networks
PlanetLab
TCP and UDP

Cite this

@article{5df0900135da4c40a1cc999142fac8b0,

title = "A comparative evaluation of high-performance file transfer systems for data-intensive grid applications",

abstract = "The ability of transferring very large files in the shortest amount of time is crucial for data-intensive Grid applications. Experimental evidence has shown that the mere availability of high-capacity wide-area networks is not sufficient to obtain adequate performance if vanilla TCP is used to transport data. Consequently, many alternative solutions are being explored, and a variety of data transfer tools have appeared. In this paper we experimentally compare some of these tools in various network scenarios. Our results show that solutions based on UDP, adopting rate-based algorithms, result in better performance than other alternatives in most cases, while solutions based on TCP are effective only under specific circumstances.",

keywords = "Data-intensive Grid applications, File transfer tools, High Bandwidth-Delay-Product Networks, PlanetLab, TCP and UDP",

author = "Cosimo Anglano and Massimo Canonico",

year = "2004",

language = "English",

volume = "13",

pages = "283--288",

journal = "Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE",

issn = "1524-4547",

publisher = "IEEE Computer Society",

note = "Proceedings - Thirteenth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2004 ; Conference date: 14-06-2004 Through 16-06-2004",

}

TY - JOUR

T1 - A comparative evaluation of high-performance file transfer systems for data-intensive grid applications

AU - Anglano, Cosimo

AU - Canonico, Massimo

PY - 2004

Y1 - 2004

N2 - The ability of transferring very large files in the shortest amount of time is crucial for data-intensive Grid applications. Experimental evidence has shown that the mere availability of high-capacity wide-area networks is not sufficient to obtain adequate performance if vanilla TCP is used to transport data. Consequently, many alternative solutions are being explored, and a variety of data transfer tools have appeared. In this paper we experimentally compare some of these tools in various network scenarios. Our results show that solutions based on UDP, adopting rate-based algorithms, result in better performance than other alternatives in most cases, while solutions based on TCP are effective only under specific circumstances.

AB - The ability of transferring very large files in the shortest amount of time is crucial for data-intensive Grid applications. Experimental evidence has shown that the mere availability of high-capacity wide-area networks is not sufficient to obtain adequate performance if vanilla TCP is used to transport data. Consequently, many alternative solutions are being explored, and a variety of data transfer tools have appeared. In this paper we experimentally compare some of these tools in various network scenarios. Our results show that solutions based on UDP, adopting rate-based algorithms, result in better performance than other alternatives in most cases, while solutions based on TCP are effective only under specific circumstances.

KW - Data-intensive Grid applications

KW - File transfer tools

KW - High Bandwidth-Delay-Product Networks

KW - PlanetLab

KW - TCP and UDP

UR - https://www.scopus.com/pages/publications/10444261336

M3 - Conference article

AN - SCOPUS:10444261336

SN - 1524-4547

VL - 13

SP - 283

EP - 288

JO - Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE

JF - Proceedings of the Workshop on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE

T2 - Proceedings - Thirteenth IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises, WET ICE 2004

Y2 - 14 June 2004 through 16 June 2004

ER -

A comparative evaluation of high-performance file transfer systems for data-intensive grid applications

Abstract

Keywords

Other files and links

Fingerprint

Cite this