The File Mover: An efficient data transfer system for grid applications

Cosimo Anglano; Massimo Canonico

The File Mover: An efficient data transfer system for grid applications

Department of Science and Technological Innovation

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

In this paper we present the File Mover, a data transfer system designed to optimize the transfer of potentially very large files. The File Mover relies on an overlay network architecture, where a set of machines cooperate in the transfer by forwarding among them portions of the files being transferred. Data transfer times are minimized by choosing, for each transfer, the set of relays that maximize the expected throughput. Preliminary experiments show that the File Mover is able to profitably exploit existing network paths not chosen by IP routing algorithms, thereby enhancing file transfer performance.

Original language	English
Title of host publication	2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004
Pages	625-632
Number of pages	8
Publication status	Published - 2004
Event	2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004 - Chicago, IL, United States Duration: 19 Apr 2004 → 22 Apr 2004

Publication series

Name	2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

Conference

Conference	2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004
Country/Territory	United States
City	Chicago, IL
Period	19/04/04 → 22/04/04

Cite this

@inproceedings{979dac83754142f3bf12bde35f204de5,

title = "The File Mover: An efficient data transfer system for grid applications",

abstract = "In this paper we present the File Mover, a data transfer system designed to optimize the transfer of potentially very large files. The File Mover relies on an overlay network architecture, where a set of machines cooperate in the transfer by forwarding among them portions of the files being transferred. Data transfer times are minimized by choosing, for each transfer, the set of relays that maximize the expected throughput. Preliminary experiments show that the File Mover is able to profitably exploit existing network paths not chosen by IP routing algorithms, thereby enhancing file transfer performance.",

author = "Cosimo Anglano and Massimo Canonico",

year = "2004",

language = "English",

isbn = "078038430X",

series = "2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004",

pages = "625--632",

booktitle = "2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004",

note = "2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004 ; Conference date: 19-04-2004 Through 22-04-2004",

}

Anglano, C & Canonico, M 2004, The File Mover: An efficient data transfer system for grid applications. in 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004, pp. 625-632, 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004, Chicago, IL, United States, 19/04/04.

The File Mover: An efficient data transfer system for grid applications. / Anglano, Cosimo ; Canonico, Massimo.
2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004. 2004. p. 625-632 (2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - The File Mover

T2 - 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

AU - Anglano, Cosimo

AU - Canonico, Massimo

PY - 2004

Y1 - 2004

N2 - In this paper we present the File Mover, a data transfer system designed to optimize the transfer of potentially very large files. The File Mover relies on an overlay network architecture, where a set of machines cooperate in the transfer by forwarding among them portions of the files being transferred. Data transfer times are minimized by choosing, for each transfer, the set of relays that maximize the expected throughput. Preliminary experiments show that the File Mover is able to profitably exploit existing network paths not chosen by IP routing algorithms, thereby enhancing file transfer performance.

AB - In this paper we present the File Mover, a data transfer system designed to optimize the transfer of potentially very large files. The File Mover relies on an overlay network architecture, where a set of machines cooperate in the transfer by forwarding among them portions of the files being transferred. Data transfer times are minimized by choosing, for each transfer, the set of relays that maximize the expected throughput. Preliminary experiments show that the File Mover is able to profitably exploit existing network paths not chosen by IP routing algorithms, thereby enhancing file transfer performance.

UR - https://www.scopus.com/pages/publications/4544259891

M3 - Conference contribution

AN - SCOPUS:4544259891

SN - 078038430X

T3 - 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

SP - 625

EP - 632

BT - 2004 IEEE International Symposium on Cluster Computing and the Grid, CCGrid 2004

Y2 - 19 April 2004 through 22 April 2004

ER -

The File Mover: An efficient data transfer system for grid applications

Abstract

Publication series

Conference

Other files and links

Fingerprint

Cite this