In this paper, we first explore the various fundamental bottlenecks of TCP that impair conventional network file systems and transfer protocols, and then introduce in contrast the design principles of an innovative, patented data transport technology, Aspera fasp], as a solution capable of moving petabyte data on a daily basis.
The paper first summarizes the fundamental performance limitations of TCP including its congestion control and reliability; we further extend the discussion beyond the traditional domain of the wide area network and focus attention on the “last foot” of this data movement; and we conclude with a series of multi-Gbps wide area transfer benchmarks with five major storage vendors, for data transfer across storage area network (SAN), local area network (LAN), and wide area networks (WAN) between distant storage appliances, and explain the key engineering practices learned to maximize the transmission speed and efficiency.
These systems demonstrate how Aspera fasp can be used as a next-generation bulk data transport between distributed scalable storage appliances and open a high-speed artery between data centers. For business this will dramatically improve the workflow efficiency in the industries that rely on high-speed file transfer, replication, or synchronization, and help make possible the promised “virtual data center” serving large data to clients and applications at global distances.