[CPCC] Seminar
Hamid Jafarkhani
hamidj at uci.edu
Fri Dec 2 17:43:31 PST 2011
Seminar: “Efficient Inter-Datacenter Bulk Transfers with NetStitcher”
Nikos Laoutaris
Telefonica Research, Barcelona, Spain
Monday, December 5th, 2011
11:00-12:00pm, EH 2430 (Colloquium room)
Host: Athina Markopoulou
Abstract
Large datacenter operators with sites at multiple locations dimension
their key resources according to the peak demand of the geographic area
that each site covers. The demand of specific areas follows strong diurnal
patterns with high peak to valley ratios that result in poor average
utilization across a day. In this paper, we show how to rescue unutilized
bandwidth across multiple datacenters and backbone networks and use it for
non-real-time applications, such as backups, propagation of bulky updates,
and migration of data that improve fault tolerance, end-user experience,
and energy/personnel costs. Achieving the above is non-trivial since
leftover bandwidth appears at different times, for different durations,
and at different places in the world.
For this purpose, we have designed, implemented, and validated
NetStitcher, a system that employs a network of storage nodes to stitch
together Unutilized bandwidth, whenever and wherever it exists. It gathers
information about leftover resources, uses a store-and-forward algorithm
to schedule data transfers, and adapts to resource fluctuations.
We have compared NetStitcher with other bulk transfer mechanisms such as
direct transfer, multipath forwarding, and naive store-and-forward using
both a testbed and a live deployment on a real CDN. Our evaluation shows
that NetStitcher outperforms all other mechanisms and can rescue up to
five times additional datacenter bandwidth thus making it a valuable tool
for datacenter providers. Our live CDN deployment demonstrates that our
solution can perform large data transfers at a much lower cost than naive
end-to-end or store-and-forward schemes.
Speaker’s Bio
Nikolaos Laoutaris is a senior researcher at the Internet research group
of Telefonica Research in Barcelona. Prior to joining the Barcelona lab he
was a postdoc fellow at Harvard University and a Marie Curie postdoc
fellow at Boston University. He got his PhD in computer science from the
University of Athens in 2004. His general research interests are on
system, algorithmic, and performance evaluation aspects of computer
networks and distributed systems. Current projects include: Efficient
inter-datacenter bulk transfers, energy-efficient distributed system
design, content distribution for long tail content, transparent scaling
of social networks, pricing of broadband services and ISP interconnection
economics.
More information about the CPCC
mailing list