















































Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
Combine error traffic for multiple groups within intersections, while conserving: Coherent, tunable per-group overhead: Ratio of data.
Typology: Exercises
1 / 55
This page cannot be seen from the preview
Don't miss anything!
Motivation Systems Roadmap
A-Exam
Mahesh Balakrishnan 1 (^1) Department of Computer Science Cornell University
Motivation Systems Roadmap
(^1) Motivation
(^2) Systems Ricochet PLATO Others
(^3) Roadmap
Motivation Systems Roadmap
Multicast is ubiquitous in the Datacenter... ... hidden under abstractions/middleware such as: Publish-Subscribe Eventing Replicated Data/Functionality In-memory Caching BEA Weblogic, JBoss, Tibco, RTI DDS, Tangosol, Gemfire...
Motivation Systems Roadmap
Mission-Critical: Finance, Aerospace, Military Scalability, Availability, Fault-Tolerance... Timeliness! Examples: Real-time automated trading Air-traffic Control System Foobooks.com?
Systems Roadmap PLATO Others
(^1) Motivation
(^2) Systems Ricochet PLATO Others
(^3) Roadmap
Systems Roadmap PLATO Others
Many different reliable, scalable protocols Designed for streaming video/TV, file distribution Reliable: Packet Loss at WAN Routers, overlay node failures Scalable: Single group with massive numbers of receivers Not suited for datacenter multicast! Different failure mode Different scalability dimensions
Systems Roadmap PLATO Others
Financial Datacenter Example: Each equity is mapped to a multicast group. Each Node is interested in a different set of equities... ... each Node joins a different set of groups.
Tracking S&P 500 Tracking Portfolio
Lots of overlapping groups =⇒ Low per-group data rate.
Systems Roadmap PLATO Others
Wanted: A reliable, scalable multicast protocol. Reliable: can tolerate end-host loss bursts Scalable: the size of the group the number of senders to a group the number of groups per node
Systems Roadmap PLATO Others
Wanted: A reliable, scalable multicast protocol. Reliable: can tolerate end-host loss bursts Scalable: the size of the group the number of senders to a group the number of groups per node
Systems Roadmap PLATO Others
How does latency scale?
Two Phases: Discovery and Recovery of Lost Packets ACK/timeout: RMTP/RMTP-II Gossip-based: Bimodal Multicast, lpbcast NAK/sender-based sequencing: SRM Forward Error Correction Fundamental Insight: latencyα (^) datarate^1
Systems Roadmap PLATO Others
Pros: Tunable, Proactive Overhead Time-Critical: Eliminates need for retransmission Cons: FEC packets are generated over a stream of data Have to wait for r data packets before generating FEC latencyα (^) datarate^1 data rate: at a single sender, in a single group
Systems Roadmap PLATO Others
Randomness: Each Receiver picks another Receiver randomly to send XOR to Tunability: Percentage of XOR packets to data is determined by rate-of-fire (r , c) latencyα (^) datarate^1 data rate: across all senders, in a single group
Data Data Lost Data
XOR
XOR
Systems Roadmap PLATO Others
Randomness: Each Receiver picks another Receiver randomly to send XOR to Tunability: Percentage of XOR packets to data is determined by rate-of-fire (r , c) latencyα (^) datarate^1 data rate: across all senders, in a single group
Data Data Lost Data
XOR
XOR
Systems Roadmap PLATO Others
Randomness: Each Receiver picks another Receiver randomly to send XOR to Tunability: Percentage of XOR packets to data is determined by rate-of-fire (r , c) latencyα (^) datarate^1 data rate: across all senders, in a single group
E D C B Kernel BufferA
F
F E Kernel BufferD
B C App Buffer App Buffer