Improving Flow Completion Time and Throughput in Data Center Networks

Abstract

Today, data centers host a wide variety of applications which generate a mix of diverse internal data center traffic. In a data center environment 90% of the traffic flows, though they constitute only 10% of the data carried around, are short flows with sizes up to a maximum of 1MB. The rest 10% constitute long flows with sizes in the range of 1MB to 1GB. Throughput matters for the long flows whereas short flows are latency sensitive. This thesis studies various data center transport mechanisms aimed at either improving flow completion time for short flows or throughput for long flows. Thesis puts forth two data center transport mechanisms: (1) for improving flow completion time for short flows (2) for improving throughput for long flows. The first data center transport mechanism proposed in this thesis, FA-DCTCP (Flow Aware DCTCP), is based on Data Center Transmission Control Protocol (DCTCP). DCTCP is a Transmission Control Protocol (TCP) variant for data centers pioneered by Microsoft, which is being deployed widely in data centers today. DCTCP congestion control algorithm treats short flows and long flows equally. This thesis demonstrate that, treating them differently by reducing the congestion window for short flows at a lower rate compared to long flows, at the onset of congestion, 99th percentile of flow completion time for short flows could be improved by up to 32.5%, thereby reducing their tail latency by up to 32.5%. As per data center traffic measurement studies, data center internal traffic often exhibit predefined patterns with respect to the traffic flow mix. The second data center transport mechanism proposed in this thesis shows that, insights into the internal data center traffic composition could be leveraged to achieve better throughput for long flows. The mechanism for the same is implemented by adopting the Software Defined Networking paradigm, which offers the ability to dynamically adapt network configuration parameters based on network observations. The proposed solution achieves up to 22% improvement in long flow throughput, by dynamically adjusting network element’s QoS configurations, based on the observed traffic pattern.