Mario A. Sánchez
ABSTRACT
The risk of placing an undesired load on networks and networked services through probes originating from measurement platforms has always been present. While several scheduling schemes have been proposed to avoid undue loads or DDoS-like effects from uncontrolled experiments, the motivation scenarios for such schemes have generally been considered "sufficiently unlikely" and safely ignored by most existing measurement platforms. We argue that the growth of large, crowdsourced measurement systems means we cannot ignore this risk any longer.
In this paper we expand on our original lease-based coordination scheme designed for measurement platforms that embrace crowdsourcing as their method-of-choice. We compare it with two alternative strategies currently implemented by some of the existing crowdsourced measurement platforms: centralized rate-limiting and individual rate limiting. Our preliminary results show that our solution outperforms these two naive strategies for coordination according to at least two different intuitive metrics: resource utilization and bound compliance. We find that our scheme efficiently allows the scalable and effective coordination of measurements among potentially thousands of hosts while providing individual clients with enough flexibility to act on their own.
- Caida. Ark. http://www.caida.org/projects/ark/.Google Scholar
- Calyam, P., Kumarasamy, L., and Ozguner, F. Semantic scheduling of active measurements for meeting network monitoring objectives. In Proc. of CNSM (2010), IEEE.Google ScholarCross Ref
- Calyam, P., Lee, C.-G., Arava, P. K., and Krymskiy, D. Enhanced EDF Scheduling Algorithms for Orchestrating Network-Wide Active Measurements. In Proc. of RTSS (2005), IEEE Computer Society. Google ScholarDigital Library
- Cappos, J., Beschastnikh, I., Krishnamurthy, A., and Anderson, T. Seattle: a platform for educational cloud computing. In Proc. of the 40th ACM technical symposium on Computer science education (2009), SIGCSE '09. Google ScholarDigital Library
- Gray, C. G., and Cheriton, D. R. Leases: An Efficient Fault-Tolerant Mechanism for Distributed File Cache Consistency. In Proc. ACM SOSP (1989). Google ScholarDigital Library
- Hunt, P., Konar, M., Junqueira, F. P., and Reed, B. ZooKeeper: wait-free coordination for Internet-scale systems. In Proc. USENIX ATC (2010). Google ScholarDigital Library
- Kumar, N. D., Monrose, F., and Reiter, M. K. Towards Optimized Probe Scheduling for Active Measurement Studies. In Proc. of ICIMP (2011).Google Scholar
- PlanetLab. PlanetLab. http://www.planet-lab.org/.Google Scholar
- Qin, Z., Rojas-Cessa, R., and Ansari, N. Task-execution scheduling schemes for network measurement and monitoring. Computer Communications 33 (2010). Google ScholarDigital Library
- Sánchez, M. A., Otto, J. S., Bischof, Z. S., Choffnes, D. R., Bustamante, F. E., Krishnamurthy, B., and Willinger, W.Google Scholar
- Sánchez, M. A., Otto, J. S., Bischof, Z. S., Choffnes, D. R., Bustamante, F. E., Krishnamurthy, B., and Willinger, W. Dasu: Pushing experiments to the Internet's edge. In Proc. of USENIX NSDI (2013). Google ScholarDigital Library
- Shavitt, Y., and Shir, E. DIMES: Let the Internet measure itself. SIGCOMM Comput. Commun. Rev. 35, 5 (October 2005). Google ScholarDigital Library
- Wen, Z., Triukose, S., and Rabinovich, M. Facilitating Focused Internet Measurements. In Proc. ACM SIGMETRICS (2007), ACM. Google ScholarDigital Library
Index Terms
- Experiment Coordination for Large-scale Measurement Platforms
Recommendations
Standardizing large-scale measurement platforms
Over the last few years, we have witnessed the deployment of large measurement platforms that enable measurements from many vantage points. Examples of these platforms include SamKnows and RIPE ATLAS. All told, there are tens of thousands of measurement ...
Large-scale three-dimensional measurement based on LED marker tracking
This paper presents a three-dimensional (3-D) measurement method of large-scale objects by integrating a 3-D scanner and a stereo tracker. To measure a large-scale object, some high-brightness light-emitting diode (LED) lights are rigidly connected to ...
Large Scale Enterprise Information System Architectures and Coordination Methods
ICEE '12: Proceedings of the 2012 3rd International Conference on E-Business and E-Government - Volume 03The large scale enterprise information systems are usually consisted of many subsystems or modules. Coordination among subsystems or modules is an important problem in developing and integrating information systems. In this paper, we classify ...
Comments