Abstract
Cloud computing environments (CCEs) are expected to deliver their services with qualities in service level agreements. On the other hand, they typically employ virtualization technology to consolidate multiple workloads on the same physical machine, thereby enhancing the overall utilization of physical resources. Most existing virtualization technologies are, however, unaware of their delivered quality of services (QoS). For example, the Xen hypervisor merely focuses on fair sharing of processor resources. We believe that CCEs have got married with traditional virtualization technologies without many traits in common. To bridge the gap between these two technologies, we have designed and implemented Kani, a QoS-aware hypervisor-level scheduler. Kani dynamically monitors the quality of delivered services to quantify the deviation between desired and delivered levels of QoS. Using this information, Kani determines how to allocate processor resources among running VMs so as to meet the expected QoS. Our evaluations of Kani scheduler prototype in Xen show that Kani outperforms the default Xen scheduler namely the Credit scheduler. For example, Kani reduces the average response time to requests to an Apache web server by up to \(93.6\,\%\); improves its throughput by up to \(97.9\,\%\); and mitigates the call setup time of an Asterisk media server by up to \(96.6\,\%\).
Similar content being viewed by others
References
Abdelmaboud, A., Jawawi, D.N.A., Ghani, I., Elsafi, A., Kitchenham, B.: Quality of service approaches in cloud computing: a systematic mapping study. J. Syst. Softw. 101(3), 159–179 (2015)
Ardagna, D., Casale, G., Ciavotta, M., Ciavotta, J.F., Wang, W.: Quality-of-Service in cloud computing: modeling techniques and their applications. J. Internet Ser. Appl. 5(1), 1–7 (2014)
Halboob, W., Abbas, H., et al.: A framework to address inconstant user requirements in cloud SLAs management. Cluster Comput. 18(1), 123–133 (2015)
Nathuji, R., Kansal, A., Ghaffarkhah, A.: Q-Clouds: managing performance interference effects for QoS-Aware clouds. In: Proceedings of the 5th European conference on computer systems. pp. 237–250. Paris (2010)
Xu, C., Gamage, S., Rao, P.N., Kangarlou, A., Kompella, R.R., Xu, D.: vSlicer: latency-aware virtual machine scheduling via differentiated frequency CPU slicing. In: Proceedings of the 21st ACM international symposium on high-performance parallel and distributed computing (HPDC ’12). pp 3–14. Delft (2012)
Xu, C., Gamage, S., Lu H.: vTurbo: accelerating virtual machine I/O processing using designated Turbo-Sliced core. In: USENIX ATC’13 proceedings of the 2013 USENIX conference on annual technical conference. pp. 243–254 (2013)
Gamage, S., Xu, C., Kompella, R.R., Xu, D.: vPipe: piped I/O offloading for efficient data movement in vrtualized clouds. In: Proceedings of the ACM Symposium on Cloud Computing. pp. 1–13. Seattle (2014)
Xiao, Z., Chen, Q., Luo, H.: Automatic scaling of internet applications for cloud computing services. IEEE Trans. Comput. 63(5), 1111–1123 (2012)
Herbst, N.R., Kounev, S., Reussner, R.: Elasticity in cloud computing: what it is, and what it is. In: USENIX 10th international conference on autonomic computing (ICAC 2013). pp. 23–27. San Jose (2013)
Lee, M., Krishnakumar, A.S., Krishnan P., Singh N., Yajnik S.: XenTune: Detecting Xen scheduling bottlenecks for media applications. In: Global telecommunications conference (GLOBECOM). pp. 1–6. Miami (2010)
Zeng, L., Wang Y., Shi W., Feng D.: An improved Xen credit scheduler for I/O latency-sensitive applications on multicores. In: International conference on cloud computing and big data (CloudCom-Asia), pp. 267–274. Fuzhou (2013)
Ongaro, D., Cox, A.L., Rixner, S.: Scheduling I/O in virtual machine monitor. In: Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on virtual execution environments. pp. 1–10. Seattle (2008)
Dehsangi, M., Asyabi, E., Sharifi, M., Azhari, S.V.: cCluster: a core clustering mechanism for workload-aware virtual machine scheduling. In: 3rd international conference on future internet of things and cloud (FiCloud). pp. 248–255. Rome (2015)
Al-Ayyoub, M., Jararweh, Y., Daraghmeh, M., Althebyan, Q.: Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure. Cluster Comput. 18(2), 919–932 (2015)
Credit SchedulerXen: http://wiki.xenproject.org/wiki/Credit_Scheduler. Accessed Oct 2015
Zhou, L., Wu, S., Shi, X., Jin, H., Zhou, J.: Guaranteeing QoS of media-based applications in virtualized environment. New Rev. Hypermedia Multimedia 19(3—-4), 217–233 (2013)
Kim, H., Jeong, J., Hwang, J., Lee J., Maeng S.: Scheduler support for video-oriented multimedia on client side virtualization. In: Proceedings of the 3rd multimedia systems conference. pp. 65–76. Chapel Hill (2012)
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield A.: Xen and the art of virtualization. In: Proceedings of the nineteenth ACM symposium on operating systems principles (SOSP). pp. 164–177. (2003)
Lee, M., Krishnakumar, A.S., Krishnan, P., Singh, N., Yajnik S.: Supporting soft real-time tasks in the Xen hypervisor. In: Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on virtual execution environments (VEE), pp. 97–108. Pittsburgh (2010)
Xi, S., Wilson, J., Lu, C., Gill C.: RT-Xen: towards real-time hypervisor scheduling in Xen. In: Proceedings of the IEEE international conference on embedded software (EMSOFT). pp. 39–48. Taipei, Taiwan (2011)
Liu, X., Tong, W., Shen, C.: QoS-aware I/O schedule for virtual machines in cloud computing environment. In: Seventh international conference on innovative mobile and internet services in ubiquitous computing. pp. 267–274. Taichung (2013)
Tcpdump: http://www.tcpdump.org. Accessed Oct 2015
Beloglazov, Anton, Buyya, R.: Managing overloaded PMs for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Trans. Parallel Distrib. Syst. 24(7), 1366–1379 (2013)
Asyabi, E., Sharifi, M.: A new approach for dynamic virtual machine consolidation in cloud data centers. Int. J. Mod. Educ. Comput. Sci. 7(4), 61–66 (2015)
Olio, A.: http://incubator.apache.org/olio. Accessed Oct 2015
Sobel, W. et al.: Cloudstone: multi-platform multi-language benchmark and measurement tools for web 2.0. In: Proceedings of Cloud Computing and its Applications (2008)
SIPp traffic generator: http://sipp.sourceforge.net. Accessed Oct 2015
Asterisk Media Server: http://www.asterisk.org. Accessed Oct 2015
SysBench Benchmark: https://github.com/akopytov/sysbench. Accessed Oct 2015
Lookbusy Synthetic Load Generator: http://www.devin.com/lookbusy. Accessed Oct 2015
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Asyabi, E., Azhdari, A., Dehsangi, M. et al. Kani: a QoS-aware hypervisor-level scheduler for cloud computing environments. Cluster Comput 19, 567–583 (2016). https://doi.org/10.1007/s10586-016-0541-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-016-0541-5