Skip to main content
SpringerLink
Log in

Kani: a QoS-aware hypervisor-level scheduler for cloud computing environments

  • Published:
Cluster Computing Aims and scope Submit manuscript

Abstract

Cloud computing environments (CCEs) are expected to deliver their services with qualities in service level agreements. On the other hand, they typically employ virtualization technology to consolidate multiple workloads on the same physical machine, thereby enhancing the overall utilization of physical resources. Most existing virtualization technologies are, however, unaware of their delivered quality of services (QoS). For example, the Xen hypervisor merely focuses on fair sharing of processor resources. We believe that CCEs have got married with traditional virtualization technologies without many traits in common. To bridge the gap between these two technologies, we have designed and implemented Kani, a QoS-aware hypervisor-level scheduler. Kani dynamically monitors the quality of delivered services to quantify the deviation between desired and delivered levels of QoS. Using this information, Kani determines how to allocate processor resources among running VMs so as to meet the expected QoS. Our evaluations of Kani scheduler prototype in Xen show that Kani outperforms the default Xen scheduler namely the Credit scheduler. For example, Kani reduces the average response time to requests to an Apache web server by up to \(93.6\,\%\); improves its throughput by up to \(97.9\,\%\); and mitigates the call setup time of an Asterisk media server by up to \(96.6\,\%\).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20

Similar content being viewed by others

References

  1. Abdelmaboud, A., Jawawi, D.N.A., Ghani, I., Elsafi, A., Kitchenham, B.: Quality of service approaches in cloud computing: a systematic mapping study. J. Syst. Softw. 101(3), 159–179 (2015)

    Article  Google Scholar 

  2. Ardagna, D., Casale, G., Ciavotta, M., Ciavotta, J.F., Wang, W.: Quality-of-Service in cloud computing: modeling techniques and their applications. J. Internet Ser. Appl. 5(1), 1–7 (2014)

    Article  Google Scholar 

  3. Halboob, W., Abbas, H., et al.: A framework to address inconstant user requirements in cloud SLAs management. Cluster Comput. 18(1), 123–133 (2015)

    Article  Google Scholar 

  4. Nathuji, R., Kansal, A., Ghaffarkhah, A.: Q-Clouds: managing performance interference effects for QoS-Aware clouds. In: Proceedings of the 5th European conference on computer systems. pp. 237–250. Paris (2010)

  5. Xu, C., Gamage, S., Rao, P.N., Kangarlou, A., Kompella, R.R., Xu, D.: vSlicer: latency-aware virtual machine scheduling via differentiated frequency CPU slicing. In: Proceedings of the 21st ACM international symposium on high-performance parallel and distributed computing (HPDC ’12). pp 3–14. Delft (2012)

  6. Xu, C., Gamage, S., Lu H.: vTurbo: accelerating virtual machine I/O processing using designated Turbo-Sliced core. In: USENIX ATC’13 proceedings of the 2013 USENIX conference on annual technical conference. pp. 243–254 (2013)

  7. Gamage, S., Xu, C., Kompella, R.R., Xu, D.: vPipe: piped I/O offloading for efficient data movement in vrtualized clouds. In: Proceedings of the ACM Symposium on Cloud Computing. pp. 1–13. Seattle (2014)

  8. Xiao, Z., Chen, Q., Luo, H.: Automatic scaling of internet applications for cloud computing services. IEEE Trans. Comput. 63(5), 1111–1123 (2012)

    MATH  MathSciNet  Google Scholar 

  9. Herbst, N.R., Kounev, S., Reussner, R.: Elasticity in cloud computing: what it is, and what it is. In: USENIX 10th international conference on autonomic computing (ICAC 2013). pp. 23–27. San Jose (2013)

  10. Lee, M., Krishnakumar, A.S., Krishnan P., Singh N., Yajnik S.: XenTune: Detecting Xen scheduling bottlenecks for media applications. In: Global telecommunications conference (GLOBECOM). pp. 1–6. Miami (2010)

  11. Zeng, L., Wang Y., Shi W., Feng D.: An improved Xen credit scheduler for I/O latency-sensitive applications on multicores. In: International conference on cloud computing and big data (CloudCom-Asia), pp. 267–274. Fuzhou (2013)

  12. Ongaro, D., Cox, A.L., Rixner, S.: Scheduling I/O in virtual machine monitor. In: Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on virtual execution environments. pp. 1–10. Seattle (2008)

  13. Dehsangi, M., Asyabi, E., Sharifi, M., Azhari, S.V.: cCluster: a core clustering mechanism for workload-aware virtual machine scheduling. In: 3rd international conference on future internet of things and cloud (FiCloud). pp. 248–255. Rome (2015)

  14. Al-Ayyoub, M., Jararweh, Y., Daraghmeh, M., Althebyan, Q.: Multi-agent based dynamic resource provisioning and monitoring for cloud computing systems infrastructure. Cluster Comput. 18(2), 919–932 (2015)

    Article  Google Scholar 

  15. Credit SchedulerXen: http://wiki.xenproject.org/wiki/Credit_Scheduler. Accessed Oct 2015

  16. Zhou, L., Wu, S., Shi, X., Jin, H., Zhou, J.: Guaranteeing QoS of media-based applications in virtualized environment. New Rev. Hypermedia Multimedia 19(3—-4), 217–233 (2013)

    Article  Google Scholar 

  17. Kim, H., Jeong, J., Hwang, J., Lee J., Maeng S.: Scheduler support for video-oriented multimedia on client side virtualization. In: Proceedings of the 3rd multimedia systems conference. pp. 65–76. Chapel Hill (2012)

  18. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield A.: Xen and the art of virtualization. In: Proceedings of the nineteenth ACM symposium on operating systems principles (SOSP). pp. 164–177. (2003)

  19. Lee, M., Krishnakumar, A.S., Krishnan, P., Singh, N., Yajnik S.: Supporting soft real-time tasks in the Xen hypervisor. In: Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on virtual execution environments (VEE), pp. 97–108. Pittsburgh (2010)

  20. Xi, S., Wilson, J., Lu, C., Gill C.: RT-Xen: towards real-time hypervisor scheduling in Xen. In: Proceedings of the IEEE international conference on embedded software (EMSOFT). pp. 39–48. Taipei, Taiwan (2011)

  21. Liu, X., Tong, W., Shen, C.: QoS-aware I/O schedule for virtual machines in cloud computing environment. In: Seventh international conference on innovative mobile and internet services in ubiquitous computing. pp. 267–274. Taichung (2013)

  22. Tcpdump: http://www.tcpdump.org. Accessed Oct 2015

  23. Beloglazov, Anton, Buyya, R.: Managing overloaded PMs for dynamic consolidation of virtual machines in cloud data centers under quality of service constraints. IEEE Trans. Parallel Distrib. Syst. 24(7), 1366–1379 (2013)

    Article  Google Scholar 

  24. Asyabi, E., Sharifi, M.: A new approach for dynamic virtual machine consolidation in cloud data centers. Int. J. Mod. Educ. Comput. Sci. 7(4), 61–66 (2015)

    Article  Google Scholar 

  25. Olio, A.: http://incubator.apache.org/olio. Accessed Oct 2015

  26. Sobel, W. et al.: Cloudstone: multi-platform multi-language benchmark and measurement tools for web 2.0. In: Proceedings of Cloud Computing and its Applications (2008)

  27. SIPp traffic generator: http://sipp.sourceforge.net. Accessed Oct 2015

  28. Asterisk Media Server: http://www.asterisk.org. Accessed Oct 2015

  29. SysBench Benchmark: https://github.com/akopytov/sysbench. Accessed Oct 2015

  30. Lookbusy Synthetic Load Generator: http://www.devin.com/lookbusy. Accessed Oct 2015

Download references

Author information

Authors and Affiliations

  1. School of Computer Engineering, Iran University of Science and Technology, Tehran, Iran

    Esmail Asyabi, Azadeh Azhdari, Mostafa Dehsangi, Michel Gokan Khan, Mohsen Sharifi & Sayed Vahid Azhari

Authors
  1. Esmail Asyabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Azadeh Azhdari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mostafa Dehsangi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Michel Gokan Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Mohsen Sharifi
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Sayed Vahid Azhari
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Esmail Asyabi.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Asyabi, E., Azhdari, A., Dehsangi, M. et al. Kani: a QoS-aware hypervisor-level scheduler for cloud computing environments. Cluster Comput 19, 567–583 (2016). https://doi.org/10.1007/s10586-016-0541-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10586-016-0541-5

Keywords

Search

Navigation