Please use this identifier to cite or link to this item:
Title: Bejo: Behavior based job classification for resource consumption prediction in the cloud
Authors: Xu, L
Cao, J 
Wang, Y
Yang, L
Li, J
Keywords: Bag of words (BoW)
Job classification
Resource consumption pattern
Resource prediction
Sparse coding
Issue Date: 2015
Publisher: IEEE Computer Society
Source: Proceedings of the International Conference on Cloud Computing Technology and Science, CloudCom, 2015, 7037642, p. 10-17 How to cite?
Abstract: Resource prediction (e.g. CPU/memory utilization) of cloud computing jobs has attracted substantial amount of attention. Existing works use regression methods based on historical information of jobs, with an impractical assumption that the job to be predicted has the same class as the historical jobs. To address this problem, we propose to take the category of the jobs into consideration for effective resource prediction. Existing works on job classification either ignores the temporal variance of resource consumption during job execution or use it in a naive way, resulting in unsatisfactory classification accuracy and/or slow speed. In this paper, we introduce a new and efficient job classification approach, called Bejo. Inspired by the textual document classification methods, which use distribution of text words to describe and classify a document, Bejo treats the job as a document, assigns each collected resource consumption snapshot to a certain 'resource word', and uses the distribution of the words to describe and classify a job. An l1 norm minimization formulation is used to assign each resource snapshot to a resource word, to especially address the unique challenges of high noise and tight time budget of cloud job classification. We collect a comprehensive dataset for job classification and resource consumption prediction on cloud platforms, and demonstrate superior quality and efficiency of Bejo over state-of-the-art algorithms. Experiments also show the relative error of resource consumption prediction can be dramatically reduced by adding an extra job classification step to the existing regression methods.
Description: 2014 6th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2014, 15-18 December 2014
ISSN: 2330-2194
DOI: 10.1109/CloudCom.2014.48
Appears in Collections:Conference Paper

View full-text via PolyU eLinks SFX Query
Show full item record


Last Week
Last month
Citations as of Feb 19, 2019


Last Week
Last month
Citations as of Feb 18, 2019

Page view(s)

Last Week
Last month
Citations as of Feb 18, 2019

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.