Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/19774
Title: Bejo: Behavior based job classification for resource consumption prediction in the cloud
Authors: Xu, L
Cao, J 
Wang, Y
Yang, L
Li, J
Keywords: Bag of words (BoW)
Job classification
Resource consumption pattern
Resource prediction
Sparse coding
Issue Date: 2015
Publisher: IEEE Computer Society
Source: Proceedings of the International Conference on Cloud Computing Technology and Science, CloudCom, 2015, 7037642, p. 10-17 How to cite?
Abstract: Resource prediction (e.g. CPU/memory utilization) of cloud computing jobs has attracted substantial amount of attention. Existing works use regression methods based on historical information of jobs, with an impractical assumption that the job to be predicted has the same class as the historical jobs. To address this problem, we propose to take the category of the jobs into consideration for effective resource prediction. Existing works on job classification either ignores the temporal variance of resource consumption during job execution or use it in a naive way, resulting in unsatisfactory classification accuracy and/or slow speed. In this paper, we introduce a new and efficient job classification approach, called Bejo. Inspired by the textual document classification methods, which use distribution of text words to describe and classify a document, Bejo treats the job as a document, assigns each collected resource consumption snapshot to a certain 'resource word', and uses the distribution of the words to describe and classify a job. An l1 norm minimization formulation is used to assign each resource snapshot to a resource word, to especially address the unique challenges of high noise and tight time budget of cloud job classification. We collect a comprehensive dataset for job classification and resource consumption prediction on cloud platforms, and demonstrate superior quality and efficiency of Bejo over state-of-the-art algorithms. Experiments also show the relative error of resource consumption prediction can be dramatically reduced by adding an extra job classification step to the existing regression methods.
Description: 2014 6th IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2014, 15-18 December 2014
URI: http://hdl.handle.net/10397/19774
ISSN: 2330-2194
DOI: 10.1109/CloudCom.2014.48
Appears in Collections:Conference Paper

Access
View full-text via PolyU eLinks SFX Query
Show full item record

SCOPUSTM   
Citations

1
Last Week
0
Last month
0
Citations as of Nov 30, 2017

Page view(s)

39
Last Week
6
Last month
Checked on Dec 11, 2017

Google ScholarTM

Check

Altmetric



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.