A Machine Learning Approach to Live Migration Modeling

Authors: 
Changyeon Jo, Youngsu Cho, Bernhard Egger
Seoul National University

Summary: 
This paper proposed a machine learning approach to predict the system metrics for different VM migration algorithms. These system metrics are affected by migration algorithm, host machine status and user applications and feasible for machine learning approach. The prediction model takes 21 system/application input features (including which algorithm), and generates 6 metrics as the output. As a result, it can accurately estimate each metrics under different application, VM and algorithms. One of the application, the paper provide a semi-automated algorithm selection based on this machine learning model and user-provided SLA (service level agreements) constraints.

Questions about Machine Learning: 
Why machine learning is applied:
The combination of algorithm, VM status and current running applications status, is a huge searching space.

Machine learning features:
which algorithm, 20 features to describe: user applications (CPU, memory, networking usage), source and destination VM utility and etc.

Machine learning outputs:
6 features prediction results: migration time, transferred data, downtime, performance degradation, CPU and Memory utilization.

Machine learning application:
semi-automated migration algorithm selection

Strength: 
1. This paper is very clear for the readers: why they use machine learning to solve this problem and how. It also has a very good writing structure.

2. It shows lots of data to demonstrate the effectiveness, coverage and generality of this approach.

Limitation: 
1. The motivation should be evaluated, i.e. applying incorrect algorithms on applications leads to observable overhead.

2. CPU degradation is close to 0 (section 7.2, bottom of page 8), then what's the motivation to predict that?

3. (Minor) Nearly all the features are timing serials. The paper needs to describe how to process this timing serial sampling data into features in this machine learning framework (in profiling stage).


Blogger Minjun Wu, 04/10/2019

Comments

  1. Minjun WuApril 11, 2019 at 6:44 AM

    I am sorry.. My first opinion about the limitation is shown in Figure 2. To be honest, I cannot find very obvious and fundamental problem in this paper...

    ReplyDelete
  2. jon_weissmanApril 11, 2019 at 6:45 AM

    They have limitation 1. just not at the beginning of the paper. A question might be the sampling rate (1 out of 32) and whether this can be adapted or whether greater sampling can improve things.

    ReplyDelete
    Replies
    1. Minjun WuApril 11, 2019 at 6:52 AM

      Right. For example, for working set entropy, I have 400 samples in this application data, how to convert this 400 to 1 single number feeding into the model. I think not all the features can be calculated by "average" operation..

      Delete

Post a Comment

Popular posts from this blog

StormDroid: A Streaminglized Machine Learning-Based System for Detecting Android Malware

Introduction: The paper approaches the problem of Malware Detection using machine learning approach. In this paper, the authors propose considering new type of features along with two traditionally used set of features for developing techniques for malware detection. Along with this proposal, the paper makes other contributions as well. The authors provide a new framework which is able to process information from large data sets as streams, and efficiently perform malware detection. Motivation: Android is an open platform for development. It has certainly made easy for everyone to develop and publish apps.  The number of apps published on Google store is in millions. However, it has also made easier for hackers to reach out to a larger population for malicious attacks. Additionally, with surge in the number of attacks on devices, more data is available for analysis which can be used by the machine learning models to identify malicious apps. This is motivation to use machine ...
Read more

Coordinated Management of Multiple Interacting Resources in Chip Multiprocessors: A Machine Learning Approach

Authors: Ramazan Bitirgen, Engin Ipek, Jose F. Martinez Motivation: Sharing system resources efficiently on chip multiprocessors (CMPs) platforms is the key to obtain high utilization and enforce system-level performance objectives. Unrestricted sharing of microarchitectural resources will result in destructive interference and unacceptable performance. However, the works focus on coordinated management of multiple interacting resources on CMPs are very scarce , even though several proposals focusing on addressing the management of a single microarchitectural resource exist. Aiming to fill this gap, this paper proposes a framework with the machine learning technology to manage multiple shared CMP resources in a coordinated fashion to enforce higher-level performance objectives. This novel mechanism consists of per-application hardware performance models and a global resource manager. Positive Points: 1. The global resource manager is able to aggregate each app...
Read more