Loading…
Friday, July 12 • 12:50pm - 1:10pm
Cross-dataset Time Series Anomaly Detection for Cloud Systems

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

In recent years, software applications are increasingly deployed as online services on cloud computing platforms. It is important to detect anomalies in cloud systems in order to maintain high service availability. However, given the velocity, volume, and diversified nature of cloud monitoring data, it is difficult to obtain sufficient labelled data to build an accurate anomaly detection model. In this paper, we propose cross-dataset anomaly detection: detect anomalies in a new unlabelled dataset (the target) by training an anomaly detection model on existing labelled datasets (the source). Our approach, called ATAD (Active Transfer Anomaly Detection), integrates both transfer learning and active learning techniques. Transfer learning is applied to transfer knowledge from the source dataset to the target dataset, and active learning is applied to determine informative labels of a small part of samples from unlabelled datasets. Through experiments, we show that ATAD is effective in cross-dataset time series anomaly detection. Furthermore, we only need to label about 1%-5% of unlabelled data and can still achieve significant performance improvement.

Speakers
XZ

Xu Zhang

Microsoft Research, Nanjing University
QL

Qingwei Lin

Microsoft Research
YX

Yong Xu

Microsoft Research
SQ

Si Qin

Microsoft Research
HZ

Hongyu Zhang

The University of Newcastle
BQ

Bo Qiao

Microsoft Research
YD

Yingnong Dang

Microsoft
XY

Xinsheng Yang

Microsoft
QC

Qian Cheng

Microsoft
YW

Youjiang Wu

Microsoft
KH

Ken Hsieh

Microsoft
KS

Kaixin Sui

Microsoft Research
XM

Xin Meng

Microsoft Research
YX

Yaohai Xu

Microsoft Research
WZ

Wenchi Zhang

Microsoft Research
FS

Furao Shen

Nanjing University
DZ

Dongmei Zhang

Microsoft Research


Friday July 12, 2019 12:50pm - 1:10pm PDT
USENIX ATC Track II: Grand Ballroom VII–IX