Ma, X;
Zou, H;
He, P;
Keung, J;
Li, Y;
Yu, X;
Sarro, F;
(2024)
On the Influence of Data Resampling for Deep Learning-Based Log Anomaly Detection: Insights and Recommendations.
IEEE Transactions on Software Engineering
pp. 1-18.
10.1109/TSE.2024.3513413.
(In press).
Preview |
Text
On_the_Influence_of_Data_Resampling_for_Deep_Learning-Based_Log_Anomaly_Detection_Insights_and_Recommendations.pdf - Accepted Version Download (1MB) | Preview |
Abstract
DLLAD methods may underperform in severely imbalanced datasets. Although data resampling has proven effective in other software engineering tasks, it has not been explored in LAD. This study aims to fill this gap by providing an in-depth analysis of the impact of diverse data resampling methods on existing DLLAD approaches from two distinct perspectives. Firstly, we assess the performance of these DLLAD approaches across four datasets with different levels of class imbalance, and we explore the impact of resampling ratios of normal to abnormal data on DLLAD approaches. Secondly, we evaluate the effectiveness of the data resampling methods when utilizing optimal resampling ratios of normal to abnormal data. Our findings indicate that oversampling methods generally outperform undersampling and hybrid sampling methods. Data resampling on raw data yields superior results compared to data resampling in the feature space. These improvements are attributed to the increased attention given to important tokens. By exploring the resampling ratio of normal to abnormal data, we suggest generating more data for minority classes through oversampling while removing less data from majority classes through undersampling. In conclusion, our study provides valuable insights into the intricate relationship between data resampling methods and DLLAD. By addressing the challenge of class imbalance, researchers and practitioners can enhance DLLAD performance.
| Type: | Article |
|---|---|
| Title: | On the Influence of Data Resampling for Deep Learning-Based Log Anomaly Detection: Insights and Recommendations |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1109/TSE.2024.3513413 |
| Publisher version: | https://doi.org/10.1109/tse.2024.3513413 |
| Language: | English |
| Additional information: | This version is the author accepted manuscript. For information on re-use, please refer to the publisher’s terms and conditions. |
| Keywords: | Deep Learning-Based Log Anomaly Detection, Data Resampling Methods, Class Imbalance, Empirical Analysis |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > UCL BEAMS UCL > Provost and Vice Provost Offices > UCL BEAMS > Faculty of Engineering Science > Dept of Computer Science |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10203078 |
Loading...
Loading...Loading...Loading...Archive Staff Only
 |
View Item |
