An Execution Fingerprint Dictionary for HPC Application Recognition

【Author】 Jakobsche, Thomas; Lachiche, Nicolas; Cavelan, Aurelien; Ciorba, Florina M.

【Source】2021 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER 2021)

【影响因子】

【Abstract】Applications running on HPC systems waste time and energy if they: (a) use resources inefficiently, (b) deviate from allocation purpose (e.g. cryptocurrency mining), or (c) encounter errors and failures. It is important to know which applications are running on the system, how they use the system, and whether they have been executed before. To recognize known applications during execution on a noisy system, we draw inspiration from the way Shazam recognizes known songs playing in a crowded bar. Our contribution is an Execution Fingerprint Dictionary (EFD) that stores execution fingerprints of system metrics (keys) linked to application and input size information (values) as key-value pairs for application recognition. Related work often relies on extensive system monitoring (many system metrics collected over large time windows) and employs machine learning methods to identify applications. Our solution only uses the first 2 minutes and a single system metric to achieve F-scores above 95 percent, providing comparable results to related work but with a fraction of the necessary data and a straightforward mechanism of recognition.

【Keywords】HPC; application recognition; data reduction; system monitoring

【发表时间】2021

【收录时间】2021-12-31

【文献类型】会议

【主题类别】

区块链应用--