Refereed article in conference proceedings (A4)

A Cache- and Memory-Aware Mapping Algorithm for Big Data Applications




List of AuthorsThomas Canhao Xu, Ville Leppänen

Conference nameInternational Conference on Digital Information Processing and Communications

Publication year2015

Book title *Digital Information Processing and Communications (ICDIPC), 2015 Fifth International Conference on

Start page110

End page115

Number of pages6

ISBN978-1-4673-6831-5

DOIhttp://dx.doi.org/10.1109/ICDIPC.2015.7323015


Abstract

In this paper, we propose and investigate a task mapping algorithm for big data applications. As a critical resource, data are produced faster than ever before. Parallel programs that process these data on massive parallel systems are widely adopted. The task mapping algorithm however, has not been well optimized for these applications. We explore the characteristics of big data applications based on a shared cache/memory multicore processor. The latencies of cache and memory sub-systems are analysed. The proposed algorithm is designed to optimize the cache/memory latency, as well as intra-application latency. We introduce an efficient greedy algorithm to calculate the mapping result based on the congregate degree of nodes. Different numbers of search spaces are discussed and evaluated. Experiments are conducted based on synthetic simulation and running real applications on a full system simulation environment. Results confirmed the effectiveness of the proposed algorithm. Average execution time of five selected big data applications is reduced by 8% compared with the first fit algorithm.



Last updated on 2021-24-06 at 11:06