New accepted paper at the EAI International Conference on Performance Evaluation Methodologies and Tools (ValueTools) [06.09.21]
Christian Krupitzer from the Department of Food Informatics is co-author of the peer-reviewed conference paper "ComBench: A Benchmarking Framework for Publish/Subscribe Communication Protocols under Network Limitations" at the EAI Conference on Performance Evaluation Methodologies and Tools (ValueTools).
The publication "ComBench: A Benchmarking Framework for Publish/Subscribe Communication Protocols under Network Limitations" by Stefan Herrnleben (University of Würzburg) with co-authors Maximilian Leidinger, Veronika Lesch, Thomas Prantl, Johannes Grohmann (all University of Würzburg), Christian Krupitzer (Department of Food Informatics, University of Hohenheim) and Samuel Kounev (University of Würzburg) was accepted at the Conference on Performance Evaluation Methodologies and Tools (peer-reviewed). The Conference on Performance Evaluation Methodologies and Tools, sponsored by EAI, focuses on methodologies and practices in modelling, performance evaluation and optimization of complex systems and brings together researchers from different communities including Computer Science, Networks and Telecommunications, Operations Research, Optimization, Control Theory and Manufacturing.
Efficient and dependable communication is a highly relevant aspect for Internet of Things (IoT) systems in which tiny sensors, actuators, wearables, or other smart devices exchange messages. Various publish/subscribe protocols address the challenges of communication in IoT systems. The selection process of a suitable protocol should consider
the communication behavior of the application, the protocol’s performance, the resource requirements on the end device, and the network connection quality, as IoT environments often rely on wireless networks. Benchmarking is a common approach to evaluate and compare systems, considering the performance and aspects like dependability or security. In this paper, we present our IoT communication benchmarking framework ComBench for publish/subscribe protocols focusing on constrained networks with varying quality conditions. The benchmarking framework supports system designers, software engineers, and application developers to select and investigate the behavior of communication protocols. Our benchmarking framework contributes to (i) show the impact of fluctuating network quality on communication, (ii) compare multiple protocols, protocol features, and protocol implementations, and (iii) analyze scalability, robustness, and dependability of clients, networks, and brokers in different scenarios. Our case study demonstrates the applicability of our framework to support the decision for the best-suited protocol in various scenarios.
The publication is available in the Springer Link digital library.
