Benchmarking Tabular Data Synthesis for User Guidance

Maria F Davila R, Wolfram Wingerath, Fabian Panse
Proceedings of the Workshops of the EDBT/ICDT 2024 Joint Conference co-located with the EDBT/ICDT 2024 Joint Conference
This paper presents our research on evaluating the suitability of a Tabular Data Synthesis (TDS) tool for use-case specific requirements. The main goal is to develop a platform that allows users, for example researchers from other fields, to select a suitable TDS tool for their real-world application. In the course of developing such a platform, three contributions are currently planned: Firstly, a decision guide for users formulated by compiling the reported performance of leading tools against a set of functional and non-functional requirements. Secondly, a benchmarking framework for TDS tools based on these identified requirements. Lastly, a customizable tool selection platform, developed through extensive benchmarking of predominant TDS tools. This platform must provide a number of possible tools based on specific use case constraints and allow for community-based expansion, thereby offering a dynamic and adaptable solution for TDS tool selection.
03 / 2024