In this paper we introduce a modular, highly flexible, opensource environment for data generation. Using an existing graphical data flow tool, the user can combine various types of modules for numeric and categorical data generators. Additional functionality is added via the data processing framework in which the generator modules are embedded. The resulting data flows can be used to document, deploy, and reuse the resulting data generators. We describe the overall environment and individual modules and demonstrate how they can be used for the generation of a sample, complex customer/product database with corresponding shopping basket data, including various artifacts and outliers. Categories and Subject Descriptors H.2.8 [Database Management]: Database Application— Data mining; I.6.0 [Simulation and Modeling]: General General Terms Design, Algorithms Keywords data generation, pipeline tool, artificial data
Iris Adä, Michael R. Berthold