• search hit 27 of 403
Back to Result List

Discovering relaxed functional dependencies based on multi-attribute dominance

  • With the advent of big data and data lakes, data are often integrated from multiple sources. Such integrated data are often of poor quality, due to inconsistencies, errors, and so forth. One way to check the quality of data is to infer functional dependencies (fds). However, in many modern applications it might be necessary to extract properties and relationships that are not captured through fds, due to the necessity to admit exceptions, or to consider similarity rather than equality of data values. Relaxed fds (rfds) have been introduced to meet these needs, but their discovery from data adds further complexity to an already complex problem, also due to the necessity of specifying similarity and validity thresholds. We propose Domino, a new discovery algorithm for rfds that exploits the concept of dominance in order to derive similarity thresholds of attribute values while inferring rfds. An experimental evaluation on real datasets demonstrates the discovery performance and the effectiveness of the proposed algorithm.

Export metadata

Additional Services

Search Google Scholar Statistics
Metadaten
Author details:Loredana CaruccioORCiD, Vincenzo DeufemiaORCiD, Felix NaumannORCiDGND, Giuseppe PoleseORCiD
DOI:https://doi.org/10.1109/TKDE.2020.2967722
ISSN:1041-4347
ISSN:1558-2191
Title of parent work (English):IEEE transactions on knowledge and data engineering
Publisher:Institute of Electrical and Electronics Engineers
Place of publishing:New York, NY
Publication type:Article
Language:English
Date of first publication:2020/01/17
Publication year:2021
Release date:2023/07/13
Tag:Approximation algorithms; Big Data; Complexity theory; Distributed; Functional dependencies; Lakes; Semantics; data cleansing; data profiling; databases
Volume:33
Issue:9
Number of pages:17
First page:3212
Last Page:3228
Organizational units:An-Institute / Hasso-Plattner-Institut für Digital Engineering gGmbH
DDC classification:0 Informatik, Informationswissenschaft, allgemeine Werke / 00 Informatik, Wissen, Systeme / 000 Informatik, Informationswissenschaft, allgemeine Werke
5 Naturwissenschaften und Mathematik / 53 Physik / 530 Physik
6 Technik, Medizin, angewandte Wissenschaften / 62 Ingenieurwissenschaften / 620 Ingenieurwissenschaften und zugeordnete Tätigkeiten
Peer review:Referiert
Accept ✔
This website uses technically necessary session cookies. By continuing to use the website, you agree to this. You can find our privacy policy here.