ABSTRACT
We consider a set of views stating possibly conflicting facts. Negative facts in the views may come, e.g., from functional dependencies in the underlying database schema. We want to predict the truth values of the facts. Beyond simple methods such as voting (typically rather accurate), we explore techniques based on "corroboration", i.e., taking into account trust in the views. We introduce three fixpoint algorithms corresponding to different levels of complexity of an underlying probabilistic model. They all estimate both truth values of facts and trust in the views. We present experimental studies on synthetic and real-world data. This analysis illustrates how and in which context these methods improve corroboration results over baseline methods. We believe that corroboration can serve in a wide range of applications such as source selection in the semantic Web, data quality assessment or semantic annotation cleaning in social networks. This work sets the bases for a wide range of techniques for solving these more complex problems.
- S. Abiteboul, M. Preda, and G. Cobena. Adaptive on-line page importance computation. In Proc. WWW, Budapest, Hungary, May 2003. Google ScholarDigital Library
- M. Arenas, L. Bertossi, and J. Chomicki. Consistent query answers in inconsistent databases. In Proc. PODS, Philadelphia, Pennsylvania, USA, May 1999. Google ScholarDigital Library
- E. Brill, S. Dumais, and M. Banko. An analysis of the AskMSR question-answering system. In Proc. EMNLP, July 2002. Google ScholarDigital Library
- S. Brin and L. Page. The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems, 30(1-7):107--117, 1998. Google ScholarDigital Library
- C.-H. Chang, M. Kayed, M.R. Girgis, and K.F. Shaalan. A survey of Web information extraction systems. IEEE Transactions on Knowledge and Data Engineering, 18(10):1411--1428, Oct. 2006. Google ScholarDigital Library
- A.P. Dempster, N.M. Laird, and D.B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39(1):1--38, 1977.Google Scholar
- X. Dong, L. Berti-Equille, and D. Srivastava. Integrating conflicting data: The role of source dependence. In Proc. VLDB, Lyon, France, 2009.Google ScholarDigital Library
- X. Dong, L. Berti-Equille, and D. Srivastava. Truth discovery and copying detection in a dynamic world. In Proc. VLDB, Lyon, France, 2009. Google ScholarDigital Library
- D. Downey, O. Etzioni, and S. Soderland. A probabilistic model of redundancy in information extraction. In Proc. IJCAI, Edinburgh, United Kingdom, July 2005. Google ScholarDigital Library
- A. Fuxman, E. Fazli, and R.J. Miller. Conquer: efficient management of inconsistent databases. In Proc. SIGMOD, Baltimore, Maryland, USA, June 2005. Google ScholarDigital Library
- A. Galland, S. Abiteboul, A. Marian, and P. Senellart. Corroboration de vues discordantes fondées sur la confiance. In Proc. BDA, Namur, Belgium, Oct. 2009. Conference without formal proceedings.Google Scholar
- S. Golder and B.A. Huberman. Usage patterns of collaborative tagging systems. Journal of Information Science, 32(2):198--208, April 2006. Google ScholarDigital Library
- O. Häggström. Finite Markov chains and algorithmic applications, volume 52 of London Mathematical Society Student Texts. Cambridge University Press, Cambridge, United Kingdom, 2002.Google Scholar
- A. Jøsang, S. Marsh, and S. Pope. Exploring different types of trust propagation. In Proc. Trust Management, Pisa, Italy, May 2006. Google ScholarDigital Library
- C.C.T. Kwok, O. Etzioni, and D.S. Weld. Scaling question answering to the Web. In Proc. WWW, Hong Kong, China, May 2001. Google ScholarDigital Library
- C.D. Manning, P. Raghavan, and H. Schutze. Introduction to Information Retrieval. Cambridge University Press, Cambridge, United Kingdom, 2008. Google ScholarDigital Library
- G.A. Mihaila, L. Raschid, and M.-E. Vidal. Using quality of data metadata for source selection and ranking. In Proc. WebDB, Dallas, Texas, USA, May 2000.Google Scholar
- D. Osherson and M.Y. Vardi. Aggregating disparate estimates of chance. Games and Economic Behavior, 56(1):148--173, July 2006.Google ScholarCross Ref
- N.E. Taylor and Z.G. Ives. Reconciling while tolerating disagreement in collaborative data sharing. In Proc. SIGMOD, Chicago, Illinois, USA, June 2006. Google ScholarDigital Library
- M. Wu and A. Marian. Corroborating answers from multiple Web sources. In Proc. WebDB, Beijing, China, June 2007.Google Scholar
- X. Yin, J. Han, and P.S. Yu. Truth discovery with multiple conflicting information providers on the Web. In Proc. KDD, San Jose, California, USA, Aug. 2007. Google ScholarDigital Library
Index Terms
- Corroborating information from disagreeing views
Recommendations
Patterns for Implementing Uncertainty Propagation
EuroPLoP '18: Proceedings of the 23rd European Conference on Pattern Languages of ProgramsIn this paper, the design patterns Uncertain Number and Propagation Strategy are presented. They are useful for storing uncertainties of values and propagating them throughout calculations in an application. Uncertain Number represents a numerical value ...
Agents’ model of uncertainty
Multi-agent systems play an increasing role in sensor networks, software engineering, web design, e-commerce, robotics, and many others areas. Uncertainty is a fundamental property of these areas. Agent-based systems use probabilistic and other ...
Certainty, trust and evidence
We assume a group of agents, in which a process of opinion gathering takes place.We examine the values of agent's reputation, trust and certainty.Confidence value for agents depend on the values of trust and certainty.Increasing the importance of trust ...
Comments