The next C3.ai Digital Transformation Institute Colloquium on Digital Transformation Science Webinar will be Thursday, June 24 at 3:00 p.m. U.S. Central time. Presenting "Closing the Loop on Machine Learning: Data Markets, Domain Expertise, and Human Behavior" will be Roy Dong from the University of Illinois at Urbana-Champaign.
Registration is required to attend this event.
Abstract: As machine learning and data analytics are increasingly deployed in practice, it becomes more and more pressing to consider the ecosystem created by such methods. In recent years, issues of data provenance, the veracity of available data, vulnerabilities to data manipulation, and human perceptions/behavior have had a growing effect on the overall performance of our intelligent systems. In the first part of this talk, I consider a game-theoretic model for data markets, and demonstrate that whenever multiple data purchasers compete for data sources without exclusivity contracts, there is a fundamental degeneracy in the equilibria, independent of each data purchaser’s learning capabilities. In the second part of this talk, we discuss issues of causal inference, which are essential when our learning algorithms are used to make decisions. We analyze how passively observed data can be efficiently combined with actively collected trial data to most efficiently recover causal structures. In the last section of this talk, I will discuss some of our recent experiments with human participants in the context of intelligent building control, and show that commonly designed mechanisms assuming utility-maximizing behavior may fall short of theoretical performance in practice.