Reducing Bias in AI-Based Analysis of Visual Artworks

Empirical research in science and the humanities is vulnerable to bias which, by definition, implies incorrect or misleading findings. Artificial intelligence-based analysis of visual artworks is vulnerable to bias in ways specific to the domain. Works of art belong to a distinct cultural category that often prioritizes such characteristics as hand-craftsmanship, uniqueness, originality, and imaginative content; works of art are also responsive to diverse social and cultural contexts. Ascertaining which features of an artwork can be rightly ascribed to an objective “truth,” without which the concept of bias is not even relevant, is itself challenging. Incorporating expert knowledge into machine learning applications can help reduce bias in final estimates. We review several sources of bias that can occur across different stages of AI-based analysis, protocols, and best practices for reducing bias, and approaches to measuring these biases. This systematic investigation of various types of bias can help researchers better understand bias, become aware of practical solutions, and ultimately cultivate the prudent adoption of AI-based approaches to artwork analysis.
Related Articles

Revealing and Reconstructing Hidden or Lost Features in Art Investigation
In recent decades, cultural heritage research—and in particular art investigation—has been undergoing a digital revolution. This is due both to improvements ...

Information Processing Challenges at the National Archives
The National Archives, U.K., faces a number of information processing challenges relating to the volume, variety and velocity of the data it handles, as well as its need to ensure value and veracity. This feature highlights some of these challenges as well as some of the work it is undertaking to address them.

The Dual Space: Concept and Applications in Cultural Heritage
An important question in cultural heritage concerns the make process of an artifact. Understanding the make process provides insight related to the origin, t...