To understand how the visual brain works in the natural world, we must study cortical neurons. Specifically, we must identify what kinds of information they store, and then relate this information to different types of images. Here, I will describe how we use machine learning to extract visual attributes represented by neurons and show that neurons may act as “similarity machines," signaling the distance between input signals and their encoded attributes.