Judging a Book by Its Cover