Health information is everywhere, but that doesn't mean everyone is better informed. New deep learning algorithms can create user-tailored summaries of online health information for users without medical expertise. But before we can release these algorithms into the wild, they need to be evaluated.