You Always Remember the Things That Matter the Least