Remembering Diverse Representation