Keith Sweat never had a lover