Roll Out New Features Without Hurting Loyal Users