To Train or Not to Train?