To Train, or Not to Train!