Do not stop taking your steroid medicine without talking to your doctor first. They may lower or change your dose if you're having side effects. Any side effects will usually stop when you finish your treatment.