Suddenly stopping Prednisone after long-term use can cause serious health issues. Symptoms may include fatigue, joint pain, reducing prednisone dosage and low blood pressure. This is due to the suppression of the adrenal glands, which produce natural steroids.