How do i counteract the caffeine jitters from my vitamins?

I have always had trouble taking medicine with caffeine in it because i rarely drink cafinated soda or coffee. i cannot take excedrine or midol for example without getting extremely shakey and jittery and get a fast heart rate. I took a one a day for women for the first time today and found out it has about an equivalent of a cup of coffee. i am extreemly jittery and dont want to stop taking the vitamin because i need to be taking it. any cheap and easy ways to counteract the caffeen affect??? (no alcohol or sleeping pills please)