To have your heart in your mouth

To be very frightened or anxious

e.g. when my four year old son rode off around the park on his bicycle for the very first time my heart was in my mouth.

The idiom comes from when the heart beats so violently that it appears to leap upward.