If only 4% of your portfolio is in stocks (which most 60-year-olds should do), then you should worry about the 96%. Down markets recover so quickly. Besides, guessing the future based on the past is not that smart.