In addition to genetics and aging, diet can also play a big part in maintaining strong bones. If you've sworn off dairy (or had to forgo it due to allergies), you may be at higher risk for developing a deficiency.