Vicksburg, Mississippi, sat on high bluffs over the Mississippi River and was a key Confederate stronghold.