Dark matter annihilation has been proposed to explain the TeV gamma rays observed from the Galactic Center. We study constraints on this hypothesis coming from the mass profile around the Galactic Center measured by observing stellar dynamics. We show that for current particle models, the constraints on the dark matter density profile from measurements of mass by infrared observations are comparable to the constraints from the measurements of the TeV source extension.