A massive young star cluster embedded in its parent molecular cloud will spiral into the Galactic Center from 30 pc during the life-time of its most massive stars, if the combined total mass is 106 Mo. On its way inwards the system loses most of its mass to the strong tidal field, until the dense cluster core of high-mass stars is finally disrupted by the central black hole. A simple model is presented to argue that this scenario may under plausible conditions explain the observed location and rotation of the Galactic Center HeI stars. Accretion of star clusters into the Galactic Center could be recurrent, and play an important role in regulating the activity of Sgr A*.