HIV stigma as a barrier to retention in HIV care has not been well-studied outside the United States. We conducted a case–control study in Lima, Peru to examine this issue. Cases were out-of-care for ≥12 months (n = 66) and controls were recruited from patients in active care presenting for a clinic visit (n = 110). A previously validated HIV stigma scale with four domains was used. Associations between being out-of-care and each stigma domain were assessed using multivariable logistic regression. Stigma scores were highest for disclosure concerns. Modest associations were found for greater disclosure concerns (OR 1.16; 95 % CI 0.99, 1.36) and concerns with public attitudes (OR 1.20; 95 % CI 1.03, 1.40). Enacted stigma and negative self-image showed non-linear associations with being out-of-care that plateaued or declined, respectively, at higher levels of stigma. The threshold effect for enacted stigma warrants further exploration, while disclosure concerns may be especially amenable to intervention in this population.