Although recreational drug use is associated with risky sexual behaviors and HIV infection among men who have sex with men (MSM), it is unclear to what extent these behaviors and outcomes differ between single-drug users and polydrug users in China. This is a cross-sectional study conducted from July to September 2016 among MSM in three cities of Sichuan Province, China. Multinomial logistic regression was performed to examine factors correlated with single-drug and polydrug use. A total of 1,122 participants were included in the study. Overall, 28% of MSM have ever used recreational drugs, of whom 64.0% were single-drug users, and 36.0% were polydrug users. Factors associated with both single-drug and polydrug use included: receptive sexual role (single-drug use: AOR = 1.79, 95% CI: 1.05–3.07; polydrug use: AOR = 6.00, 95% CI: 2.54–14.17), engaging in group sex (AOR = 2.23, 95% CI: 1.28–3.87; AOR = 4.68, 95% CI: 2.41–9.08), frequent alcohol use (AOR = 3.11, 95% CI: 1.75–5.52; AOR = 6.41, 95% CI: 2.50–16.47), seeking partners mainly by Internet (AOR = 4.87, 95% CI: 3.31–7.17; AOR = 4.58, 95% CI: 2.58–8.14), history of STIs (AOR = 1.86, 95% CI: 1.08–3.21; AOR = 3.32, 95% CI: 1.77–6.26) and HIV infection (AOR = 1.76, 95% CI: 1.02–3.02; AOR = 3.19, 95% CI: 1.62–6.26). Our findings suggest the urgent need for HIV and STIs prevention programs among MSM in China to integrate strategies that mitigate recreational drug use.