Context-specific information, including differences in geographical areas, such as distinct altitudes, can be important to explain variations in physical growth. We aimed to compare the estimation of maximum growth velocity and pubertal growth-spurt parameters of children and adolescents living at low and moderate altitudes in Colombia. A cross-sectional study, including a representative cohort of 30.305 (51% boys) children and adolescents aged 1–18 years from Colombia, was performed. The heights were measured with standardized techniques. The Preece–Baines growth model was used to estimate the mathematical and biological parameters of the height-growth velocities and growth spurts for both sexes. The altitudes were categorized as low (18 to 564 m above sea level) or moderate (2420 to 2640 m above sea level). There were no differences in final height (h1), peak height velocity size (hθ), age at peak height velocity (APHV), or peak height velocity PHV (cm/y) between the subjects living in both altitudes (p > 0.05). The APHV was estimated at 12.75 ± 0.75 years in the boys and at 10.05 ± 0.65 years in the girls. The girls reached the APVH 2.70 years earlier than the boys. Regarding the PHV, the boys reached higher growth velocity, which was 6.85 ± 0.55 cm/y. In conclusion, there were no significant differences in final height, peak height, APHV, or PHV between the children and adolescents living at distinct altitudes in Colombia. The PHV occurred approximately 3 years earlier in the girls than in the boys. Furthermore, the girls’ estimated PHV, APHV, and final height were lower than those of the boys. This study allows additional insight into pubertal growth-spurt parameters and also provides a valuable reference database for the assessment of Colombian children and adolescents.