Raman spectroscopy is an important tool in understanding chemical components of various materials. However, the excessive weight and energy consumption of a conventional CCD-based Raman spectrometer forbids its applications under extreme conditions, including unmanned aircraft vehicles (UAVs) and Mars/Moon rovers. In this article, we present a highly sensitive, shot-noise-limited, and ruggedized Raman signal acquisition using a time-correlated photon-counting system. Compared with conventional Raman spectrometers, over 95% weight, 65% energy consumption, and 70% cost could be removed through this design. This technique allows space- and UAV-based Raman spectrometers to robustly perform hyperspectral Raman acquisitions without excessive energy consumption.