This paper deals with autonomous navigation of unmanned ground vehicles (UGV). The UGV has to reach its assigned final configuration in a structured environments (e.g. a warehouse or an urban environment), and to avoid colliding neither with the route boundaries nor any obstructing obstacles. In this paper, vehicle planning/set-points definition is addressed. A new efficient and flexible methodology for vehicle navigation throughout optimal and discrete selected waypoints is proposed. Combining multi-criteria optimization and expanding tree allows safe, smooth and fast vehicle overall navigation. This navigation through way-points permits to avoid any path/trajectory planning which could be time consuming and complex, mainly in cluttered and dynamic environment. To evaluate the flexibility and the efficiency of the proposed methodology based on expanding tree (taking into account the vehicle model and uncertainties), an important part of this paper is dedicated to give an accurate comparison with another proposed optimization based on the commonly used grid map. A set of simulations, comparison with other methods and experiments, using an urban electric vehicle, are presented and demonstrate the reliability of our proposals.