We study how countries choose intra-bloc tariffs and preferential margins in Preferential Trade Agreements (PTAs). Our model indicates that countries should set systematically lower preferential margins when the bloc takes the form of a free trade area, relative to a customs union. Moreover, in customs unions (but not necessarily in free trade areas) preferential margins should increase with the supply of partner countries and decrease with the level of preferential imports. These relationships reflect, respectively, the internalization of political-economy goals within the bloc and the desire to curb trade diversion. Using a sample that covers most PTAs formed by Latin American countries in the 1990s, we find empirical support for each of those predictions. These findings rationalize why governments often keep intra-bloc duties strictly positive. We show that this tends to worsen the welfare consequences of PTAs, and that requiring the elimination of internal tariffs would be socially desirable.