In a medium saucepan over medium-high heat, combine the sugar, cocoa, butter and milk. Bring to a rapid boil and boil for 2 minutes stirring continuously . Remove from heat and stir in the vanilla and the peanut butter. Stir in the oats until blended then immediately drop by tablespoons onto waxed paper. Let cool until set.