Combine sugars and milk in heavy saucepan. Cook and stir until the mixture reaches soft ball stage (234F). Remove from heat and add butter, vanilla and peanut butter. Beat well using electric mixer. Pour into greased 8-inch square pan. Let cool slightly, score with knife. When completely cool, cut into squares and store in air-tight container.