Cream together butter and sugar. Add banana, eggs, and vanilla. Sift together dry ingredients. Add alternately with buttermilk. Blend well. Stir in nuts, and pour into a greased and floured loaf pan. Bake at 325 degrees for 1-1/4 hours.