Cake: Have all ingredients at room temperature. Beat egg whites until they form soft peaks. Add 1/2 cup sugar slowly; beat until mixture is like meringue. Cream butter and remaining sugar, salt and vanilla. Add egg yolks one at a time. Stir baking soda into the buttermilk. Alternately add the buttermilk and flour to the egg mixture. Start and finish with the flour. Fold egg whites in gently then fold in mac nuts and the coconut. Bake in three 9-inch pans which have been greased and floured. Bake in preheated 325 degree oven for about 40 minutes. Cool then ice layers and sides with the icing. This cake keeps well in the refrigerator. Serves 12 or more.
Frosting: Beat all ingredients together until consistency of whipped cream. Ice the cake then decorate with a ring of chopped nuts if preferred.