See papers with Mirek Kordos in this list.
Error surfaces determine the efficiency of network training; they can be visualized in PCA space of the weigh sequences; surprisingly we have never seen local minima, only large plateaus.