We studied the performance of different types of neural networks at predicting extreme storm surges. We found that that performance improves when during model training, storm surges that are rarer are given a higher weight than moderate storm surges. Additionally, we found that the performance of some of the neural networks approaches that of a state-of-the-art hydrodynamic model. This is promising for the future application of neural networks to climate model simulations.