Only if the function that they are trying to approximate is differentiable. Also, it depends on having enough training data, and on the training data actually being representative of the domain of the function.