Backpropagation

Following the gradient in the model (weight) space.

Computational Graph

Backpropagation

Essentially a dynamic programming

Backpropagation is just a chain rule. Dynamic programming.

We're moving along the direction of the gradient in the weight space. We don't have the notion of "backprop" here. Backprop is just a computational help.