mwolf.dev

Graph View

RNNs are feedforward networks with shared weights

aka feedforward networks with tied weights are RNNs

RNNs are feedforward neural networks with shared weights (and, usually, residual connections).

Feedforward vs recurrent: Unrolling an RNN in time results in a feedforward network with weight sharing and vice versa.
Layers vs iterations: A deep network with weight sharing is doing the same computation L times.

See NODE, ResNet (discretized continuous-time dynamical system), dynamical-systems lens on neural networks


Backlinks

  • RNN
  • feedforward

Created with Quartz v4.5.2 © 2026