I think the point about NN and ray tracing being simple systems that allow for complex outcomes is something that seems to be a deeper truth about the universe. Stephen Wolfram and Max Tegmark both talk and write about this - it also shows up in old cellular automata like Conway’s game of life.
It’s pretty cool that so much complexity can come from a few small rules or equations.
It’s pretty cool that so much complexity can come from a few small rules or equations.