Takens, not Attention, is all you need!
For those interested in LLMs and the technical side of this technology - this post describes how the LLM mechanism of 'Attention' can be framed in the field of non-linear dynamical systems theory using Takens' method of delays phase space embedding!
For those interested in LLMs and the technical side of this technology - this post describes how the LLM mechanism of 'Attention' can be framed in the field of non-linear dynamical systems theory using Takens' method of delays phase space embedding!