Residual Stream

A general structure of Transformer Blocks wherein the input stream of a previous layer has it’s output Logit appended, to be fed into the next layer. .