Removing activations 2026 recap

This is a quick blog looking back on some experiments from a couple of years ago. I am not altering the previous blogs, even though some things could be updated. I have a better understanding of what is going on from the last 2 years of experiments.