Category: Uncategorized

  • Introduction to Forgetting

    Forgetting is removing parameters from a neural network to change how they behave. This blog is not really an introduction to the forgetting, it is an intro to the blog series that I am going to be working on while I develop the idea and methods. My last series of blogs has taken too long…

  • Mean Activated Absolute Values

    My software library is called Sparana, or sparse parameter analysis. The sparse part is because I wanted to use sparse data structures. The parameter analysis is because I wanted to look at parameter and what they were doing. Well if I am going to call my software library that, i should probably have a new…

  • Building Sparana

    Building Sparana I have built a python library for training artificial neural networks(NNs) called Sparana. The name is short for sparse parameter analysis. I started with a library using tensorflow that made it easier for me to look at parameters, and prune them. I found tensorflow did not support optimization over sparse weights, which seemed…

  • Hello world!

    Welcome to WordPress. This is your first post. Edit or delete it, then start writing!