Category: Uncategorized
-
Introduction to Forgetting
Forgetting is removing parameters from a neural network to change how they behave. This blog is not really an introduction to the forgetting, it is an intro to the blog series that I am going to be working on while I develop the idea and methods. My last series of blogs has taken too long…
-
Mean Activated Absolute Values
My software library is called Sparana, or sparse parameter analysis. The sparse part is because I wanted to use sparse data structures. The parameter analysis is because I wanted to look at parameter and what they were doing. Well if I am going to call my software library that, i should probably have a new…
-
Building Sparana
Building Sparana I have built a python library for training artificial neural networks(NNs) called Sparana. The name is short for sparse parameter analysis. I started with a library using tensorflow that made it easier for me to look at parameters, and prune them. I found tensorflow did not support optimization over sparse weights, which seemed…
-
Hello world!
Welcome to WordPress. This is your first post. Edit or delete it, then start writing!