In the last few years several researchers within the Artificial Life and Mobile Robotics community used Artificial Neural Networks. Explicitly viewing Neural Networks in an Artificial Life perspective has a number of consequences that make research on what we will call Artificial Life Neural Networks (ALNNs) rather different from traditional connectionist research. The aim of the paper is to make the differences between ALNNs and "classical" neural networks explicit.