In models of associative memory composed of pulse neurons, chaotic pattern transitions where the pattern retrieved by the network changes chaotically were found. The network is composed of multiple modules of pulse neurons, and when the inter-module connection strength decreased, the stability of pattern retrieval changed from stable to chaotic. It was found that the mixed pattern of stored patterns plays an important role in chaotic pattern transitions.