We present a neural architecture of sentence representation. Words are represented with neural cell assemblies. Relations between words are represented with ‘structure’ assemblies. Word and structure assemblies are bound temporarily to form a sentence representation. We show how multiple sentences can be represented simultaneously, and we simulate how specific information can be retrieved from the architecture. The assemblies are simulated as populations of spiking neurons, in terms of the average firing rate of the neurons in the population.