In this paper we introduce an information theoretic approach and use techniques from the theory of Huffman codes to construct a sequence of binary sampling vectors to determine a sparse signal. Unlike other approaches, ours is adaptive in the sense that each sampling vector depends on the previous sample results. The expected total cost (number of measurements and reconstruction combined) we need for an s-sparse vector in Rn is no more than s log n + 2s.