implement on efficient data layout for a hadoop cluster

I need to create a layout of common data repeated dataset on ahadoop cluster of a reduced storage cost. So we need to understand the commonality of values across records and create a data layout that avoids duplicate values. But at the same time, I need to allow retrieval of a complete data record rom the storage, given a record identifier.