Data in column family stores is organized into column families, which group related columns together. Each column family contains rows identified by a unique key. This structure allows for efficient data retrieval by accessing only the relevant columns.