Sometimes walking through a moldering old crypt can be a pleasure. With the smell of bone dust and ancient burial wrappings, almost like a library. Certainly as quiet. Until you step in a patch of Choo Mold.
Elves are not actually aloof. They are actually extremely family-based and insular, and often intermarry inside their families, making them uncomfortable around those not of their family. Therefore, they shield themselves behind pretended aloofness and coldness until they are comfortable in others' company.