Everyone has a special place for each person because everybody has memories about where it might go with someone special, or his sense of fun and become a special place.
Everyone has a special place for each person because different people have different memories about the place or the people who make them feel special and enjoy a special place.
Everyone has a special place of each because different people have memories of that place, or may be a visit to someone gives him a sense of fun and a special place.