The "harem" referred to the wives, favorite women, and concubines of the Sultan, and also the part of the palace that was for the Sultan's family and therefore off-limits to visitors. This courtyard was in the Harem part of the palace and was the main meeting place for the family (Sultan, Crown Prince, wives, favorites, Sultan's mother) as the apartments opened onto this courtyard.