This little room is right next to Mr. Vanderbilt's library which connects to the nursery.
I guess he needed time to chill out after visiting with the kids.
The previous photo shows the beautiful door at the entrance of this interesting space.