Old Executive Office Building. When you say you work in the White House, often, except for the top staff, it is actually the Old Executive Office Building right next door to the White House. The Vice President's formal office is located here.