The first telephone was installed in the telegraph room in the White House, thanks to President Rutherford B. Hayes.
Source