The Bank of Savings in New York City became the first bank in the US.

Source