To close an account with (to close financial dealings)

we have closed our account with the Punjab national bank.