I have a savings account with a credit union, they can offer some pretty good rates and will generally have a very open investment strategy. Customer service has been rather good, at least when accessed via phone. I don't think my union offers things like current accounts, but I hear some do.

You experience is going to be heavily dependent on your specific union, they tend not to have as much money to throw around as major banks do, so don't expect a bespoke app or anything like that.