There are great broker shops and great banks. The key is who at these lenders will treat you right. I know several good people at Bank of America/Countrywide (they will never lose that name btw...) and Wells Fargo. From the sound of things very few people have good things to say about either company but much of their grousing falls squarely on the LO, not the company. Brokers for the most part are problematic but some good shops still are around - Loan Link Financial Services is a good broker/banker for example. An earlier post mentioned Park Place Funding. Not to pick on them, but companies like PPF ran ads touting their 1% rate solution during the Option ARM frenzy, then a year later claimed they avoided these kinds of products and sold only good "family friendly loans". Most broker shops like this are destined to collapse (Greenlight, QLF etc.) so avoid getting sucked into their vortex of fail by chasing what appears to be a great rate.
The best rule of thumb, of which there are many exceptions, is finding someone who has been in the business from the early 1990's on. Sorry, newbies but hopefully you will count as an exception.... Most LO's who started in the 90's survived the last down turn, went through two significant refi booms, and still remain in the business to this day despite all odds. That kind of experience is worth paying for.
Can you get a better deal elsewhere? Of course. You can also get low priced legal advice, low cost tax preparation services, discount food and goods. The question is are you really saving all that much overall versus what you paid in the short run?
My .02c
Remember: Tuesday is Soylent Green Day!