Anyone set up a merchant account instead of using stripe or PayPal? Is it worth it?

I want get rid of the standard 2.9% transaction fee of the big gateways. Looking setting up a merchant account and using authorize.net.

Anyone got any context, tips, advice to add to this for me?