My Supplier Is Overcharging Me, Is It Time To Move On?

So I've been moving more into a dropshipping type of business model where I use a supplier called Zinzino. Things have been going pretty good and they have been super reliable; however, they tend to mark up their prices a good amount. It becomes harder to compete when people sell the same product at a fraction of the cost. Do you think it's worth it to change suppliers solely to get a better price? or should I stay with my supplier because they are reliable? I found this company through Scam Risk, and it seems others have the same problems.