Amazon wholesaler here: new supplier does not charge tax on its product, called it a “cash transaction” done by PayPal or etransfer…

I would be provided a valid invoice, and the inventory they have is legit. My only concern is they don’t charge tax, so I would not be paying any HST/GST. Is this fine? Are there any downsides?