Working with a designer early on for simple clothing ideas. Good or bad idea?

Hey guys!

So I'm looking to start a clothing brand with a pretty simple style in a certain niche. My ideas at the minute basically involve a calligraphy style text and maybe a couple of simple designs.

I totally understand and appreciate the value of a designer to make sure they look great but I also think I could do it myself (no real design experience though).

I'm also concerned about paying out a big cost for the right designer and then the brand not working, so losing more money up front.

What do you think? Should I try doing it myself first and then pay for a designer if I see some success? Straight up start with a designer?

Thanks!