You may find regular size fitted tops make you look like a kid wearing mom’s clothes. In that case, you may find petite size tops fit you perfectly since they are adjusted for shorter torso.
In most cases, I would say yes, you should start with trying petite size at least. You are much better off with clothes designed to fit the proportions of shorter women.
Pay attention to the definition of petite sizing by each retailer/designer, as some of them define what is petite as under 5’4” while others define it as under 5’3”.
Petite plus girls, like other petite size women, share the common body features I mentioned earlier, and the best bet to find their clothing from designers who carry petite plus specifically tailored to suit the needs of curvier petite women.
Tens of thousands of petites have already got a makeover at Petite Dressing, the clothing site dedicated to women under 5'4". What are you waiting for?