Yes! Babies need different washcloths than adults. They should be soft enough to cleanse without irritating their skin.
If you use them for your newborn’s bath time, they should also be big enough to cover his chest to keep them warm. The ideal size is 10” × 10” or 12” × 12” (around 30 × 30cm)