Is it okay to start at 2mm?

Yeah absolutely. Just keep pushing. It might hurt at first but it'll ease in and soon stretch out to fit the stretchers you've bought.