Yes. Those are pistils.
No they don't only show up in flower.
They usually show around the 4-5 week mark in veg once the plant has reached a certain level of "maturity". Some refer to these as "pre-flowers". I just had some show sex at day 27 from Veg.
Totally normal. Enjoy.