Your symptoms sound a lot like when my RPS flywheel had issues. There are bolts that screw into the main aluminum section of the flywheel, which are then welded to the steel ring gear. My welds broke and this created a fraction of an inch of play, thereby making the odd grinding noise from a dead stop and in 1st gear.
It seems to go away after slipping the clutch assuming that the heat created expanded the metal.