You can use Abort method to stop a thread.

You can check whether its running or not with the ThreadState property.

The easiest way to track them would to make a collection or array of the threads you've started until then end.