Another option would be to add the timer to the button. The .Tag property of a button is essentially a storage area that can hold anything...including a timer. So, you could assign each timer to the .Tag property of the button, then get it back with:

Dim yourTimer = DirectCast(yourButtonHere.Tag,Timer)

However, I still prefer having only a single timer.