This is effectively what they are and is consistent with the terms people are already familiar with.
"Watchers" sounds like someone is able to see a task (therefore, it's confusingly similar to thinking "Watchers" are people who have viewing permissions.)
I'd request changing this term to Followers.