I have never been asked nor even seen that question but I understand your concern. I went into the privacy settings and could not see an option to limit those following you, so I don't think that is possible. I will report this to Slinky and see if he knows any way to control it.
Even though this is unsettling for you, it's actually a compliment in a way. It means that other members consider your posts important enough that they want to be alerted any time you post. But in reality, it's really no different than going into the board daily and checking out new posts. Had you made a new comment or started a new thread, your post would be read either way.
My only suggestion would be to follow everyone who is following you. This would accomplish two things. First, it would show you how the function works. Second, it would show those following you how it feels to be followed. If I find out a way to turn the function off, I will let you know.
And if you have any other privacy concerns, I suggest you go into your profile and visit the "privacy" tab to tweak the available settings in there.