Removing yourself from following a story, removes everyone from following

If you are following a story and you go and uncheck the “followers” box to unfollow the story, it removes all followers of the story instead of just removing you as a follower.