Sorry if you got unnecessary notification at the very moment; the phone was in my pant's pocket and it might clicked some tabs(maybe follow-unfollow few times) on its own due to movement, which may had given you notification !!
I just came to know when my phone vibrated, and a banner said your changes had been saved !!
I only saw one notification for it though.