After keeping BJP on tenterhooks for two days, he declared on Monday that he was not quitting the party yet.