They are not. Even if Chinese Army is marching in Old Delhi, the leaders will prattle : "Na Koi Ghusa hai, Na Koi Ghus ayaa hei". And its not Modi's word actually, its the words of entire PMO and south block combined.He's unhappy with the current situation and is only venting.
In Ladakh, the Chinese have pushed quite a lot towards India. In Depsang, they are right next to the SSN road. In most other places, we have eyeball to eyeball confrontation a bit further away.
But the Chinese have reached the peak of their salami slicing tactic in the region and if they want anything more, they will have to forcibly push the IA out, which means war. Or they have to try the same elsewhere and turn the LAC into LoC. But everything else he's worried about, not gonna happen without going to war.