A senior BJP leader said its top brass, including Prime Minister Narendra Modi, is "upset" with the sixth-term Lok Sabha MP, who was a minister in the first Modi government, and the Karnataka leader has been asked to take remedial measures, including tendering an apology.