Swamy’s plea appeared before the court as the deadline to vacate the possession of his government bungalow was approaching