Bhardwaj said that he will vacate the ministry when his predecessor Satyendar Jain is released from prison.