"These are not my views, they are the views of the department. I will take up the matter with the Prime Minister," Ramadoss told reporters here on Tuesday.
He also asked the Home Minister to be "more responsible" in its statements.
The Centre on Monday had told the Delhi High Court not to consider Ramadoss' views on allowing same gender sex among two consenting adults.
The court during the last hearing had pulled up the government for speaking in two voices on the issue as the Union Home Ministry suggested not to de-criminalise gay sex on moral grounds while the Health Ministry proposed to abolish the penal provision which carries a punishment of up to life imprisonment for such acts.
The Health Minister had sought legalisation of homosexuality arguing that it can help in better treatment of people suffering from HIV/AIDS.