According to the poll of more than 2,000 people, which was commissioned by the Training and Development Agency for Schools (TDA), more than four in ten adults believe that poor perceptions about men working with young children are the reason why so few take up primary teaching roles.
Almost half of the respondents said it was important to ensure that children had both male and female role models, reports The Scotsman.
TDA chief executive Graham Holley said: "Men are under-represented in primary schools and we are keen to improve the balance over time.
"This is not an educational issue: there is nothing wrong with the thousands of splendid women teachers who we are fortunate to have in our schools.
"But a well balanced, diverse and representative workforce is of huge benefit to children socially and in their broader development."