(CBS News) — One in four registered voters say they are less likely to vote for President Obama in November because he expressed support same-sex marriage, according to a new CBS News/New York Times poll.

While 25 percent say the president’s support for same-sex marriage makes them less likely to support his reelection, 16 percent say his position makes them more likely to support him. Fifty-eight percent say the announcement will not affect how they vote.

Republicans were most likely to say the announcement made them less likely to support the president, with 43 percent making that assertion. Even before he came out in support of same-sex marriage, Mr. Obama had little support from Republican voters. In the new survey, conducted from May 11-13, only five percent of Republicans said they would vote for the president in November.

More worrisome for the president is the percentage of Democrats and independents who say the decision will sway their views. And that figure, while smaller, is not insignificant.