May 16, 2017 10:12 AM
It's not easy to say, but recent reports suggesting that Voter ID lost Wisconsin for Mrs. Clinton are overstating the evidence. So says Slate anyway, and they're not noted for being Republican shills.
But the Nation headline doesn’t say it all—not even close, as a number of political scientists and polling experts were quick to point out.
One of the first to arrive on the scene with a big bucket of cold water was Eitan Hersh, an assistant professor of political science at Yale University who has studied the effect of voter ID laws.
No offense, but this is something that is going to be shared hundreds of times and does not meet acceptable evidence standards. https://t.co/4M3ipqiaWg
— Eitan Hersh (@eitanhersh) May 9, 2017
The most glaring problem with the report and how it’s being interpreted, Hersh told me by phone, is that the firm behind the analysis decided to operate at a surface level when it almost certainly had the data and expertise to dig much deeper. “Civis presents itself as a very sophisticated analytics shop,” Hersh said, “and yet the analysis they’re offering here is rather blunt.”
The group relied largely on state-by-state and county-by-county comparisons to reach its conclusions, but it could have—and Hersh maintains, should have—conducted a more granular analysis. Civis could have isolated communities that straddle the border between two states, for instance, or even used a comprehensive voter file to compare similar individuals that do and don’t live in states with new voter ID laws. Doing either would have allowed Civis to eliminate variables that may have ultimately skewed its findings. “It’s very weird to do an analysis the way they did when they presumably had a better way to do it,” Hersh said. “That’s a red flag that jumps out right away.”
Civis says it mostly limited itself to publicly available information so that its analysis was repeatable; Hersh counters that repeating a flawed analysis will just lead to the same flawed results. As the New York Times’ Nate Cohn pointed out on Twitter, and as Hersh echoed in his conversation with me, the absence of a detailed voter file-based analysis of the impact of voter ID laws—by Civis or anyone else for that matter—is in itself telling at this point. “I would in no way argue that these [voter ID] laws have no effect, but what we’ve found is that it’s a relatively small one,” Hersh said. Making things more complicated, he added, is that the effect of a voter ID law can be difficult to separate from that of other non-ID-based measures that disenfranchise the same types of people. “It’s just very unlikely that these voter ID laws by themselves would translate into the effect of 200,000 voters,” Hersh said.
Richard Hasen, an occasional Slate contributor and a professor of law and political science at the University of California–Irvine, voiced similar concerns about the Civis findings on his blog, pointing to a New York Times story published in the weeks after the election. Reporting from Milwaukee in late November, Times national correspondent Sabrina Tavernise cited Wisconsin’s voter ID law as one potential reason why turnout was down in the city’s poor and black neighborhoods. Tavernise, though, ultimately found a bounty of anecdotal evidence that black voters were simply far less excited to vote for Clinton in 2016 than they were to pull the lever for Barack Obama in 2008 and 2012. Here again it is difficult to offer a single explanation for depressed voter turnout: If a black man in Milwaukee decides it’s not worth jumping through hoops to cast a ballot, do we explain that by citing voter enthusiasm, the ID law, or both?