When running for governor of Virginia in 1855, Henry Wise tarred his Know-Nothing opponent and the party behind him as covert abolitionists. He had a point when it came to Know-Nothings in the North, if not those Virginians he actually accused. To some degree, the natural impulses of ex-Whigs, anti-Nebraska men, and nativists ran together. All feared subversive conspiracies to seize control of the nation and dispossess them of what they saw as their birthright. All had a kind of moral panic over scandals, real and imagined, at home and abroad. Rome and slavery both turned the places where they prevailed into giant brothels, as lurid pamphlets and novels told an audience eager for scandal. If that writing also provided a socially acceptable outlet for more prurient interests, few publishers and readers would complain. To many nineteenth century Americans, nativism and antislavery thus seemed logical, congenial bedfellows.
But other northerners very much disagreed. They looked on less than 700,000 of the nation’s 14,235,000 church members and asked why the Catholics prompted such fears. So small a number hardly represented a serious threat of turning the majority-Protestant United States into a majority-Catholic papal fiefdom. They counted 2,234,602 foreign-born against 19,429,185 native-born and wondered at the panic. Nativist demographic challenges did not hold just in the South. If the Catholics intended to work ruin on the nation, they had Chief Justice Roger Taney on their side. He went to their churches, listened to their sermons, and supposedly took his orders from their Pope. Yet what calamity, they asked before Dred Scott, befell from his influence? Or from Lafayette’s decades before?
Viewed the right way, anti-immigrant and anti-Catholic paranoia could look very much like anti-aboltionist paranoia. Mobs attacked convents, but mobs had also attacked abolitionist meetings. One had murdered Elijah P. Lovejoy for the crime of abolitionism. Smart antislavery men took care where they traveled to avoid following his example. Respectable venues once refused antislavery patronage, just as the nativists would have the country refuse immigrants and Catholics. For that matter, the goals of the nativists sounded suspiciously similar to a slave system: one race, and nineteenth century Americans very much saw the Irish and, often, Catholics also, as a racial group subordinated permanently to the other via a form of despotism that would require extension over free, white Protestants to sustain itself. If that happened, the nation would have the anti-democratic impulses of slavery replicated and suffer still more for it. They had more of that than they ever wanted just from sustaining slavery.
Possibly the man who put it best had essentially quit politics some years before, after an uninspiring single term in the House of Representatives. The Kansas-Nebraska Act drew him back in. Looking on the ruins of his chosen party, Lincoln wrote to his slaveholding friend, Joshua Speed:
I am a whig; but others say there are no whigs, and that I am an abolitionist. When I was at Washington I voted for the Wilmot Proviso as good as forty times, and I never heard of any one attempting to unwhig me for that. I now do no more than oppose the extension of slavery.
Still an antislavery Whig in 1855, he knew the Know-Nothings wanted the votes of men like him. He would not have it:
I am not a Know-Nothing. That is certain. How could I be? How can any one who abhors the oppression of negroes, be in favor of degrading classes of white people? Our progress in degeneracy appears to me to be pretty rapid. As a nation, we began by declaring that “all men are created equal.” We now practically read it “all men are created equal, except negroes.” When the Know-Nothings get control, it will read “all men are created equal, except negroes, and foreigners, and catholics.” When it comes to this I should prefer emigrating to some country where they make no pretence of loving liberty—to Russia, for instance, where despotism can be taken pure, and without the base alloy of hypocracy.
Virginia’s new governor would have trouble finding a man eager to throw in with the Know-Nothings in all of that, even if he could find others who would.