This wasn’t the result of Brexit; it was the result of Corbyn’s leadership. Labour was not a hard Remain Party like the Liberal Democrats. They campaigned for a second referendum, not to rescind Article 50.
Working-class voters did not turn away from Corbyn because of Brexit, they turned against him because they were unconvinced by his radical left manifesto that touted the evils of capitalism. In one poll, voters said the second-biggest concern with Jeremy Corbyn as Prime Minister was that he would spend too much and put the country into more debt. This has nothing to do with Brexit or immigration, just Jeremy Corbyn’s reckless fiscal policy.