Sunderland striker Jermain Defoe scored an 89th-minute equaliser as Liverpool - without their ill manager Jurgen Klopp - squandered a two-goal lead to draw 2-2 at Anfield.
Second-half goals from Roberto Firmino and Adam Lallana appeared to have put the home side in full control with 20 minutes remaining.
But the way they defended after that would have had Klopp, who missed the game with a suspected appendicitis, turning in his sick bed.
Substitute Adam Johnson's free-kick somehow beat Simon Mignolet at his near post before Defoe equalised at the death.
The result may have come as a surprise to the few thousand Liverpool fans who staged the first walkout in Anfield's 132-year history.
It came in the 77th minute, in protest at rising ticket prices next season, and with their side apparently heading for a straightforward victory.
However, seasoned Liverpool watchers will know it is rarely straightforward with this team, especially considering their defensive record, and Sunderland snatched a point which barely seemed possible with 10 minutes to go.
Klopp's number two Zeljko Buvac was put in charge, although the Serbian was hardly visible in the technical area never mind being as animated as his boss.
The home team, who surprisingly included Daniel Sturridge on the bench for his first appearance in the squad in two months, although he did not get on, were even less animated in the first half against a Sunderland side which lined up 4-5-1 with centre-back Jan Kirchhoff deployed as a stopper in central midfield.
Despite pushing on both full-backs, Liverpool struggled to find a way through the visitors' massed ranks, although their fluency was not helped by yet more hamstring injuries to defender Dejan Lovren and Joe Allen, on his first Premier League start for two months.
Sunderland were so happy to let their opponents have the ball Liverpool enjoyed an incredible 82 per cent possession in the opening 45 minutes but managed just one shot on target.
Left-back Alberto Moreno forced Vito Mannone into that save after being played in by Lallana, with the defender also managing to balloon over a stooping header from close range on the stroke of half-time.
Liverpool upped the tempo after the break with Firmino suddenly sparking into life, producing one nutmeg and shot just wide, before making the crucial breakthrough when he headed home Milner's far-post cross in the 59th minute.
The Brazilian then provided a simple pass for Lallana, who had just seen his shot saved by Mannone's legs, to score the second in the 70th minute.
Patrick van Aanholt should have made things more anxious for the hosts but fired into the side-netting with the goal at his mercy, however Liverpool's job was made more challenging when Mignolet was beaten at his near post by Johnson's 82nd-minute free-kick.
Worse was to follow as Defoe turned Mamadou Sakho to equalise and leave those remaining inside Anfield with something else to complain about.
TWEET OF THE MATCH
Former Black Cats left-back Michael Gray (@mickygray33): "Great comeback lads. A point that could go a long way come the end of the season #SAFC"
PLAYER RATINGS
Liverpool
Simon Mignolet: 4
Nathaniel Clyne: 6
Dejan Lovren: 5
Mamadou Sakho: 5
Alberto Moreno: 6
Jordan Henderson: 6
Emre Can: 5
Joe Allen: 6
James Milner: 6
Roberto Firmino: 7
Adam Lallana: 6
Substitutes
Kolo Toure (on for Lovren, 12): 6
Jordon Ibe (on for Joe Allen, 45): 6
Lucas Leiva (on for Henderson, 86): 5
Sunderland
Vito Mannone: 5
Billy Jones: 6
John O'Shea: 6
Jan Kirchoff: 6
Lamine Kone: 6
Patrick van Aanholt: 7
Yann M'Vila: 6
Lee Cattermole: 5
Duncan Watmore: 5
Wahbi Khazri: 6
Jermain Defoe: 6
Substitutes
Dame N'Doye (on for Watmore, 26): 6
Adam Johnson (on for Kirchoff, 66): 6
Deandre Yedlin (on for Jones, 75): 5
STAR MAN
Roberto Firmino sparked into life after half-time, scoring one and creating the other and was only let down by defensive lapses at the back again.
MOMENT OF THE MATCH
Adam Johnson's free-kick which beat Simon Mignolet at the near post turned the tide in Sunderland's favour.
VIEW FROM THE BENCH
With Jurgen Klopp absent with a suspected appendicitis number two Zelkjo Buvac was left in charge but was a less prominent and more composed figure on the touchline than his boss. Had to cope with two first-half injuries but everything seemed to be going to plan until a late capitulation. Sam Allardyce set up his side to frustrate and they succeeded in doing that for an hour but even at 2-0 down they stayed in the game and snatched a point.
MOAN OF THE MATCH
Liverpool's defensive incapability again. Mignolet should have done better with the first and Sakho similarly with the second.
WHO'S UP NEXT?
West Ham v Liverpool (FA Cup, Tuesday February 9)
Sunderland v Manchester United (Premier League, February 13)
Source: PA
