Bury boss Richie Barker was still ruing two points dropped after skipper Steven Schumacher netted a late leveller against Chesterfield.
The resurgent Spireites looked set for their third win in four league games after former Bury loanee Nicky Ajose gave them a 42nd-minute lead with his first goal while on loan from Peterborough.
But with just two minutes left, Schumacher headed home to give the Shakers a deserved draw.
"We should have won it," said Barker. "I think the man of the match was their keeper so it proves we did something right.
"We've managed to come out with a point having only played for 45 minutes, but I'm disappointed - we wasted 45 minutes again.
"Once we learn to play for 90 minutes we'll not be a bad team. We hadn't played for two weeks and, if I'm honest, it looked like it."