It will be difficult for Harry Redknapp's successor to maintain the success Spurs enjoyed under him, Paul Walsh told Sky Sports News.
Redknapp left Spurs earlier this week and after David Moyes was installed as the bookies' favourite to succeed him it was reported Andre Villas-Boas is interested in the role.
However, former Tottenham front man Walsh believes whoever takes the reins next at White Hart Lane will have big shoes to fill.
"It's a difficult job for any manager who goes there to try and maintain what Harry Redknapp did," Walsh said.
"Maintaining fourth spot and the expectation that's been built up by Harry, will be a difficult thing to do. Redknapp was fantastic for Spurs and I think getting rid of him is a mistake by Tottenham.
"If Villas-Boas does get the job he will have to learn a few things from is experience at Chelsea. He certainly didn't manage the more experienced players there very well, in my opinion. That was evident from the change Roberto Di Matteo made.
"But in terms of the size of the club, I don't think there are many better opportunities than Tottenham to get back into the game."
Moyes respected
Walsh was full of praise for Everton boss David Moyes, although he did have concerns over how the Scot would get on with a bigger budget than he's used to at his disposal.
"Moyes punches considerably above his weight every season," he said. "He gets the most out of his player, they love playing for him, they respect him, he takes no nonsense and he doesn't complain publicly about the financial situation at Everton. He's at the front of the line of people you'd have to consider.
"The only thing is he's never spent big bucks - apart from Marouane Fellaini, who cost £13m. Once you get to a club with a bit more money to spend it brings you another type of problem. Kenny Dalglish can tell you about that at Liverpool. He spent £110m and the players haven't done the job that was hoped. Once you get the money you have to spend it well."