The Frenchman, who was dropped to the bench for the game, was furious at Riley's decision to hand Luis Boa Morte his second yellow card for diving after a challenge from Herman Hreidarsson.
"It was a game without a referee for us," blasted Saha. "He was a joke and it was very difficult to play with him against us."
Many thought that Boa Morte should not have been on the pitch at the time after his clash with Fabien Wilnis resulted in just a booking.
A dreadful day for the former Arsenal man also saw his woeful penalty sail wide of the post, although it could now be Saha that is in trouble for his comments about the official.
Cottagers boss Jean Tigana went for Riley immediately after the final whistle, while skipper Andy Melville had more support for the man in the middle.
"Jean was frustrated and wanted to get his point across," said Melville.
"The referee's only got a split-second to make a decision, but there were some big decisions and we were a bit disappointed with them.
"The lads thought Hreidarsson might have caught Luis with his knee, but referees have got to make decisions.
"They have someone who sits in the crowd and assesses them, so they're under orders and they've got a difficult job.
"Luis is very disappointed. He's obviously down about what happened. He hasn't said anything, and there's not much you can say to someone who's that disappointed."
