Avram Grant was reluctant to blame Frederic Piquionne for costing his side victory in a pulsating 2-2 draw against Everton.
The Hammers seemed on course for three points which would have taken them out of the bottom three as Piquionne headed them in front for the second time with six minutes left to play.
However, the Frenchman was sent off for celebrating with fans and the Hammers were denied when Marouane Fellaini struck deep into stoppage time.
The visitors had taken the lead after Jonathan Spector found the net for the fourth time in two months but Diniyar Bilyaletdinov came off the Everton bench to level.
Grant defended Piquionne as he told Sky Sports: "What is football about? It is about celebrating and emotions.
"Ok, Freddie needs to know that he's on a yellow card. He scored a goal but he did the right thing because he went to celebrate with the supporters.
"He has not done anything wrong - he went to celebrate with the people who deserve to more than anybody.
"I know it is the law but it is a stupid law and we need to change it.
"You never know but I think if we had stayed with 11 players we would have won the game because we were the better team.
"They didn't create chances but when we were a man short it was a little difficult."
The Hammers boss was full of praise for his side despite conceding a stoppage time equaliser.
He continued: "They showed a lot of good spirit, a lot of good football and a lot of tactical awareness.
"We dominated the game in the first half and could have scored more - we hit the post and another was offside.
"We created a lot of chances and after scoring the second one we were unlucky.
"Since the beginning of the season the players have shown a lot of commitment. I am very proud of the players."