I’m a 100% with you, and this is why I’m supporting the Proposal that removes this for a challenge reason.
The reason why the deposit is what it is now exceeds a little bit of what PoH can currently do. The contract sits in the Ethereum network and the amount of ETH is just enough to make the challenger task worth doing, and thus keeping the registry safe. Right now the abusive behaviour of challengers is considered by some as just collateral damage (I do not). Check this post to see how tricky it is to change the base deposit in PoH.
This solution is very tricky to implement in terms of the technicalities of how a Smart Contract works. The current contract is immutable and those changes would require that everything burns to the ground.
There are several independent efforts on this front. Currently site maintenance is understaffed (or non-staffed?) and every solution comes from very generous developers that send some pull request to the website repository. So if you are (or know someone who is) a dev, please help us.