Sorry about the dupe. Missed it yesterday and it looks like it's re-sourced here.

You'd think we'd have some kind of spiffy dupe-detection code here, huh?

If you submit the same link twice it catches it, but there's no logic to try to detect the same story reported in different locations.

Some link sites (like DZone) will go out and load the page in question once the link is submitted. I know DZone makes a neat little thumbnail of the site, but seems like you could also do some basic text analysis while you're at it.

Not sure it's worth it, though. I don't think the dupe ratio here is that high.

Hacker news uses crowdsourcing.