Hey HN,
We analyzed 4,010,957 Hacker News submissions to find what actually makes posts perform well.
Key findings:
- 93.2% of posts never hit 50 points
- Top 1% starts at 270 points
- Certain keywords boost engagement by 1000%+
Built a free tool that scores your launch title and predicts viral potential: [link]
The entire 4M post dataset is available as a single 700MB .mv2 file if you want to run your own analysis.
That's not a methodology paper and it doesn't explain how the model being advertised works in the spirit of open machine learning research; given that the startup is an AI startup, I assume that the actual model is more sophisticated. As Section 8 notes: "This analysis is descriptive and intended to summarize empirical patterns."
It's an exploratory data analysis which not only does not explain the methodology around how the model is constructed, but it also makes a number of assumptions that imply the people making it without proper context of how Hacker News works:
1. The extreme right-skewed nature should have raised a very large number of flags in the statistical methodology and calculations, but it mostly ignores them. The mean values are effectively useless, the p-values even more useless. It doesn't point out that the negative performing terms are likely spam.
2. It does not question why there are so few questions with a title >80 characters (answer: 80 characters is the max for a HN submission)
3. The analysis separates day of the week and hour: you can't do that. They're intrinsically linked and weekend behavior with respect to activity is far different than on weekdays.
4. "Title length has a weak relationship with score (Pearson r = -0.017, Spearman r = 0.048, n = 100k)". No statistician would call that a weak correlation; those values are effectively no correlation.
There is also no person tied to this paper, just the "Memvid Research Team", which raises further questions.