research-methods
Everything on Ground Truth tagged “research-methods” — 3 items.
Gallup is testing AI agents that answer surveys for real people News
Gallup has built AI agents from in-depth interviews with about 1,000 of its panel members and is independently validating whether their simulated answers can stand in for human ones, while its partner Simile raised over $200 million at a $2 billion valuation.
Null baselines and multiple comparisons: why an untrained model can look like it learned Lesson
A null baseline is what your measurement reports when nothing happened, and it is almost never zero. Without measuring it, and without correcting for how many things you tested at once, an improvement that is pure noise will look exactly like a real result.
Ablation studies Lesson
An ablation study removes one piece of a system and re-measures it, which is how researchers show a component earns its place instead of just riding along.