Home » Archive by category "Metrics"

Data Is A People Problem

I've found that "having the data" is about half the effort. The other half is not how to make it compelling. The data was always compelling in my experience because it generally showed that we were making poor decisions. That rarely went over well.
Continue reading »

Dealing with the Uncertainty in Scientific Results

MOST EVIDENCE IN the empirical sciences is statistical in nature, and scientists rely on a variety of statistical tests to distinguish valid scientific discoveries from spurious ones. Unfortunately, there is a growing recognition that many important research findings based on statistical evidence are not reproducible,...
Continue reading »

Doing The Impossible By Using Simple Math

This is not to say Musk will realize his most ambitious goals: landing on Mars, electrifying much of the world’s transportation fleet, and accelerating the transition from a fossil-fuel to a carbon-free economy. But each is closer than most thought possible in such a short...
Continue reading »

Lies, Damn Lies, and Project Statistics

Harvey’s term for torturing the data until it confesses is “p-hacking,” a reference to the p-value, a measure of statistical significance. P-hacking is also known as overfitting, data-mining—or data-snooping, the coinage of Andrew Lo, director of MIT’s Laboratory of Financial Engineering. Says Lo: “The more...
Continue reading »

The Magic of Just Putting a Spotlight on a Problem

The team’s mission is to design policy interventions based on a scientific understanding of human behavior. Recently, for instance, hoping to fight antimicrobial resistance, they tried to persuade some prescription-happy doctors to go easy on the antibiotics. GALLAGHER: We had a very simple intervention, which...
Continue reading »

Murder He Calculated

Threats of federal intervention aside, it will be difficult to fix the problem of high murder rates without first addressing clearance rates. So it’s fortuitous, perhaps, that we are living in an age in which the analysis of data is supposed to help us decipher,...
Continue reading »

Use Your Dark Data

In the same way that dark matter is an unseen but very large part of the cosmos , dark data represents the unseen but very large part of the data that most corporations collect and store.
Continue reading »

You Are Only As Good As Your Project Data

As you’ve probably heard, while Hillary Clinton won the majority of the popular vote, Donald Trump was awarded more than 270 votes in the Electoral College. Many, particularly on social media, were incredulous, partly at the candidates but also at the pollsters — in particular,...
Continue reading »