05������������������������,What Can You Say When Your P

P-values are frequently misinterpreted, which causes many problems. I won't rehash those problems here since we have the rebutted the concerns over p-values in Part 1.  But the fact remains that the p-value will continue to be one of the most frequently used tools for deciding if a result is statistically significant. 

You know the old saw about "Lies, damned lies, and statistics," right?  It rings true because statistics really is as much about interpretation and presentation as it is mathematics. That means we human beings who are analyzing data, with all our foibles and failings, have the opportunity to shade and shadow the way results get reported. 

While I generally like to believe that people want to be honest and objective—especially smart people who do research and analyze data that may affect other people's lives—here are 500 pieces of evidence that fly in the face of that belief. 

We'll get back to that in a minute. But first, a quick review...

What's a P-Value, and How Do I Interpret It?

Most of us first encounter p-values when we conduct simple hypothesis tests, although they also are integral to many more sophisticated methods. Let's use Minitab Statistical Software to do a quick review of how they work (if you want to follow along and don't have Minitab, the full package is available free for 30 days). We're going to compare fuel consumption for two different kinds of furnaces to see if there's a difference between their means. 

Go to File > Open Worksheet, and click the "Look in Minitab Sample Data Folder" button. Open the sample data set named Furnace.mtw, and choose Stat > Basic Statistics > 2 Sample t... from the menu. In the dialog box, enter "BTU.In" for Samples, and enter "Damper" for Sample IDs.

Press OK and Minitab returns the following output, in which I've highlighted the p-value. 

In the majority of analyses, an alpha of 0.05 is used as the cutoff for significance. If the p-value is less than 0.05, we reject the null hypothesis that there's no difference between the means and conclude that a significant difference does exist. If the p-value is larger than 0.05, we cannot conclude that a significant difference exists. 

That's pretty straightforward, right?  Below 0.05, significant. Over 0.05, not significant. 

minitab-statistical-software-talk-to-minitab

"Missed It By That Much!"

In the example above, the result is clear: a p-value of 0.7 is so much higher than 0.05 that you can't apply any wishful thinking to the results. But what if your p-value is really, really close to 0.05?  

Like, what if you had a p-value of 0.06? 

That's not significant. 

Oh. Okay, what about 0.055?

Not significant. 

How about 0.051?

It's still not statistically significant, and data analysts should not try to pretend otherwise. A p-value is not a negotiation: if p > 0.05, the results are not significant. Period.

So, what should I say when I get a p-value that's higher than 0.05?  

How about saying this? "The results were not statistically significant." If that's what the data tell you, there is nothing wrong with saying so. 

No Matter How Thin You Slice It, It's Still Baloney.

Which brings me back to the blog post I referenced at the beginning. Do give it a read, but the bottom line is that the author cataloged 500 different ways that contributors to scientific journals have used language to obscure their results (or lack thereof). 

As a student of language, I confess I find the list fascinating...but also upsetting. It's not right: These contributors are educated people who certainly understand A) what a p-value higher than 0.05 signifies, and B) that manipulating words to soften that result is deliberately deceptive. Or, to put it in words that are less soft, it's a damned lie.

Nonetheless, it happens frequently. 

Here are just a few of my favorites of the 500 different ways people have reported results that were not significant, accompanied by the p-values to which these creative interpretations applied:  

a certain trend toward significance (p=0.08)approached the borderline of significance (p=0.07)at the margin of statistical significance (p
【领克领克05】领克_领克领克05报价_价格_领克领克05图片 ...05.com - Pre Market Call | AI analysisHC-05蓝牙无线模块设置_走过_冬天的博客-CSDN博客_hc ...HC-05蓝牙模块使用教程_private_void_main的博客-CSDN ...HC-05与HC-06的AT指令的区别 - Being_young - 博客园JP 3-05, Special Operations微信,是一个生活方式What Can You Say When Your P-Value is Greater Than 0.05?RINEX - IGSmysql连接Java报java.sql.SQLException: The server time zone value ‘�й���׼ʱ��‘ is ...解决AndroidStudio报错显示���的问题报错The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than one ...使用JDBC连接数据库出现The server time zone value ‘�й���׼ʱ��‘ is unrecognized 的解决方案连接mysql数据库报错java.sql.SQLException: The server time zone value '�й���׼ʱ��' is ...项目启动报错:java.sql.SQLException: The server time zone value ‘�й���׼ʱ��‘ is ...springBoot连接数据库错误: The server time zone value ‘�й���׼ʱ��‘ is unrecognized or ...【异常】springBoot连接数据库错误: The server time zone value ‘�й���׼ʱ��‘ is unrecognized...Java编译时出现����,黑色菱形里面有问号,为什么?jdbc连接数据库报错:The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents ...InvalidConnectionAttributeException: The server time zone value '�й���׼ʱ��' is unrecog-...mysql连接出错,报The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents ...the server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than one time ...The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than one time ...Java 掉坑之The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than...连接mysql报错java.sql.SQLException: The server time zone value ‘�й���׼ʱ��‘ is ...使用JDBC连接MySql时出现:The server time zone value ‘�й���׼ʱ��‘ is unrecognized or ...FreeBSD 6 手��� MySQL5 (最佳化)(ZT)Java.sql.SQLException: The server time zone value ‘й���׼ʱ��‘ is unrecognized or represents...generate (default-cli) on project mall: The server time zone value ‘�й���׼ʱ��‘ is ...java.sql.SQLException: The server time zone value ‘�й���׼ʱ��‘ is unrecognized or ...‘“node“‘ �����ڲ����ⲿ���Ҳ���ǿ����еij������������ļ��� ...在使用springboot+jpa+mysql时出现The server time zone value ‘�й���׼ʱ��‘ is unrecognized ...java.sql.SQLException The server time zone value ‘�й���׼ʱ��‘....及数据库时间与本地时间不...关于sql异常The server time zone value ‘�й���׼ʱ��‘ is unrecognized or represents more than...androidx.fragment.app.Fragment�޷�ת��Ϊandroid.app.Fragment fragmentTransaction.replace报错ADODB.Connection ���� ‘800a0e7a’ win7 IIS运行ASP常见问题及解决方法java?e7?a8??e9?a8ӿEasyClick易点云测 执行错误:Didn‘t find ...com.js.sad���͵�"; on path: DexPathList 解决方法