Charlie, we were not discussing what constitutes good science in our debate therefore what constitutes good science is irrelevant in our discussion.
The authors of the paper showing that 64% of published findings didn't replicate were well meant. They didn't want to damage the science of psychology so they spun the results in the best possible light. You bought their angle. I didn't. But it doesn't matter in our debate. It's irrelevant.
What does matter is that the quality of psi publishing can't be assumed to be of lesser quality than mainstream publishing (I don't recall if it was you or another poster who argued that mainstream publishing could be assumed to be of much higher quality).
Good science is central to this conversation, because you seem to think if studies fail replication, that somehow means it low quality research,
as if the scientific method is perfect already. Good science is finding failures and figuring out how to fix them. Bad science is maliciously making up figures, like
Wakefield's research that vaccinations cause autism. The failed replications do not necessarily mean the research itself did not find anything or that they found false positives. You of all people should know this because you're sticking to psi research no matter what, lol. There may be problems in the replication procedure. For instance attempting to copy how the study was done exactly is part of replicating the research. There may have been variables that were not accounted for.
In the paper, they found it was more likely a study would be significant and have similar effect sizes if the instructions were simple. This means that the scientific methods needs improvement explaining the procedure more thoroughly. Other things that could happen in the original research is P hacking, bias influences, small sample sizes, and a number of confounding variables. For instance, something as simple as the participants knowing what's going on can change the results. This doesn't mean it's low quality research. For arguments sake, If this is really low quality research then so is every psi research study out there, because they all fail the replication process. In reality, them finding failures in replication means the scientific method needs to be improved. It bears no bearing on low quality research. One of the problems with human research is that we're incredibly difficult to pin down, however, when a theory holds water it really holds water. The quality of the research is largely judged during the peer review process and different journals will have varying levels of prestige and difficulty getting in.
Let's assume that what you say is fact. How do you know that the original wasn't simply an over-estimate based on a statistical error? If there has been a positive effect in all those tests, it's evidence that a psi effect exists in humans and that, logically, some people are probably more gifted than others.
I don't know, that's the thing. It is logical to surmise something went on in psi research, but, as far as science is concerned, it's not been been demonstrate for any scientific consensus. For science, a theory needs to be (1) falsifiable (2)verifiable and (3) reproducible. Psi lacks in reproducibility and gets worse and worse. I can show the difference, if you want, between 30-50 year research to today.
You're having double standards if you say the 64% of studies that failed
one replication is poor research quality but say psi is good research quality when they have failed numerous replication attempts. This is what happens when you get too close to something.