Pseudoscience

James Chastek reflects on science, pseudoscience, and religion:

The demarcation problem is a name for our failure to identify criteria that can distinguish science from pseudo-science, in spite of there being two such things. In the absence of rational criteria, we get clarity on the difference from various institutional-cultural institutions, like the consensus produced by university gatekeepers though peer review (which generates, by definition, peer pressure), grants, prestige, and other stick-and-carrot means.  Like most institutions we expect it to do reasonably well (or at least better than an every-man-for-himself chaos) though it will come at a cost of group-think, elitism, the occasional witch hunt etc..

The demarcation problem generalizes to our failure to identify any meta-criterion for what counts as legitimate discourse or belief. Kant’s famous attempt to articulate meta-criteria for thought, which concluded to limiting it to an intuition of Euclidean space distinct from linear time turned out to be no limitation at all, and Davidson pointed out that the very idea of a conceptual scheme – a finite scope or limit to human thought that could be determined in advance – requires us to posit a language that is in-principle untranslatable, which is to speak of something that has to meaning. Heraclitus was right – you can’t come to the borders of thought, even if you travel down every road. We simply can’t articulate a domain of acceptable belief in general from which we can identify the auslanders.

This is true of religion as well. By our own resources we can know there are pseudo ones and truer ones, but the degree of clarity we want in this area is going to have to be borrowed from an intellect other than our own. The various religious institutions are attempts to make up for this deficiency in reason and provide us with clearer and more precise articulations of true religion in exactly the same way that we get it in the sciences. That a westerner tends to accept Christianity arises from the same sort of process that makes him tend to accept scientific consensus. He walks within the ambit of various institutions that are designed to help him toward truth, and they almost certainly succeed at this more than he would succeed if left solely to his own lights. Anyone who thinks he can easily identify true science while no one can identify true religion is right in a sense, but he doesn’t recognize how heavily his belief is resting on institutional power.

Like Sean Collins as quoted in this earlier post, Chastek seems to be unreasonably emphasizing the similarity between science and religion where in fact there is a greater dissimilarity. As discussed in the last post, a field is only considered scientific once it has completely dominated the area of thought among persistent students of that field. It is not exactly that “no one disagrees,” so much as that it becomes too complicated for anyone except those students. But those students, to an extremely high degree, have a unified view of the field. An actual equivalent in the area of religion would be if virtually all theologians accepted the same religion. Even here, it might be a bit strange to find whole countries that accepted another religion, the way it would be strange to find a whole country believing in a flat earth. But perhaps not so strange; occasionally you do get a poll indicating a fairly large percentage of some nation believing some claim entirely opposed to the paradigm of some field of science. Nonetheless, if virtually all theologians accepted the same religion, the comparison between science and religion would be pretty apt. Since that is not the case in the slightest, religion looks more like a field where knowledge remains “undeveloped,” in the way I suggested in reference to some areas of philosophy.

Chastek is right to note that one cannot set down some absolute list of rules setting apart reasonable thought from unreasonable thought, or science from pseudoscience. Nonetheless, reflecting on the comments to the previous post, it occurs to me that we have a pretty good idea of what pseudoscience is. The term itself, of course, means something like “fake science,” so the idea would be something purporting to be scientific which is not scientific.

A recurring element in Kuhn’s book, as in the title itself, is the idea of change in scientific paradigms. Kuhn remarks:

Probably the single most prevalent claim advanced by the proponents of a new paradigm is that they can solve the problems that have led the old one to a crisis. When it can legitimately be made, this claim is often the most effective one possible. In the area for which it is advanced the paradigm is known to be in trouble. That trouble has repeatedly been explored, and attempts to remove it have again and again proved vain. “Crucial experiments”—those able to discriminate particularly sharply between the two paradigms—have been recognized and attested before the new paradigm was even invented. Copernicus thus claimed that he had solved the long-vexing problem of the length of the calendar year, Newton that he had reconciled terrestrial and celestial mechanics, Lavoisier that he had solved the problems of gas-identity and of weight relations, and Einstein that he had made electrodynamics compatible with a revised science of motion.

Some pages later, considering why paradigm change is considered progress, he continues:

Because the unit of scientific achievement is the solved problem and because the group knows well which problems have already been solved, few scientists will easily be persuaded to adopt a viewpoint that again opens to question many problems that had previously been solved. Nature itself must first undermine professional security by making prior achievements seem problematic. Furthermore, even when that has occurred and a new candidate for paradigm has been evoked, scientists will be reluctant to embrace it unless convinced that two all-important conditions are being met. First, the new candidate must seem to resolve some outstanding and generally recognized problem that can be met in no other way. Second, the new paradigm must promise to preserve a relatively large part of the concrete problem-solving ability that has accrued to science through its predecessors. Novelty for its own sake is not a desideratum in the sciences as it is in so many other creative fields. As a result, though new paradigms seldom or never possess all the capabilities of their predecessors, they usually preserve a great deal of the most concrete parts of past achievement and they always permit additional concrete problem-solutions besides.

It is not automatically unscientific to suggest that the current paradigm is somehow mistaken and needs to be replaced: in fact the whole idea of paradigm change depends on scientists doing this on a fairly frequent basis. But Kuhn suggests that this mainly happens when there are well known problems with the current paradigm. Additionally, when a new one is proposed, it should be in order to solve new problems. This suggests one particular form of pseudoscientific behavior: to propose new paradigms when there are no special problems with the current ones. Or at any rate, to propose that they be taken just as seriously as the current ones; there is not necessarily anything unreasonable about saying, “Although we currently view things according to paradigm A, someday we might need to adopt something somewhat like paradigm B,” even if one is not yet aware of any great problems with paradigm A.

A particularly anti-scientific form of this would be to propose that the current paradigm be abandoned in favor of an earlier one. It is easy to see why scientists would be especially opposed to such a proposal: since the earlier one was abandoned in order to solve new problems and to resolve more and more serious discrepancies between the paradigm and experience, going back to an earlier paradigm would suddenly create all sorts of new problems.

On the other hand, why do we have the “science” part of “pseudoscience”? This is related to Chastek’s point about institutions as a force creating conformity of opinion. The pseudoscientist is a sort of predator in relation to these institutions. While the goal of science is truth, at least to a first approximation, the pseudoscientist has something different in mind: this is clear from the fact that he does not care whether his theory solves any new problems, and it is even more clear in the case of a retrogressive proposal. But the pseudoscientist will attempt to use the institutions of science to advance his cause. This will tend in reality to be highly unsuccessful in relation to ordinary scientists, for the same reason that Kuhn remarks that scientists who refuse to adopt a new paradigm after its general acceptance “are simply read out of the profession, which thereafter ignores their work.” In a similar way, if someone proposes an unnecessary paradigm change, scientists will simply ignore the proposal. But if the pseudoscientist manages to get beyond certain barriers, e.g. peer review, it may be more difficult for ordinary people to distinguish between ordinary science and pseudoscience, since they are not in fact using their own understanding of the matter, but simply possess a general trust that the scientists know the general truth about the field.

One of the most common usages of the term “pseudoscience” is in relation to young earth creationism, and rightly so. This is in fact a case of attempting to return to an earlier paradigm which was abandoned precisely because of the kind of tensions that are typical of paradigm change. Thus one of their favorite methods is to attempt to get things published in peer reviewed journals. Very occasionally this is successful, but obviously it has very little effect on the field itself: just as with late adopters or people who never change their mind, the rest of the field, as Kuhn says, “ignores their work.” But to the degree that they manage to lead ordinary people to adopt their views, this is to act in a sort of predator relationship with the institutions of science: to take advantage of these institutions for the sake of falsehood rather than truth.

That’s kind of blunt, someone will say. If paradigm change is frequently necessary, surely it could happen at least once that a former paradigm was better than a later one, such that it would be necessary to return to it, and for the sake of truth. People are not infallible, so surely this is possible.

Indeed, it is possible. But very unlikely, for all the reasons that Kuhn mentions. And in order for such a proposal to be truth oriented, it would have to be motivated by the perception of problems with the current paradigm, even if they were problems that had not been foreseen when the original paradigm was abandoned. In practice such proposals are normally not motivated by problems at all,  and thus there is very little orientation towards truth in them.

Naturally, all of this has some bearing on the comments to the last post, but I will leave most of that to the reader’s consideration. I will remark, however, that things like “he is simply ignorant of basic physics because he is a computer scientist, not a physicist,” or “Your last question tells me that you do not know much physics,” or that it is important not to “ignore the verdict of the reviewers and editors of a respected physics journal,” might be important clues for the ordinary fellow.

Technical Discussion and Philosophical Progress

In The Structure of Scientific Revolutions (p. 19-21), Thomas Kuhn remarks on the tendency of sciences to acquire a technical vocabulary and manner of discussion:

We shall be examining the nature of this highly directed or paradigm-based research in the next section, but must first note briefly how the emergence of a paradigm affects the structure of the group that practices the field. When, in the development of a natural science, an individual or group first produces a synthesis able to attract most of the next generation’s practitioners, the older schools gradually disappear. In part their disappearance is caused by their members’ conversion to the new paradigm. But there are always some men who cling to one or another of the older views, and they are simply read out of the profession, which thereafter ignores their work. The new paradigm implies a new and more rigid definition of the field. Those unwilling or unable to accommodate their work to it must proceed in isolation or attach themselves to some other group. Historically, they have often simply stayed in the departments of philosophy from which so many of the special sciences have been spawned. As these indications hint, it is sometimes just its reception of a paradigm that transforms a group previously interested merely in the study of nature into a profession or, at least, a discipline. In the sciences (though not in fields like medicine, technology, and law, of which the principal raison d’être is an external social need), the formation of specialized journals, the foundation of specialists’ societies, and the claim for a special place in the curriculum have usually been associated with a group’s first reception of a single paradigm. At least this was the case between the time, a century and a half ago, when the institutional pattern of scientific specialization first developed and the very recent time when the paraphernalia of specialization acquired a prestige of their own.

The more rigid definition of the scientific group has other consequences. When the individual scientist can take a paradigm for granted, he need no longer, in his major works, attempt to build his field anew, starting from first principles and justifying the use of each concept introduced. That can be left to the writer of textbooks. Given a textbook, however, the creative scientist can begin his research where it leaves off and thus concentrate exclusively upon the subtlest and most esoteric aspects of the natural phenomena that concern his group. And as he does this, his research communiqués will begin to change in ways whose evolution has been too little studied but whose modern end products are obvious to all and oppressive to many. No longer will his researches usually be embodied in books addressed, like Franklin’s Experiments . . . on Electricity or Darwin’s Origin of Species, to anyone who might be interested in the subject matter of the field. Instead they will usually appear as brief articles addressed only to professional colleagues, the men whose knowledge of a shared paradigm can be assumed and who prove to be the only ones able to read the papers addressed to them.

Today in the sciences, books are usually either texts or retrospective reflections upon one aspect or another of the scientific life. The scientist who writes one is more likely to find his professional reputation impaired than enhanced. Only in the earlier, pre-paradigm, stages of the development of the various sciences did the book ordinarily possess the same relation to professional achievement that it still retains in other creative fields. And only in those fields that still retain the book, with or without the article, as a vehicle for research communication are the lines of professionalization still so loosely drawn that the layman may hope to follow progress by reading the practitioners’ original reports. Both in mathematics and astronomy, research reports had ceased already in antiquity to be intelligible to a generally educated audience. In dynamics, research became similarly esoteric in the later Middle Ages, and it recaptured general intelligibility only briefly during the early seventeenth century when a new paradigm replaced the one that had guided medieval research. Electrical research began to require translation for the layman before the end of the eighteenth century, and most other fields of physical science ceased to be generally accessible in the nineteenth. During the same two centuries similar transitions can be isolated in the various parts of the biological sciences. In parts of the social sciences they may well be occurring today. Although it has become customary, and is surely proper, to deplore the widening gulf that separates the professional scientist from his colleagues in other fields, too little attention is paid to the essential relationship between that gulf and the mechanisms intrinsic to scientific advance.

As Kuhn says, this tendency has very well known results. Consider the papers constantly being published at arxiv.org, for example. If you are not familiar with the science in question, you will likely not be able to understand even the title, let alone the summary or the content. Many or most of the words will be meaningless to you, and even if they are not, their combinations will be.

It is also not difficult to see why this happens, and why it must happen. Everything we understand, we understand through form, which is a network of relationships. Thus if particular investigators wish to go into something in greater detail, these relationships will become more and more remote from the ordinary knowledge accessible to everyone. “Just say it in simple words” will become literally impossible, in the sense that explaining the “simple” statement will involve explaining a huge number of relationships that by default a person would have no knowledge of. That is the purpose, as Kuhn notes, of textbooks, namely to form connections between everyday knowledge and the more complex relationships studied in particular fields.

In Chapter XIII, Kuhn relates this sort of development with the word “science” and progress:

The preceding pages have carried my schematic description of scientific development as far as it can go in this essay. Nevertheless, they cannot quite provide a conclusion. If this description has at all caught the essential structure of a science’s continuing evolution, it will simultaneously have posed a special problem: Why should the enterprise sketched above move steadily ahead in ways that, say, art, political theory, or philosophy does not? Why is progress a perquisite reserved almost exclusively for the activities we call science? The most usual answers to that question have been denied in the body of this essay. We must conclude it by asking whether substitutes can be found.

Notice immediately that part of the question is entirely semantic. To a very great extent the term ‘science’ is reserved for fields that do progress in obvious ways. Nowhere does this show more clearly than in the recurrent debates about whether one or another of the contemporary social sciences is really a science. These debates have parallels in the pre-paradigm periods of fields that are today unhesitatingly labeled science. Their ostensible issue throughout is a definition of that vexing term. Men argue that psychology, for example, is a science because it possesses such and such characteristics. Others counter that those characteristics are either unnecessary or not sufficient to make a field a science. Often great energy is invested, great passion aroused, and the outsider is at a loss to know why. Can very much depend upon a definition of ‘science’? Can a definition tell a man whether he is a scientist or not? If so, why do not natural scientists or artists worry about the definition of the term? Inevitably one suspects that the issue is more fundamental. Probably questions like the following are really being asked: Why does my field fail to move ahead in the way that, say, physics does? What changes in technique or method or ideology would enable it to do so? These are not, however, questions that could respond to an agreement on definition. Furthermore, if precedent from the natural sciences serves, they will cease to be a source of concern not when a definition is found, but when the groups that now doubt their own status achieve consensus about their past and present accomplishments. It may, for example, be significant that economists argue less about whether their field is a science than do practitioners of some other fields of social science. Is that because economists know what science is? Or is it rather economics about which they agree?

The last point is telling. There is significantly more consensus among economists than among other sorts of social science, and consequently less worry about whether their field is scientific or not. The difference, then, is a difference of how much agreement is found. There is not necessarily any difference with respect to the kind of increasingly detailed thought that results in increasingly technical discussion. Kuhn remarks:

The theologian who articulates dogma or the philosopher who refines the Kantian imperatives contributes to progress, if only to that of the group that shares his premises. No creative school recognizes a category of work that is, on the one hand, a creative success, but is not, on the other, an addition to the collective achievement of the group. If we doubt, as many do, that nonscientific fields make progress, that cannot be because individual schools make none. Rather, it must be because there are always competing schools, each of which constantly questions the very foundations of the others. The man who argues that philosophy, for example, has made no progress emphasizes that there are still Aristotelians, not that Aristotelianism has failed to progress.

In this sense, if a particular school believes they possess the general truth about some matter (here theology or philosophy), they will quite naturally begin to discuss it in greater detail and in ways which are mainly intelligible to students of that school, just as happens in other technical fields. The field is only failing to progress in the sense that there are other large communities making contrasting claims, while we begin to use the term “science” and to speak of progress when one school completely dominates the field, and to a first approximation even people who know nothing about it assume that the particular school has things basically right.

What does this imply about progress in philosophy?

1. There is progress in the knowledge of topics that were once considered “philosophy,” but when we get to this point, we usually begin to use the name of a particular science, and with good reason, since technical specialization arises in the manner discussed above. Tyler Cowen discusses this sort of thing here.

2. Areas in which there doesn’t seem to be such progress, are probably most often areas where human knowledge remains at an early stage of development; it is precisely at such early stages that discussion does not have a technical character and when it can generally be understood by ordinary people without a specialized education. I pointed out that Aristotle was mistaken to assume that the sciences in general were fully developed. We would be equally mistaken to make such an assumption at the present times. As Kuhn notes, astronomy and mathematics achieved a “scientific” stage centuries before geology and biology did the same, and these long before economics and the like. The conclusion that one should draw is that metaphysics is hard, not that it is impossible or meaningless.

3. Even now, particular philosophical schools or individuals can make progress even without such consensus. This is evidently true if their overall position is correct or more correct than that of others, but it remains true even if their overall position is more wrong than that of other schools. Naturally, in the latter situation, they will not advance beyond the better position of other schools, but they will advance.

4. One who wishes to progress philosophically cannot avoid the tendency to technical specialization, even as an individual. This can be rather problematic for bloggers and people engaging in similar projects. John Nerst describes this problem:

The more I think about this issue the more unsolvable it seems to become. Loyal readers of a publication won’t be satisfied by having the same points reiterated again and again. News media get around this by focusing on, well, news. News are events, you can describe them and react to them for a while until they’re no longer news. Publications that aim to be more analytical and focus on discussing ideas, frameworks, slow processes and large-scale narratives instead of events have a more difficult task because their subject matter doesn’t change quickly enough for it to be possible to churn out new material every day without repeating yourself[2].

Unless you start building upwards. Instead of laying out stone after stone on the ground you put one on top of another, and then one on top of two others laying next to each other, and then one on top of all that, making a single three-level structure. In practice this means writing new material that builds on what came before, taking ideas further and further towards greater complexity, nuance and sophistication. This is what academia does when working correctly.

Mass media (including the more analytical outlets) do it very little and it’s obvious why: it’s too demanding[3]. If an article references six other things you need to have read to fully understand it you’re going to have a lot of difficulty attracting new readers.

Some of his conclusions:

I think that’s the real reason I don’t try to pitch more writing to various online publications. In my summary of 2018 I said it was because I thought my writing was to “too idiosyncratic, abstract and personal to fit in anywhere but my own blog”. Now I think the main reason is that I don’t so much want to take part in public debate or make myself a career. I want to explore ideas that lie at the edge of my own thinking. To do that I must assume that a reader knows broadly the same things I know and I’m just not that interested in writing about things where I can’t do that[9]. I want to follow my thoughts to for me new and unknown places — and import whatever packages I need to do it. This style isn’t compatible with the expectation that a piece will be able to stand on its own and deliver a single recognizable (and defensible) point[10].

The downside is of course obscurity. To achieve both relevance in the wider world and to build on other ideas enough to reach for the sky you need extraordinary success — so extraordinary that you’re essentially pulling the rest of the world along with you.

Obscurity is certainly one result. Another (relevant at least from the VP’s point of view) is disrespect. Scientists are generally respected despite the general incomprehensibility of their writing, on account of the absence of opposing schools. This lack leads people to assume that their arguments must be mostly right, even though they cannot understand them themselves. This can actually lead to an “Emperor has No Clothes” situation, where a scientist publishes something basically crazy, but others, even in his field, are reluctant to say so because they might appear to be the ones who are ignorant. As an example, consider Joy Christian’s “Disproof of Bell’s Theorem.” After reading this text, Scott Aaronson comments:

In response to my post criticizing his “disproof” of Bell’s Theorem, Joy Christian taunted me that “all I knew was words.”  By this, he meant that my criticisms were entirely based on circumstantial evidence, for example that (1) Joy clearly didn’t understand what the word “theorem” even meant, (2) every other sentence he uttered contained howling misconceptions, (3) his papers were written in an obscure, “crackpot” way, and (4) several people had written very clear papers pointing out mathematical errors in his work, to which Joy had responded only with bluster.  But I hadn’t actually studied Joy’s “work” at a technical level.  Well, yesterday I finally did, and I confess that I was astonished by what I found.  Before, I’d actually given Joy some tiny benefit of the doubt—possibly misled by the length and semi-respectful tone of the papers refuting his claims.  I had assumed that Joy’s errors, though ultimately trivial (how could they not be, when he’s claiming to contradict such a well-understood fact provable with a few lines of arithmetic?), would nevertheless be artfully concealed, and would require some expertise in geometric algebra to spot.  I’d also assumed that of course Joy would have some well-defined hidden-variable model that reproduced the quantum-mechanical predictions for the Bell/CHSH experiment (how could he not?), and that the “only” problem would be that, due to cleverly-hidden mistakes, his model would be subtly nonlocal.

What I actually found was a thousand times worse: closer to the stuff freshmen scrawl on an exam when they have no clue what they’re talking about but are hoping for a few pity points.  It’s so bad that I don’t understand how even Joy’s fellow crackpots haven’t laughed this off the stage.  Look, Joy has a hidden variable λ, which is either 1 or -1 uniformly at random.  He also has a measurement choice a of Alice, and a measurement choice b of Bob.  He then defines Alice and Bob’s measurement outcomes A and B via the following functions:

A(a,λ) = something complicated = (as Joy correctly observes) λ

B(b,λ) = something complicated = (as Joy correctly observes) -λ

I shit you not.  A(a,λ) = λ, and B(b,λ) = -λ.  Neither A nor B has any dependence on the choices of measurement a and b, and the complicated definitions that he gives for them turn out to be completely superfluous.  No matter what measurements are made, A and B are always perfectly anticorrelated with each other.

You might wonder: what could lead anyone—no matter how deluded—even to think such a thing could violate the Bell/CHSH inequalities?

“Give opposite answers in all cases” is in fact entirely irrelevant to Bell’s inequality. Thus the rest of Joy’s paper has no bearing whatsoever on the issue: it is essentially meaningless nonsense. Aaronson says he was possibly “misled by the length and semi-respectful tone of the papers refuting his claims.” But it is not difficult to see why people would be cautious in this way: the fear that they would turn out to be the ones missing something important.

The individual blogger in philosophy, however, is in a different position. If they wish to develop their thought it must become more technical, and there is no similar community backing that would cause others to assume that the writing basically makes sense. Thus, one’s writing is not only likely to become more and more obscure, but others will become more and more likely to assume that it is more or less meaningless word salad. This will happen even more to the degree that there is cultural opposition to one’s vocabulary, concepts, and topics.