HIV/AIDS Skepticism

Pointing to evidence that HIV is not the necessary and sufficient cause of AIDS

Abuses of statistics in HIV/AIDS research

Posted by Henry Bauer on 2009/09/14

There are many ways of lying under the cover of statistics. One that I’ve not previously emphasized is to imply a correlation where none exists; for example, “the declining incidence in the control group in Rakai — which, although not statistically significant, reduces the difference between the groups” [emphasis added; Gray et al., “Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial”, Lancet, 369 (2007) 657-66].

The whole point of this type of statistical analysis is to determine whether or not an association plausibly exists. If there is no statistically significant association, then no association has been found.
The proper statement would be significantly different:
“The declining incidence apparently had nothing to do with the difference between groups”.

Here’s another example: “The odds of being HIV-positive were nonsignificantly lower among MSM who were circumcised than uncircumcised (odds ratio, 0.86; 95% confidence interval, 0.65-1.13; number of independent effect sizes [k]=15)” (emphasis added; Millett et al., “Circumcision status and risk of HIV and sexually transmitted infections among men who have sex with men”, JAMA, 300 [2008] 1674-84).
The enumeration of odds ratio, confidence interval, and effect sizes conveys a sense of technical correctness which, whether intended or not, lends rhetorical weight to the assertion of “lower” when, in actual technical fact, no significance has been established at the 95% probability level.
It is unwarranted, irresponsible, pseudo-scientific to say “nonsignificantly lower”, because that suggests that it is actually lower, though perhaps for purely technical statistical reasons not statistically significantly so.

Again: If the statistics delivers a verdict of “not significant”, then nothing has been established, not lower and not higher. Once more the proper statement would be significantly different:
“No association was found between circumcision and ‘HIV’ status”.

The silver lining in these instances, such as it is, is that I have stimulated many belly laughs — though also some very puzzled expressions — by inviting statistically literate friends to explain to me what “nonsignificantly lower” means.

The dark clouds, however, are that these people — who work at the Centers for Disease Control and Prevention, no less — are capable of writing such a phrase. They are either statistically illiterate or seeking deliberately to deceive. I don’t know which of those two would be the more depressing.

It is also worth noting and regretting that these statistical illiteracies passed the editorial- and peer-review processes of the Lancet and the Journal of the American Medical Association. “Peer review” is no better than the reviewers and the editors make it.

*********************

Oxymoronic jargon like “nonsignificantly lower” surely comes about because of an unshakeable belief that there is — must be — a lowering, in the face of data that do not support the belief. There exists a persistent unwillingness among HIV/AIDS mainstreamers to accept facts that contradict their belief — they suffer cognitive dissonance, as I’ve had occasion to remark all too often [Cognitive dissonance: a human condition, 26 December 2008; The debilitating distraction of “HIV”, 21 December 2008; State of HIV/AIDS denial: carcinogenic HAART, 21 November 2008; True Believers of HIV/AIDS: Why do they believe despite the evidence?, 30 October 2008; “SMART” Study begets more cognitive dissonance, 11 June 2008; Death, antiretroviral drugs, and cognitive dissonance, 9 May 2008; HIV/AIDS illustrates cognitive dissonance, 29 April 2008].

Of course, one might try to argue that “95%” is just an arbitrary criterion: one could choose 85%, or 70%, or any other value; or one might say that “lower” is simply expressing the raw numbers in words without attempting statistical analysis to attach a particular probability. But that would mean jettisoning any pretence of being scientific by using statistics to guide judgment as to whether an effect is plausibly real or not. If one offers statistical details then one should also abide by what the statistical analysis concludes and not try to fudge it.

*******************

Another abuse of statistical analysis that also may not be obvious until made explicit:

Upon finding  no correlation, divide the data into sub-groups in the hopes that one or other might show an apparently significant effect. This is statistically improper, a prelude to lying with statistics, because if you look at enough sub-groups the probability becomes appreciable that there will be found one or a few that appear to have a statistically significant association. Recall that if one uses a criterion as weak as “95% probability”, one apparently but not actually significant association will show up on average at least once in every twenty times — more often if the looked-for association is inherently unlikely [R. A. J. Matthews, “Significance levels for the assessment of anomalous phenomena”, Journal of Scientific Exploration 13 (1999) 1-7].

In the present instance, there was no association in the sub-group of insertive anal sex, nor between circumcision and sexually transmitted infections, two sub-groups where an association would not be implausible. On the other hand, highly implausible apparent associations were noted in studies conducted before the introduction of HAART, and between “HIV”-preventive circumcision and study quality. It is not easy to conceive why an association between circumcision and “HIV” acquisition would have anything at all to do with what treatment is provided people who have AIDS, long after acquiring “HIV”; and “study quality” is a highly subjective variable.

No. The Millett article leads to only one legitimate conclusion: No association found between circumcision and “HIV” status among MSM.

*******************

The problem for HIV/AIDS dogmatists is that they have failed to find any way of preventing people from becoming “HIV-positive”. The mistaken view that it has to do with infection and with sex keeps them searching for data to support that view, rather as rats or guinea pigs are doomed to try eternally to scale the turning wheels in their cages. Study after study gives the same result, no association. At the 4th International AIDS Society Conference, Sydney 2007:
Guanira et al., “How willing are gay men to ‘cut off’ the epidemic? Circumcision among MSM in the Andean region”)
— “No association between circumcision and HIV infection when all the sample is included. A trend to a significant protective effect is seen when only ‘insertive’ are analyzed.”
Note again the unwarranted, illegitimate attempt to assert something despite the lack of evidence: a “trend” toward a significant effect, when the statistical analysis simply says “nothing”, no correlation.
Then there was Templeton et al., “Circumcision status and risk of HIV seroconversion in the HIM cohort of homosexual men in Sydney”)
— “Circumcision status was not associated with HIV seroconversion . . . . However, further research in populations where there is more separation into exclusively receptive or insertive sexual roles by homosexually active men is warranted” [emphasis added].
More research is always warranted, of course, that’s what pays the researchers’ bills [Inventing more epidemics; the Research Trough; and “peer review”, 2 August 2009; The Research Trough — where lack of progress brings more grants, 10 September 2008].

8 Responses to “Abuses of statistics in HIV/AIDS research”

  1. “There exists a persistent unwillingness among HIV/AIDS mainstreamers to accept facts that contradict their belief…”

    Henry,

    That is exactly what makes “HIV/AIDS” a religion. There does not exist one single religious group on Earth whose zealots would accept facts that contradict their belief.

  2. Philip said

    This is not just true of studies like this, but also of Big Pharma finding the best way to “present” their drugs via studies chock full of misrepresentation of numbers.

  3. MacDonald said

    Slightly off topic, but relating to the belief system of HIV-ists.

    Jeanne Bergmann has just posted this remarkable version of the Biblical saying, either you are with me or you are against me:

    The filmmaker, Brent Leung, told a Huffington Post blogger: “I am not a denialist. Posing questions is very different than denying something. … I traveled the globe speaking with scientists, activists, clinicians, journalists and patients asking questions. My main goal? To educate myself and others, and to generate discussion on important questions that have not yet been answered.” But Leung is an HIV denialist — he has said he is “neutral” on the issue of HIV/AIDS, which means he rejects the evidence-based science that has conclusively proved the existence of HIV and its causative role in AIDS, a fatal disease syndrome.

    If you do not accept the HIV/AIDS dogma unquestionably, without qualification or caveat — nay, even if you are accepting it, but remain open to the possibility that it could be proved wanting or wrong in part or whole you are rejecting evidence-based science.

    There’s an oxymoron for you.

    Bergmann goes on to state:

    His film is supported and promoted only by denialists

    The real interpretation of this statement is that, if you agree that the movie raises any relevant questions, you are per definition a denialist.

    The uncompromising demand for absolute faith becomes even more remarkable when one considers that it is a lawyer who makes it, not a scientist or even anyone who claims to have expert knowledge of the issues.

  4. Philip said

    “the declining incidence in the control group in Rakai — which, although not statistically significant, reduces the difference between the groups” [emphasis added; Gray et al., “Male circumcision for HIV prevention in men in Rakai, Uganda: a randomised trial”, Lancet, 369 (2007) 657-66].

    a bit off topic, but I must say this: so when it counters the “mainstream” thought, one can ignore the fact that some numbers are “not statistically significant”. Yet in studies concerning complementary medicine, like acupuncture and herbs, they throw the “not statistically significant” statement around like it was the smoking gun against the complementary treatment. I see it all the time. (imagine whiney voice) “there is no statistically significant difference between sham acupuncture and real acupuncture, blah blah blah”

    may I also suggest a new “translation” for this sentence:

    “The odds of being HIV-positive were nonsignificantly lower among MSM who were circumcised than uncircumcised (odds ratio, 0.86; 95% confidence interval, 0.65-1.13; number of independent effect sizes [k]=15)”

    to

    “The difference in HIV seropositivity between circumcised MSM and uncircumcised MSM can be attributable to pure, dumb, roll-the-dice luck!”

  5. “… which, although not statistically significant, reduces …”

    “The odds of being HIV-positive were nonsignificantly lower among MSM …”

    Henry,

    This insane fact-denying fabrication of lies in the scientific literature, did this happen in former times as well, in the fifties or sixties, say? Or is it a new development of the recent one or two decades?

    Do they camouflage their denial of facts in other scientific fields as well, or is it a unique strategy in the field of medicine?

    • Henry Bauer said

      Sabine: You ask BIG questions! I believe that science, since it’s done by people, has always suffered from human imperfections. However, it used to be that the main incentive for going into science was the opportunity to contribute to the progress of knowledge. Since about mid-20th century, increasing areas of research have come to require increasingly large resources, and in a number of fields it has also become possible to gain wealth through patents and spin-off businesses; so incentives have changed, and a different sort of person is attracted into science; and there are very many more people engaged in research, so the general level of quality is lower. The ethos has become the same as in other corporate enterprises, so idealism is way down and careerism way up, with concomitant corruption. For a further discusison, see “Science in the 21st Century: Knowledge Monopolies and Research Cartels”.

      • Yes, Henry, sometimes my questions are big and sometimes they are just – superfluous; possibly just meant to distract innocent people from concentrating on important work. When I saw the title of the paper you linked to, a bell rang in my head, because it sounded somehow familiar to me. Then I turned my HD upside down and – there it is! I should have read it before asking superfluous questions. I’m sorry! Something needs to be done here ASAP to clear this chaos! Thank you for the reminder.

    • Philip said

      Methinks it is because in the old days, people built their own materials and usually got funds from private donors or from patents from previous inventions. These days it’s about getting grants, grants grants!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s