#metaresearch
Explore tagged Tumblr posts
Text
How Meta's AI model changes AI?
Meta's AI model has introduced several advancements that are reshaping the field of artificial intelligence. Here are key ways it is changing AI:
1.Improved Accuracy and Efficiency: Meta's artificial intelligence models, including those created for computer vision and natural language processing, frequently have increased accuracy and efficiency. This facilitates more accurate image and video recognition as well as improved comprehension and production of language that is human-like.
2. Enhanced Language Understanding: Meta pushes the limits of natural language understanding with its language models, especially with their work on large-scale transformer models. These models enhance translation, content creation, and conversational AI.
3. Scalability and Adaptability: The AI systems developed by Meta are built to manage enormous volumes of data and scale effectively. They can be applied to a wide range of tasks, such as cutting edge AI research and tailored content recommendations.
4. Open Research and Collaboration: Meta has been aggressively sharing its models and research with the larger AI community. This transparency encourages cooperation, quickens the pace of discovery, and lets other scientists and technologists expand on their findings.
5. Ethical AI Development: Meta highlights the significance of ethical issues in AI development. They are tackling concerns like bias and privacy in order to make sure that their AI systems are transparent, equitable, and compliant with moral principles.
6. Integration with Social Platforms: Meta's AI algorithms optimize ad targeting, improve content moderation, and increase user engagement through tailored recommendations, all of which improve user experiences on their social media platforms.
7. AI for Innovation and Creativity: Meta investigates the use of AI in artistic and musical endeavors. This expands on AI's potential and shows how useful it is for purposes other than those associated with computers.
Overall, Meta's AI advancements contribute to more sophisticated, scalable, and ethically-conscious AI technologies, impacting various industries and setting new standards in the field.
#MetaAI#ArtificialIntelligence#AIInnovation#MachineLearning#AIResearch#MetaTech#AIModels#TechAdvancements#FutureOfAI#AITrends#MetaResearch#AIDevelopment#AIImpact#TechRevolution#MetaInnovation
0 notes
Text
Explore the world of AI-powered coding with Meta’s CodeLlama 70b. This state-of-the-art model is setting new standards in code generation, outperforming its predecessors and promising a future of streamlined and democratized coding.
#artificial intelligence#ai#machine learning#machinelearning#software engineering#open source#CodeLlama70b#AI#Coding#MachineLearning#CodeGeneration#Technology#Innovation#meta ai#programming#metaresearch
0 notes
Photo
Drummond Rennie shot for Science Magazine.
Rennie was a major player in the research of the research...meta-research.
#editorial#portrait#metaresearch#science magazine#thisisezra#ezramarcos#ezra.photo#science#magazine#ashland#oregon
1 note
·
View note
Text
this new job has been.......a very mixed bag. lots of stuff about it is going great. i feel pretty confident about it. i really am enjoying like the public education aspects of the job, i have been really getting into the history of it and really enjoying telling ppl about the mill and how it works and all (it’s a real functional watermill and grinds corn and everything very much like they did in 1790 it’s cool as hell).
but the whole stupid pronoun thing is. a mess. a disaster. i’ve got three people above me who clearly 1) have never met a they/them before 2) know just enough to be terrified of getting it wrong. everybody’s just flubbing it three times in a row and derailing the conversation to apologize, hilarious conjugation decisions being made left and right. just a real grammatical larry curly and moe act going on in this office rn. i’m trying to just like be chill about it and allow everyone some time to integrate this new knowledge but man...it’s a little rough to sit thru
we do have an open spot we’re currently hiring for and one of the bosses who isn’t really nailing it is meant to be retiring soonish(?) so. maybe the landscape will change a bit with new people and it’ll be a little more pleasant to be around? we can hope
i really want this to be workable long-term because like. it’s really very nice in lots of ways. i had so much fun making the November storywalk, i’m super proud of it :/
#my immediate boss has decided im Super Woke so im getting to like. spearhead some research on the enslaved people that worked on the mill#and do a bunch of like metaresearch and theorizing about how to integrate more information about slavery into our programming#really important stuff! stuff i can feel proud of doing!#i really want this to be a good job bro!#blah blah blah
2 notes
·
View notes
Text
grad school especially my specific area is like “what if you spend years of your life having your instinct to overanalyse, grow obsessive, pick patterns, think in the abstract, pull theories out of places no one else has seen them, and argue in combat with others specifically trained and prioritised above anything else by every person and lever in your professional life, then attempt to be normal about everything else?”
#doing my masters while working full time drove me AND everyone around me insane#i know some people doing grad school normally but. unfortunately both my own brain chemistry and my particular topic choices do not lead to#that.#kids NEVER study maths THEN follow up with metaresearch and text analysis
4 notes
·
View notes
Text
My Bated Breath’s Master List
Here is a long due master list of all my metas!
*** = my most well-written meta, OR what I write when I put in effort and creativity
Zutara Meta
Research Shows Zutara Would Have Been the Ideal Friends to Lovers Dynamic (part 1, part 2) ***
“Zuko and Katara were narratively written as found siblings in the Final Agni Kai”
“Zuko and Katara were written as siblings in EIP”
Scene Transition in “The Western Air Temple”
Wants vs Need - A Comparison Between Kataang, Taang, and Zutara ***
Zuko, Katara, and their “incompatible” volatility
How Zuko “projects” in TSR by @antxrcticas
How Zuko Influenced Katara’s Character Arc
Fire Lady Katara ***
Autonomous yet supporting - Zuko and Katara’s character arcs
“I don’t ship zk because they’re most wholesome as a platonic relationship”
Katara Meta
Rage, Compassion, and the Bridge in Between ***
Revenge for a Memory ***
Zuko Meta
Zuko & Luck by @antxrcticas
The Roku/Sozin Plot Twist for Zuko by @certified-bi-fangirl-disaster
Why The Firebending Masters is my favorite ATLA “filler” episode, ft Zuko and Aang brotp
Meaning of Strength
Zuko and “Doing Nothing” ***
A look into the “parallels” between Kuzon/Painted Lady and Blue Spirit/Painted Lady (vaguely Anti-Kataang)
Anti-Kataang
On Ideals and Idealization ***
Aang - Absence, Favoritism, and Growth, mostly Aang-centric
Would Aang still love Katara if she killed Yon Rha? ***
Oma/Shu does not mirror Kataang
gosh, i hope this is not another tsr post
Anti-Maiko
Maiko in “The Boiling Rock” with additional commentary from @sokkastyles ***
Iroh’s (lack of) reaction to Maiko
Ship Discussion
On an Immensely Popular Post, ft. zuk/ka, ma/iko, zutara ***
(follow up to the above post)
Fandom Discussion
On Colonizer/Colonized ships ***
Canon and Non-canon by @zuko-thee-stallion, @firelxdykatara, @sokkastyles
ATLA Comics
How to commit character assassinations within the first few pages of your comic
Other Fandom
Spy x Family: The Man and The Persona (or he who has a thousand faces) ***
Vincenzo: Closing Thoughts ***
#my bated breath's posts#my bated breath analyzes#atla#atla meta#zutara#katara#zuko#anti kataang#anti maiko#taang#anti atla comics
113 notes
·
View notes
Text
Metaresearchers study how research is done—and why it goes wrong | Science
Given the billions of dollars the world buys science each year, it’s unexpected how couple of scientists study science itself. But their number is proliferating, driven in part by the awareness that science isn’t really constantly the strenuous, unbiased look for understanding it is expected to be. Editors of medical journals, humiliated by the quality of the documents they were releasing, started to turn the lens of science by themselves occupation years earlier, producing a brand-new field now called “journalology.” More just recently, psychologists have actually taken the lead, afflicted by existential doubts after lots of outcomes showed irreproducible. Other fields are doing the same, and metaresearch, or research on research, is now progressing as a clinical field of its own.
For some, studying how the sausage is made is a remarkable intellectual pursuit in itself. But other metaresearchers are driven by a desire to tidy up science’s act. Their work has actually generated lots of efforts to make research more robust and effective, from preregistering research studies and developing reporting requirements to the current push to make study information easily offered for others to check out. Metaresearchers in some cases require a thick skin; not all researchers are grateful when their enduring practices are questioned. And whether the reforms in fact work has actually ended up being a study item in itself.
Metaresearchers are offering their fellow researchers great deals of things to consider. But their hidden message is simple: If we comprehend much better exactly what we’re doing, we may be able to do it much better.
Special plan: Science under analysis
New post published on: https://www.livescience.tech/2018/09/21/metaresearchers-study-how-research-is-done-and-why-it-goes-wrong-science/
0 notes
Link
In the past I had often fervently wished that one day everyone would be passionate and excited about scientific research. I should have been more careful about what I had wished for. The crisis caused by the lethal COVID-19 pandemic and by the responses to the crisis have made billions of people worldwide acutely interested and overexcited about science. Decisions pronounced in the name of science have become arbitrators of life, death, and fundamental freedoms. Everything that mattered was affected by science, by scientists interpreting science, and by those who impose measures based on their interpretations of science in the context of political warfare.
One problem with this new mass engagement with science is that most people, including most people in the West, had never been seriously exposed to the fundamental norms of the scientific method. The Mertonian norms of communalism, universalism, disinterestedness, and organized skepticism have unfortunately never been mainstream in education, media, or even in science museums and TV documentaries on scientific topics.
Before the pandemic, the sharing of data, protocols, and discoveries for free was limited, compromising the communalism on which the scientific method is based. It was already widely tolerated that science was not universal, but the realm of an ever-more hierarchical elite, a minority of experts. Gargantuan financial and other interests and conflicts thrived in the neighborhood of science—and the norm of disinterestedness was left forlorn.
As for organized skepticism, it did not sell very well within academic sanctuaries. Even the best peer-reviewed journals often presented results with bias and spin. Broader public and media dissemination of scientific discoveries was largely focused on what could be exaggerated about the research, rather than the rigor of its methods and the inherent uncertainty of the results.
Nevertheless, despite the cynical realization that the methodological norms of science had been neglected (or perhaps because of this realization), voices struggling for more communalism, universalism, disinterestedness, and organized skepticism had been multiplying among scientific circles prior to the pandemic. Reformers were often seen as holding some sort of a moral higher ground, despite being outnumbered in occupancy of powerful positions. Reproducibility crises in many scientific fields, ranging from biomedicine to psychology, caused soul-searching and efforts to enhance transparency, including the sharing of raw data, protocols, and code. Inequalities within the academy were increasingly recognized with calls to remedy them. Many were receptive to pleas for reform.
Opinion-based experts (while still dominant in influential committees, professional societies, major conferences, funding bodies, and other power nodes of the system) were often challenged by evidence-based criticism. There were efforts to make conflicts of interest more transparent and to minimize their impact, even if most science leaders remained conflicted, especially in medicine. A thriving community of scientists focused on rigorous methods, understanding biases, and minimizing their impact. The field of metaresearch, i.e., research on research, had become widely respected. One might therefore have hoped that the pandemic crisis could have fostered change. Indeed, change did happen—but perhaps mostly for the worst.
…
Personally, I don’t want to consider the lab leak theory—a major blow to scientific investigation—as the dominant explanation yet. However, if full public data-sharing cannot happen even for a question relevant to the deaths of millions and the suffering of billions, what hope is there for scientific transparency and a sharing culture? Whatever the origins of the virus, the refusal to abide by formerly accepted norms has done its own enormous damage.
…
Many amazing scientists have worked on COVID-19. I admire their work. Their contributions have taught us so much. My gratitude extends to the many extremely talented and well-trained young investigators who rejuvenate our aging scientific workforce. However, alongside thousands of solid scientists came freshly minted experts with questionable, irrelevant, or nonexistent credentials and questionable, irrelevant, or nonexistent data.
Social and mainstream media have helped to manufacture this new breed of experts. Anyone who was not an epidemiologist or health policy specialist could suddenly be cited as an epidemiologist or health policy specialist by reporters who often knew little about those fields but knew immediately which opinions were true. Conversely, some of the best epidemiologists and health policy specialists in America were smeared as clueless and dangerous by people who believed themselves fit to summarily arbitrate differences of scientific opinion without understanding the methodology or data at issue.
Disinterestedness suffered gravely. In the past, conflicted entities mostly tried to hide their agendas. During the pandemic, these same conflicted entities were raised to the status of heroes. For example, Big Pharma companies clearly produced useful drugs, vaccines, and other interventions that saved lives, though it was also known that profit was and is their main motive. Big Tobacco was known to kill many millions of people every year and to continuously mislead when promoting its old and new, equally harmful, products. Yet during the pandemic, requesting better evidence on effectiveness and adverse events was often considered anathema. This dismissive, authoritarian approach “in defense of science” may sadly have enhanced vaccine hesitancy and the anti-vax movement, wasting a unique opportunity that was created by the fantastic rapid development of COVID-19 vaccines. Even the tobacco industry upgraded its reputation: Philip Morris donated ventilators to propel a profile of corporate responsibility and saving lives, a tiny fraction of which were put at risk of death from COVID-19 because of background diseases caused by tobacco products.
Other potentially conflicted entities became the new societal regulators, rather than the ones being regulated. Big Tech companies, which gained trillions of dollars in cumulative market value from the virtual transformation of human life during lockdown, developed powerful censorship machineries that skewed the information available to users on their platforms. Consultants who made millions of dollars from corporate and government consultation were given prestigious positions, power, and public praise, while unconflicted scientists who worked pro bono but dared to question dominant narratives were smeared as being conflicted. Organized skepticism was seen as a threat to public health. There was a clash between two schools of thought, authoritarian public health versus science—and science lost.
…
Honest, continuous questioning and exploration of alternative paths are indispensable for good science. In the authoritarian (as opposed to participatory) version of public health, these activities were seen as treason and desertion. The dominant narrative became that “we are at war.” When at war, everyone has to follow orders. If a platoon is ordered to go right and some soldiers explore maneuvering to the left, they are shot as deserters. Scientific skepticism had to be shot, no questions asked. The orders were clear.
…
Heated but healthy scientific debates are welcome. Serious critics are our greatest benefactors. John Tukey once said that the collective noun for a group of statisticians is a quarrel. This applies to other scientists, too. But “we are at war” led to a step beyond: This is a dirty war, one without dignity. Opponents were threatened, abused, and bullied by cancel culture campaigns in social media, hit stories in mainstream media, and bestsellers written by zealots. Statements were distorted, turned into straw men, and ridiculed. Wikipedia pages were vandalized. Reputations were systematically devastated and destroyed. Many brilliant scientists were abused and received threats during the pandemic, intended to make them and their families miserable.
Anonymous and pseudonymous abuse has a chilling effect; it is worse when the people doing the abusing are eponymous and respectable. The only viable responses to bigotry and hypocrisy are kindness, civility, empathy, and dignity. However, barring in-person communication, virtual living and social media in social isolation are poor conveyors of these virtues.
Politics had a deleterious influence on pandemic science. Anything any apolitical scientist said or wrote could be weaponized for political agendas. Tying public health interventions like masks and vaccines to a faction, political or otherwise, satisfies those devoted to that faction, but infuriates the opposing faction. This process undermines the wider adoption required for such interventions to be effective. Politics dressed up as public health not only injured science. It also shot down participatory public health where people are empowered, rather than obligated and humiliated.
A scientist cannot and should not try to change his or her data and inferences based on the current doctrine of political parties or the reading du jour of the social media thermometer. In an environment where traditional political divisions between left and right no longer seem to make much sense, data, sentences, and interpretations are taken out of context and weaponized. The same apolitical scientist could be attacked by left-wing commentators in one place and by alt-right commentators in another. Many excellent scientists have had to silence themselves in this chaos. Their self-censorship has been a major loss for scientific investigation and the public health effort. My heroes are the many well-intentioned scientists who were abused, smeared, and threatened during the pandemic. I respect all of them and suffer for what they went through, regardless of whether their scientific positions agreed or disagreed with mine. I suffer for and cherish even more those whose positions disagreed with mine.
There was absolutely no conspiracy or preplanning behind this hypercharged evolution. Simply, in times of crisis, the powerful thrive and the weak become more disadvantaged. Amid pandemic confusion, the powerful and the conflicted became more powerful and more conflicted, while millions of disadvantaged people have died and billions suffered.
I worry that science and its norms have shared the fate of the disadvantaged. It is a pity, because science can still help everyone. Science remains the best thing that can happen to humans, provided it can be both tolerant and tolerated.
1 note
·
View note
Photo
Meta-analysis is only as good as the research that is chosen to be included.
Metaresearchers take on meta-analyses, and hoary old myths about science
Meta-analyses—structured analyses of many studies on the same topic—were once seen as objective and definitive projects that helped sort out conflicts amongst smaller studies. These days, thousands of meta-analyses are published every year—many either redundant or contrary to earlier metaworks. Host Sarah Crespi talks to freelance science journalist Jop de Vrieze about ongoing meta-analysis wars in which opposing research teams churn out conflicting metastudies around important public health questions such as links between violent video games and school shootings and the effects of antidepressants. They also talk about what clues to look for when trying to evaluate the quality of a meta-analysis.
87 notes
·
View notes
Text
A Conversation with John Ioannidis
By SAURABH JHA, MD
The COVID-19 pandemic has been a testing time for the already testy academic discourse. Decisions have had to be made with partial information. Information has come in drizzles, showers and downpours. The velocity with which new information has arrived has outstripped our ability to make sense of it. On top of that, the science has been politicized in a polarized country with a polarizing president at its helm.
As the country awoke to an unprecedented economic lockdown in the middle of March, John Ioannidis, professor of epidemiology at Stanford University and one of the most cited physician scientists who practically invented “metaresearch”, questioned the lockdown and wondered if we might cause more harm than good in trying to control coronavirus. What would normally pass for skepticism in the midst of uncertainty of a novel virus became tinder in the social media outrage fire.
Ioannidis was likened to the discredited anti-vax doctor, Andrew Wakefield. His colleagues in epidemiology could barely contain their disgust, which ranged from visceral disappointment – the sort one feels when their gifted child has lost their way in college, to deep anger. He was accused of misunderstanding risk, misunderstanding statistics, and cherry picking data to prove his point.
The pushback was partly a testament to the stature of Ioannidis, whose skepticism could have weakened the resoluteness with which people complied with the lockdown. Some academics defended him, or rather defended the need for a contrarian voice like his. The conservative media lauded him.
In this pandemic, where we have learnt as much about ourselves as we have about the virus, understanding the pushback to Ioannidis is critical to understanding how academic discourse shapes public’s perception of public policy.
Saurabh Jha (SJ): On March 17th, at the start of the lockdown, you wrote in STAT News cautioning us against overreacting to COVID-19. You likened our response to an elephant accidentally jumping off a cliff because it was attacked by a house cat. The lockdown had just begun. What motivated you to write that editorial?
John P.A. Ioannidis (JPA): March seems a long time ago. I should explain my thinking in the early days of the COVID-19 pandemic. Like many, I saw a train approaching. Like many, I couldn’t sense the train’s precise size and speed. Many said we should be bracing for a calamity and in many ways I agreed. But I was concerned that we might inflict undue damage, what I’d call “iatrogenic harm”, controlling the pandemic.
To answer your question specifically, I wrote the piece because I felt that the touted fatality rate of COVID-19 of 3.4 % was inflated, but we had so limited data and so much uncertainty that infection fatality rate values as different as 0.05% and 1% were clearly still possible. I was pleading for better data on COVID-19 to make our response more precise and proportionate.
SJ: We now know that the infection fatality rate (IFR) is much lower than 3.4 %. I’m curious – why did you doubt this figure? At the time, the virus created havoc in Iran and Italy. Hospitals in the richest areas in Italy rationed ventilators. Was a fatality rate of 3.4 % so implausible?
JPA: Small changes in the fatality rate make a dramatic difference in the number of deaths. 3.4 % is an entirely different universe from 0.5 %. Imperial College epidemiologists, using an overall IFR of 0.9 %, assumed that if 60-80 % of the population were infected, as would happen without precaution or immunity, 2.2 million Americans would die.
I’m a physician and epidemiologist with a fellowship training in infectious diseases. Though I felt that COVID-19 was a serious threat, I didn’t think it was Spanish Flu redux. COVID-19 wasn’t behaving like a “3.4 % fatality rate” pandemic. I doubted that widely quoted fatality rate, which is what the Chinese public health authorities told the WHO, because by March it was apparent that COVID-19 infection comprised a clinical spectrum, ranging from mild symptoms which could be managed at home, to severe lung disease which needed ventilatory support. The crucial piece of the epidemiological puzzle was the number of people who were infected but didn’t know they were infected because they had no, or very minimal, symptoms.
The presence of asymptomatic and mildly symptomatic people who are not detected changes the shape of the pandemic and should change our response to it, too. For starters, it means that the infection fatality rate – the fatality rate amongst the infected – will, by definition, be lower than the case fatality rate (CFR) – the fatality rate amongst known symptomatic people who get tested.
The second implication is that the infection is more contagious and has spread further than what we believe, which makes testing, tracking, and isolating infected people more challenging. Testing remains important but each day we delay rolling out mass testing, testing becomes less efficacious, and even less so when there are so many asymptomatics or people with mild symptoms who won’t seek testing.
Figuring the true IFR of a virus isn’t some petty academic musing. To be clear, distinguishing between IFR and CFR for a virus like Ebola is silly because its CFR is about 50 %. But when the CFR of a virus is less than 5 %, we must ask– what’s the true IFR? Does the CFR diverge much from the IFR? How many asymptomatic carriers of the virus are there?
SJ: Few would argue against better data. But decisions must be made with the data we have rather than the data we wish we had. The consequences of a delay in acting because we wait for better data can only be guessed, rather than proven, at the time. Nevertheless, inaction has consequences. Some felt that you were advocating that we do nothing in the pandemic until we obtained data robust enough to design policy.
JPA: That wasn’t my position, though I can see why people thought I was advocating inaction when I was actually asking, begging actually, for better data to inform our actions. The two – decisions and knowledge – aren’t mutually exclusive. We can design policy on imperfect information yet keep gathering evidence so that our approach is fine tuned. A decision such as an economic lockdown should be assumed provisional, awaiting more research and better information. Of course, we can’t know everything there is to know about a novel virus in the beginning. Inaction is a false choice. What we’re choosing between is an immutable decision and a decision updated by emerging evidence, rather than between inaction and gathering evidence.
SJ: Let me ask you, frankly. Did you support the lockdown?
JPA: Let me answer, frankly. Yes. But only as a temporary measure.
SJ: So, you’re not against locking down the economy?
JPA: By February, we missed the window for nipping the novel coronavirus in the bud. Had we acted earlier, with aggressive testing, tracing, and isolating, like the South Koreans, the Taiwanese and the Singaporeans did, the virus wouldn’t have spread as wildly as it did. The biggest lesson from this pandemic is that the costs of delaying controlling the infection can be substantial. Act decisively in haste or repent at leisure.
Once we missed the boat, the lockdown was inevitable. I say “inevitable” grudgingly because I don’t think it should have reached that eventuality.
SJ: The situation would certainly have been different had the extent of the spread been identified in January, and the infection was controlled. If I understand you correctly, given our situation in March, as avoidable as it could have been, and our state of knowledge at that time, you supported the lockdown.
JPA: That’s correct.
Once the country was locked down, I felt we should be focusing in minimizing its duration. I view “lockdown” as a drug with dangerous side effects when its use is prolonged. It’s an extreme measure – a last resort, the nuclear option.
A country should be locked down not a minute longer than absolutely necessary. We have to keep assessing its risk-benefit calculus, by collecting and analyzing data, making sure we’re measuring the denominator accurately, and finding vulnerable and not vulnerable sub-groups.
SJ: I don’t mean to play “gotcha.” But isn’t what you’re saying contradictory? You didn’t believe that COVID-19 was a “3.4 % fatality rate” pandemic but you also supported the lockdown, which you, rightly, call an “extreme” measure.
JPA: If the fatality rate were truly 3.4 %, I’d have myself tied like Ulysses did, perhaps to my refrigerator to avoid ever getting out of my house. I’d want an even stricter lockdown. One of the challenges in science communication is downgrading the threat of an infection, which you believe is inflated, without making it sound harmless. That I didn’t think that COVID-19 was that dangerous didn’t mean that I thought it was harmless.
SJ: But you compared COVID-19 to the flu. That comparison irked many doctors, particularly those in the frontline, who felt they were being gaslighted. Doctors from Lombardy, New York City (NYC), Seattle were seeing jam packed ICUs, high mortality rates in the ICU, multi-organ failure, and ventilator shortages. They were overwhelmed. They had never seen so much carnage caused by an infection, certainly not by the flu. Surely, we don’t need the denominator to figure out that COVID-19 isn’t just the flu. Surely, the numerator speaks for itself.
JPA: When conveying the severity of a novel virus, it’s useful anchoring to past infections for perspective. The seasonal flu is a natural choice for comparison. I agree “just the flu” sounds dismissive, even insulting to healthcare workers, because it sounds like the common cold. The seasonal flu isn’t “just the flu” either. It actually kills 350, 000 to 700, 000 people a year worldwide. In the USA it kills 30,000 to 70,000 people per year, and would kill even more if we didn’t vaccinate healthcare workers and half the population.
I don’t think comparing COVID-19 to the seasonal flu is unscientific, but that comparison must be nuanced. COVID-19 is a strange beast. It’s way more dangerous than the flu in the elderly and in those with comorbidities. Yet the flu is more dangerous than COVID-19 in children and young adults, even allowing for the fact that COVID-19 causes Kawasaki-disease-like syndrome in some children. Again, we face a communication challenge – how do we convey the severity of a virus which is both more dangerous and less dangerous than the flu? If I emphasize the less vulnerable group, I’ll be accused of being flippant about the virus. Yet if I focus only on its devastation in the most vulnerable group, I’m not painting the true picture.
Even though I spent lot of effort nailing the precise IFR of COVID-19, any single number IFR is misleading, because the average fatality rate hides the heterogeneity of risk. Once we figure out that the virus, on average, isn’t as bad as we thought, the next step is identifying the low-risk and the high-risk, i.e. risk stratifying.
SJ: I’m going to challenge the mortality statistics of the seasonal flu you have quoted, which are widely quoted, and was quoted by Donald Trump, too – though its source isn’t fake news but the CDC. Aren’t these figures an estimation or projection? And isn’t it true that the deaths attributable to COVID-19 is derived more from direct counting than from an estimation and, therefore, likely to be more accurate?
JPA: It’s true that mortality of seasonal flu is an estimation. But this estimation isn’t science fiction. It’s derived from sound scientific principles. The data on seasonal flu (flu-like illnesses) is robust. We know much more about the seasonal flu than COVID-19.
Now, your point that we’re literally counting, as opposed to estimating, deaths from coronavirus is correct. But I’ll push back that this may not yield mortality figures as accurately as people think. Because of the attention on coronavirus, we’re better at knowing that a deceased person had coronavirus than had the flu. This means we’re good at knowing when someone died with coronavirus – but not necessarily that they died from the infection. We assume that dying with coronavirus is dying from coronavirus.
SJ: But many have died in their homes with no documentation of being infected. We have assumed that dying without documented coronavirus is not dying from coronavirus. Surely, misattribution of deaths to coronavirus works in both directions.
JPA: I agree. Which is why we need better data to understand this virus better. One point I want to emphasize – the misattribution is paradoxically greatest in the group most vulnerable to coronavirus, i.e. those with limited life expectancy. This group is most likely to die from COVID-19. Because of their limited life expectancy, this group is also likely to die from their non-COVID morbidities.
One way to better measure the impact of COVID-19 is measuring excess deaths, which is the death rate beyond what one usually encounters annually. Excess deaths comprise several groups – e.g. people killed by COVID-19 infection and people who have died because they didn’t receive timely care because they were afraid to go to the hospital, or because healthcare resources were focused on COVID-19 patients. The magnitude of the latter group will be more evident in years to come. Another group are deaths caused by the social and economic consequences of the lockdown, such as from suicides and alcohol and drug abuse. This number, which’ll also be evident in years to come, shouldn’t be underestimated. At a global level, consequences of lockdown-induced starvation, derailment of immunizations for lethal childhood diseases, and lack of proper management of tuberculosis are tremendous threats.
SJ: In your editorial you said that the bulk of the mortality of COVID-19 was in people with limited life expectancy, rather than young people. You said “vast majority of this hecatomb would be people with limited life expectancies. That’s in contrast to 1918, when many young people died”. Some felt you were minimizing the live of the elderly. That you didn’t think that their lives were worth the economic consequences of the lockdown was because they’d be dead soon, anyway.
JPA: That’s an unfortunate misrepresentation of my position.
There is an age gradient of fatality with COVID-19. This fact has been shown in several studies. Not only is there an age gradient but a steep inflection point with age, around 70. The hazard ratios are striking. Age predicts mortality better than even comorbidities. This scientific fact can easily be hijacked by demagogues by calling people concerned about the negative consequences of the lockdown “heartless granny killers.” That isn’t helpful.
The fact that COVID-19 disproportionately affects the elderly, i.e. older people are more vulnerable, means that they need more precise and thoughtful protection. I have been advocating for more attention to and protection for elderly people, not less. Unfortunately, that’s not what happened. For instance, Andrew Cuomo, governor of New York, told hospitals to send infected nursing home residents back to their nursing homes, which was like putting out a forest fire with kerosene. The same happened also in other states. This act alone may have caused countless deaths amongst nursing home residents. We failed to protect our most vulnerable, in part because of our “one-size-fits-all” approach. In Lombardy, there were disproportionate deaths in nursing homes. It is estimated that 45-53% of US deaths were in nursing home residents, and similar or even higher percentages were seen in several European countries.
We needed extra precautionary effort in high-risk settings such as nursing homes, prisons, meat processing plants, and homeless shelters. The corollary of having high-risk groups is that there must be low-risk groups, and low-risk people can continue working. We can’t treat everyone as “high risk” because then the high risk won’t get the extra attention and care they deserve. In our approach to controlling coronavirus we made no distinction between teenagers partying on beaches in Florida and debilitated, frail residents living in congested nursing homes in NYC. Our uniform approach was neither scientific nor safe.
COVID-19 is a virus which unmasks our social and economic fault lines.
SJ: You’ve criticized models for using faulty data in projecting the death toll. When the lockdown started there were only 60 deaths in the US. You projected 10, 000 deaths using an IFR computed from infected passengers on Diamond princess cruise ship. Yet today there more than 132, 000 deaths – the figure would likely have been even higher were it not for the social distancing/ lockdown we employed on March 16th. Though the mortality numbers are still much lower than the doomsday predictions of Imperial college, they do make your projections overly optimistic.
JPA: I never said that I knew that the death toll was going to be “10,000 deaths in the US”. How could I, in a piece where the message was “we don’t know”! The 10,000 deaths in the US projection was meant to be in the most optimistic range of the spectrum and in the same piece I also described the most pessimistic end of the spectrum, 40 million deaths. The point I wanted to emphasize was the huge uncertainty.
Now, it’s perfectly reasonable following the precautionary principle advocated by Nassim Taleb and basing our response on the worst-case forecast. But as scientists it’s not reasonable staring such huge residual uncertainty in its face and doing nothing about it. It’s our job to reduce uncertainty by collecting more robust data.
SJ: You calculated the IFR of COVID-19 using the published fatality rates in various settings. We’ll get to the methods later. For now, I want to focus on the result. By your calculation, the IFR ranged from 0.02 to 0.86 % with a median estimate of 0.26. Let’s take just one data point: NYC. There were 18, 000 deaths. Even if we assume the entire city, population of 8.3 million, was infected – a big assumption – that yields an IFR of at least 0.21 %. The lowest bound of the fatality rate of NYC is far higher than the lowest bounds of your estimate. Does this fact not challenge your calculation and the assumptions made in the calculations?
JPA: IFR is not a fixed physical property like the Avogadro’s constant. It’s highly variable which depends as much on the virus as it does on us. Perhaps it depends even more on us than the virus. It depends how we interact with each other, how close we are to each other, who gets infected, who gets ill. As we know the virus more, we get better at dealing with it. The IFR is a shape-shifting moving target.
Which brings me to NYC. It certainly faced the infection courageously head on. Yet neither its experience nor its IFR can be generalized. At least three factors contributed to the high death toll in NYC: the disproportionate number of deaths in nursing homes because of a catastrophic policy blunder, the very compact nature of the city, particularly where the vulnerable populations live, and nosocomial spread of infection. Also, doctors were still learning how best to manage patients in the ICU and their approach to ventilatory support was probably too aggressive, in hindsight. I’m not blaming doctors. NYC was dealt a bad hand.
SJ: If the IFR is “shape-shifting moving target” – why did you labor so hard to measure it?
JPA: It’s still important knowing the mean and range, particularly if one wants to calculate the risk-benefit of different policies in different settings. We just can’t assume that the IFR of COVID-19 in NYC in April is the same as its IFR in Houston in July or the IFR of Singapore either in April or in July. Some hotbeds in NYC must have had IFR of 1% or more. Singapore has already detected 43,000 cases and had only 26 deaths, so the upper bound of its IFR is 0.06% and may be even smaller. The IFR of Houston in July is something that we can hopefully shape and decrease with precise actions. When we learn from history, when we understand the special circumstances of the past and ensure we don’t repeat the mistakes, hopefully the IFR doesn’t repeat itself.
Also, I showed in my methods of computing the IFR the huge diversity of IFR because of wide variation in seroprevalence estimates. It’s not just the final result that’s important, it’s the individual components which make the final number which are important as well.
SJ: Could you expand more on nosocomial spread of COVID-19.
JPA: Many patients were likely infected in hospitals by infected healthcare workers. This is understandably a controversial issue which people are reluctant to broach.
We don’t know the exact scale of the nosocomial spread but in several hard-hit locations it was probably not trivial. This happened because many infected healthcare workers, particularly those < 60 had no idea they were infected. Once again, it underscores how important it was understanding the extent of the asymptomatics and people with only mild symptoms to which they naturally pay no attention. They unwittingly and unknowingly infected patients.
Like nursing homes, hospitals house the most vulnerable. Only a handful of unaware infected healthcare workers would have been sufficient to allow the virus to spread and feast on patients in hospital. This happened even more prominently early in the pandemic, when precautionary measures, such as wearing personal protection equipment, weren’t universally adopted, and we had no idea how far coronavirus had spread.
Deaths are a lagging indicator of the extent of infection. By the time the first death from COVID-19 in the US was recorded, the virus had comfortably set foot in American society. By believing the virus was deadlier than it actually was, we underestimated how far it had spread, and thus allowed the virus to be more deadly than it needed have been.
SJ: You received considerable pushback for your piece. Has it changed your opinion of academic discourse?
JPA: Appearing on Fox may have infuriated some of my colleagues – but that speaks to the polarization in the US. I’m a data-driven technocrat. It’s unlikely I would fit well with “conservative ideology” (good grief)!
I welcome academic discourse and disagreement. I have no doubt that I know very little and that I make mistakes, but I am just trying to learn a bit more and to make fewer mistakes, if possible. I consider that people who criticize me with valid scientific arguments are my greatest benefactors. But the outrage propagated by social media is a force of its own, and destroys any intelligent discourse, civil or uncivil. Once the outrage gets going, platforms for academic discourse censor and the discourse just doesn’t happen. I was unable to publish my essay about nosocomial spread of COVID-19 in nursing homes and hospitals. I submitted to many outlets. I suspect the editors feared social media backlash against my raising an uncomfortable issue. Fear isn’t healthy for science.
Saurabh Jha is an associate editor of THCB and host of Radiology Firing Line Podcast of the Journal of American College of Radiology, sponsored by Healthcare Administrative Partner.
A Conversation with John Ioannidis published first on https://wittooth.tumblr.com/
0 notes
Text
A Conversation with John Ioannidis
By SAURABH JHA, MD
The COVID-19 pandemic has been a testing time for the already testy academic discourse. Decisions have had to be made with partial information. Information has come in drizzles, showers and downpours. The velocity with which new information has arrived has outstripped our ability to make sense of it. On top of that, the science has been politicized in a polarized country with a polarizing president at its helm.
As the country awoke to an unprecedented economic lockdown in the middle of March, John Ioannidis, professor of epidemiology at Stanford University and one of the most cited physician scientists who practically invented “metaresearch”, questioned the lockdown and wondered if we might cause more harm than good in trying to control coronavirus. What would normally pass for skepticism in the midst of uncertainty of a novel virus became tinder in the social media outrage fire.
Ioannidis was likened to the discredited anti-vax doctor, Andrew Wakefield. His colleagues in epidemiology could barely contain their disgust, which ranged from visceral disappointment – the sort one feels when their gifted child has lost their way in college, to deep anger. He was accused of misunderstanding risk, misunderstanding statistics, and cherry picking data to prove his point.
The pushback was partly a testament to the stature of Ioannidis, whose skepticism could have weakened the resoluteness with which people complied with the lockdown. Some academics defended him, or rather defended the need for a contrarian voice like his. The conservative media lauded him.
In this pandemic, where we have learnt as much about ourselves as we have about the virus, understanding the pushback to Ioannidis is critical to understanding how academic discourse shapes public’s perception of public policy.
Saurabh Jha (SJ): On March 17th, at the start of the lockdown, you wrote in STAT News cautioning us against overreacting to COVID-19. You likened our response to an elephant accidentally jumping off a cliff because it was attacked by a house cat. The lockdown had just begun. What motivated you to write that editorial?
John P.A. Ioannidis (JPA): March seems a long time ago. I should explain my thinking in the early days of the COVID-19 pandemic. Like many, I saw a train approaching. Like many, I couldn’t sense the train’s precise size and speed. Many said we should be bracing for a calamity and in many ways I agreed. But I was concerned that we might inflict undue damage, what I’d call “iatrogenic harm”, controlling the pandemic.
To answer your question specifically, I wrote the piece because I felt that the touted fatality rate of COVID-19 of 3.4 % was inflated, but we had so limited data and so much uncertainty that infection fatality rate values as different as 0.05% and 1% were clearly still possible. I was pleading for better data on COVID-19 to make our response more precise and proportionate.
SJ: We now know that the infection fatality rate (IFR) is much lower than 3.4 %. I’m curious – why did you doubt this figure? At the time, the virus created havoc in Iran and Italy. Hospitals in the richest areas in Italy rationed ventilators. Was a fatality rate of 3.4 % so implausible?
JPA: Small changes in the fatality rate make a dramatic difference in the number of deaths. 3.4 % is an entirely different universe from 0.5 %. Imperial College epidemiologists, using an overall IFR of 0.9 %, assumed that if 60-80 % of the population were infected, as would happen without precaution or immunity, 2.2 million Americans would die.
I’m a physician and epidemiologist with a fellowship training in infectious diseases. Though I felt that COVID-19 was a serious threat, I didn’t think it was Spanish Flu redux. COVID-19 wasn’t behaving like a “3.4 % fatality rate” pandemic. I doubted that widely quoted fatality rate, which is what the Chinese public health authorities told the WHO, because by March it was apparent that COVID-19 infection comprised a clinical spectrum, ranging from mild symptoms which could be managed at home, to severe lung disease which needed ventilatory support. The crucial piece of the epidemiological puzzle was the number of people who were infected but didn’t know they were infected because they had no, or very minimal, symptoms.
The presence of asymptomatic and mildly symptomatic people who are not detected changes the shape of the pandemic and should change our response to it, too. For starters, it means that the infection fatality rate – the fatality rate amongst the infected – will, by definition, be lower than the case fatality rate (CFR) – the fatality rate amongst known symptomatic people who get tested.
The second implication is that the infection is more contagious and has spread further than what we believe, which makes testing, tracking, and isolating infected people more challenging. Testing remains important but each day we delay rolling out mass testing, testing becomes less efficacious, and even less so when there are so many asymptomatics or people with mild symptoms who won’t seek testing.
Figuring the true IFR of a virus isn’t some petty academic musing. To be clear, distinguishing between IFR and CFR for a virus like Ebola is silly because its CFR is about 50 %. But when the CFR of a virus is less than 5 %, we must ask– what’s the true IFR? Does the CFR diverge much from the IFR? How many asymptomatic carriers of the virus are there?
SJ: Few would argue against better data. But decisions must be made with the data we have rather than the data we wish we had. The consequences of a delay in acting because we wait for better data can only be guessed, rather than proven, at the time. Nevertheless, inaction has consequences. Some felt that you were advocating that we do nothing in the pandemic until we obtained data robust enough to design policy.
JPA: That wasn’t my position, though I can see why people thought I was advocating inaction when I was actually asking, begging actually, for better data to inform our actions. The two – decisions and knowledge – aren’t mutually exclusive. We can design policy on imperfect information yet keep gathering evidence so that our approach is fine tuned. A decision such as an economic lockdown should be assumed provisional, awaiting more research and better information. Of course, we can’t know everything there is to know about a novel virus in the beginning. Inaction is a false choice. What we’re choosing between is an immutable decision and a decision updated by emerging evidence, rather than between inaction and gathering evidence.
SJ: Let me ask you, frankly. Did you support the lockdown?
JPA: Let me answer, frankly. Yes. But only as a temporary measure.
SJ: So, you’re not against locking down the economy?
JPA: By February, we missed the window for nipping the novel coronavirus in the bud. Had we acted earlier, with aggressive testing, tracing, and isolating, like the South Koreans, the Taiwanese and the Singaporeans did, the virus wouldn’t have spread as wildly as it did. The biggest lesson from this pandemic is that the costs of delaying controlling the infection can be substantial. Act decisively in haste or repent at leisure.
Once we missed the boat, the lockdown was inevitable. I say “inevitable” grudgingly because I don’t think it should have reached that eventuality.
SJ: The situation would certainly have been different had the extent of the spread been identified in January, and the infection was controlled. If I understand you correctly, given our situation in March, as avoidable as it could have been, and our state of knowledge at that time, you supported the lockdown.
JPA: That’s correct.
Once the country was locked down, I felt we should be focusing in minimizing its duration. I view “lockdown” as a drug with dangerous side effects when its use is prolonged. It’s an extreme measure – a last resort, the nuclear option.
A country should be locked down not a minute longer than absolutely necessary. We have to keep assessing its risk-benefit calculus, by collecting and analyzing data, making sure we’re measuring the denominator accurately, and finding vulnerable and not vulnerable sub-groups.
SJ: I don’t mean to play “gotcha.” But isn’t what you’re saying contradictory? You didn’t believe that COVID-19 was a “3.4 % fatality rate” pandemic but you also supported the lockdown, which you, rightly, call an “extreme” measure.
JPA: If the fatality rate were truly 3.4 %, I’d have myself tied like Ulysses did, perhaps to my refrigerator to avoid ever getting out of my house. I’d want an even stricter lockdown. One of the challenges in science communication is downgrading the threat of an infection, which you believe is inflated, without making it sound harmless. That I didn’t think that COVID-19 was that dangerous didn’t mean that I thought it was harmless.
SJ: But you compared COVID-19 to the flu. That comparison irked many doctors, particularly those in the frontline, who felt they were being gaslighted. Doctors from Lombardy, New York City (NYC), Seattle were seeing jam packed ICUs, high mortality rates in the ICU, multi-organ failure, and ventilator shortages. They were overwhelmed. They had never seen so much carnage caused by an infection, certainly not by the flu. Surely, we don’t need the denominator to figure out that COVID-19 isn’t just the flu. Surely, the numerator speaks for itself.
JPA: When conveying the severity of a novel virus, it’s useful anchoring to past infections for perspective. The seasonal flu is a natural choice for comparison. I agree “just the flu” sounds dismissive, even insulting to healthcare workers, because it sounds like the common cold. The seasonal flu isn’t “just the flu” either. It actually kills 350, 000 to 700, 000 people a year worldwide. In the USA it kills 30,000 to 70,000 people per year, and would kill even more if we didn’t vaccinate healthcare workers and half the population.
I don’t think comparing COVID-19 to the seasonal flu is unscientific, but that comparison must be nuanced. COVID-19 is a strange beast. It’s way more dangerous than the flu in the elderly and in those with comorbidities. Yet the flu is more dangerous than COVID-19 in children and young adults, even allowing for the fact that COVID-19 causes Kawasaki-disease-like syndrome in some children. Again, we face a communication challenge – how do we convey the severity of a virus which is both more dangerous and less dangerous than the flu? If I emphasize the less vulnerable group, I’ll be accused of being flippant about the virus. Yet if I focus only on its devastation in the most vulnerable group, I’m not painting the true picture.
Even though I spent lot of effort nailing the precise IFR of COVID-19, any single number IFR is misleading, because the average fatality rate hides the heterogeneity of risk. Once we figure out that the virus, on average, isn’t as bad as we thought, the next step is identifying the low-risk and the high-risk, i.e. risk stratifying.
SJ: I’m going to challenge the mortality statistics of the seasonal flu you have quoted, which are widely quoted, and was quoted by Donald Trump, too – though its source isn’t fake news but the CDC. Aren’t these figures an estimation or projection? And isn’t it true that the deaths attributable to COVID-19 is derived more from direct counting than from an estimation and, therefore, likely to be more accurate?
JPA: It’s true that mortality of seasonal flu is an estimation. But this estimation isn’t science fiction. It’s derived from sound scientific principles. The data on seasonal flu (flu-like illnesses) is robust. We know much more about the seasonal flu than COVID-19.
Now, your point that we’re literally counting, as opposed to estimating, deaths from coronavirus is correct. But I’ll push back that this may not yield mortality figures as accurately as people think. Because of the attention on coronavirus, we’re better at knowing that a deceased person had coronavirus than had the flu. This means we’re good at knowing when someone died with coronavirus – but not necessarily that they died from the infection. We assume that dying with coronavirus is dying from coronavirus.
SJ: But many have died in their homes with no documentation of being infected. We have assumed that dying without documented coronavirus is not dying from coronavirus. Surely, misattribution of deaths to coronavirus works in both directions.
JPA: I agree. Which is why we need better data to understand this virus better. One point I want to emphasize – the misattribution is paradoxically greatest in the group most vulnerable to coronavirus, i.e. those with limited life expectancy. This group is most likely to die from COVID-19. Because of their limited life expectancy, this group is also likely to die from their non-COVID morbidities.
One way to better measure the impact of COVID-19 is measuring excess deaths, which is the death rate beyond what one usually encounters annually. Excess deaths comprise several groups – e.g. people killed by COVID-19 infection and people who have died because they didn’t receive timely care because they were afraid to go to the hospital, or because healthcare resources were focused on COVID-19 patients. The magnitude of the latter group will be more evident in years to come. Another group are deaths caused by the social and economic consequences of the lockdown, such as from suicides and alcohol and drug abuse. This number, which’ll also be evident in years to come, shouldn’t be underestimated. At a global level, consequences of lockdown-induced starvation, derailment of immunizations for lethal childhood diseases, and lack of proper management of tuberculosis are tremendous threats.
SJ: In your editorial you said that the bulk of the mortality of COVID-19 was in people with limited life expectancy, rather than young people. You said “vast majority of this hecatomb would be people with limited life expectancies. That’s in contrast to 1918, when many young people died”. Some felt you were minimizing the live of the elderly. That you didn’t think that their lives were worth the economic consequences of the lockdown was because they’d be dead soon, anyway.
JPA: That’s an unfortunate misrepresentation of my position.
There is an age gradient of fatality with COVID-19. This fact has been shown in several studies. Not only is there an age gradient but a steep inflection point with age, around 70. The hazard ratios are striking. Age predicts mortality better than even comorbidities. This scientific fact can easily be hijacked by demagogues by calling people concerned about the negative consequences of the lockdown “heartless granny killers.” That isn’t helpful.
The fact that COVID-19 disproportionately affects the elderly, i.e. older people are more vulnerable, means that they need more precise and thoughtful protection. I have been advocating for more attention to and protection for elderly people, not less. Unfortunately, that’s not what happened. For instance, Andrew Cuomo, governor of New York, told hospitals to send infected nursing home residents back to their nursing homes, which was like putting out a forest fire with kerosene. The same happened also in other states. This act alone may have caused countless deaths amongst nursing home residents. We failed to protect our most vulnerable, in part because of our “one-size-fits-all” approach. In Lombardy, there were disproportionate deaths in nursing homes. It is estimated that 45-53% of US deaths were in nursing home residents, and similar or even higher percentages were seen in several European countries.
We needed extra precautionary effort in high-risk settings such as nursing homes, prisons, meat processing plants, and homeless shelters. The corollary of having high-risk groups is that there must be low-risk groups, and low-risk people can continue working. We can’t treat everyone as “high risk” because then the high risk won’t get the extra attention and care they deserve. In our approach to controlling coronavirus we made no distinction between teenagers partying on beaches in Florida and debilitated, frail residents living in congested nursing homes in NYC. Our uniform approach was neither scientific nor safe.
COVID-19 is a virus which unmasks our social and economic fault lines.
SJ: You’ve criticized models for using faulty data in projecting the death toll. When the lockdown started there were only 60 deaths in the US. You projected 10, 000 deaths using an IFR computed from infected passengers on Diamond princess cruise ship. Yet today there more than 132, 000 deaths – the figure would likely have been even higher were it not for the social distancing/ lockdown we employed on March 16th. Though the mortality numbers are still much lower than the doomsday predictions of Imperial college, they do make your projections overly optimistic.
JPA: I never said that I knew that the death toll was going to be “10,000 deaths in the US”. How could I, in a piece where the message was “we don’t know”! The 10,000 deaths in the US projection was meant to be in the most optimistic range of the spectrum and in the same piece I also described the most pessimistic end of the spectrum, 40 million deaths. The point I wanted to emphasize was the huge uncertainty.
Now, it’s perfectly reasonable following the precautionary principle advocated by Nassim Taleb and basing our response on the worst-case forecast. But as scientists it’s not reasonable staring such huge residual uncertainty in its face and doing nothing about it. It’s our job to reduce uncertainty by collecting more robust data.
SJ: You calculated the IFR of COVID-19 using the published fatality rates in various settings. We’ll get to the methods later. For now, I want to focus on the result. By your calculation, the IFR ranged from 0.02 to 0.86 % with a median estimate of 0.26. Let’s take just one data point: NYC. There were 18, 000 deaths. Even if we assume the entire city, population of 8.3 million, was infected – a big assumption – that yields an IFR of at least 0.21 %. The lowest bound of the fatality rate of NYC is far higher than the lowest bounds of your estimate. Does this fact not challenge your calculation and the assumptions made in the calculations?
JPA: IFR is not a fixed physical property like the Avogadro’s constant. It’s highly variable which depends as much on the virus as it does on us. Perhaps it depends even more on us than the virus. It depends how we interact with each other, how close we are to each other, who gets infected, who gets ill. As we know the virus more, we get better at dealing with it. The IFR is a shape-shifting moving target.
Which brings me to NYC. It certainly faced the infection courageously head on. Yet neither its experience nor its IFR can be generalized. At least three factors contributed to the high death toll in NYC: the disproportionate number of deaths in nursing homes because of a catastrophic policy blunder, the very compact nature of the city, particularly where the vulnerable populations live, and nosocomial spread of infection. Also, doctors were still learning how best to manage patients in the ICU and their approach to ventilatory support was probably too aggressive, in hindsight. I’m not blaming doctors. NYC was dealt a bad hand.
SJ: If the IFR is “shape-shifting moving target” – why did you labor so hard to measure it?
JPA: It’s still important knowing the mean and range, particularly if one wants to calculate the risk-benefit of different policies in different settings. We just can’t assume that the IFR of COVID-19 in NYC in April is the same as its IFR in Houston in July or the IFR of Singapore either in April or in July. Some hotbeds in NYC must have had IFR of 1% or more. Singapore has already detected 43,000 cases and had only 26 deaths, so the upper bound of its IFR is 0.06% and may be even smaller. The IFR of Houston in July is something that we can hopefully shape and decrease with precise actions. When we learn from history, when we understand the special circumstances of the past and ensure we don’t repeat the mistakes, hopefully the IFR doesn’t repeat itself.
Also, I showed in my methods of computing the IFR the huge diversity of IFR because of wide variation in seroprevalence estimates. It’s not just the final result that’s important, it’s the individual components which make the final number which are important as well.
SJ: Could you expand more on nosocomial spread of COVID-19.
JPA: Many patients were likely infected in hospitals by infected healthcare workers. This is understandably a controversial issue which people are reluctant to broach.
We don’t know the exact scale of the nosocomial spread but in several hard-hit locations it was probably not trivial. This happened because many infected healthcare workers, particularly those < 60 had no idea they were infected. Once again, it underscores how important it was understanding the extent of the asymptomatics and people with only mild symptoms to which they naturally pay no attention. They unwittingly and unknowingly infected patients.
Like nursing homes, hospitals house the most vulnerable. Only a handful of unaware infected healthcare workers would have been sufficient to allow the virus to spread and feast on patients in hospital. This happened even more prominently early in the pandemic, when precautionary measures, such as wearing personal protection equipment, weren’t universally adopted, and we had no idea how far coronavirus had spread.
Deaths are a lagging indicator of the extent of infection. By the time the first death from COVID-19 in the US was recorded, the virus had comfortably set foot in American society. By believing the virus was deadlier than it actually was, we underestimated how far it had spread, and thus allowed the virus to be more deadly than it needed have been.
SJ: You received considerable pushback for your piece. Has it changed your opinion of academic discourse?
JPA: Appearing on Fox may have infuriated some of my colleagues – but that speaks to the polarization in the US. I’m a data-driven technocrat. It’s unlikely I would fit well with “conservative ideology” (good grief)!
I welcome academic discourse and disagreement. I have no doubt that I know very little and that I make mistakes, but I am just trying to learn a bit more and to make fewer mistakes, if possible. I consider that people who criticize me with valid scientific arguments are my greatest benefactors. But the outrage propagated by social media is a force of its own, and destroys any intelligent discourse, civil or uncivil. Once the outrage gets going, platforms for academic discourse censor and the discourse just doesn’t happen. I was unable to publish my essay about nosocomial spread of COVID-19 in nursing homes and hospitals. I submitted to many outlets. I suspect the editors feared social media backlash against my raising an uncomfortable issue. Fear isn’t healthy for science.
Saurabh Jha is an associate editor of THCB and host of Radiology Firing Line Podcast of the Journal of American College of Radiology, sponsored by Healthcare Administrative Partner.
A Conversation with John Ioannidis published first on https://venabeahan.tumblr.com
0 notes
Text
Do you love music and AI? Then you will love MusicGen, a new AI model by Meta Research that can generate music based on text and melody inputs. It can produce high-quality music samples with various instruments, genres, and styles, while matching the style and melody of the input. Read our blog post to learn more about this revolutionary model and how to access it. Continue Reading
#MusicGen#AI#Music#MetaAI#MetaResearch#AIMusicGeneration#text2music#deeplearning#machinelearning#artificial intelligence#machine learning
0 notes
Text
Many Ways of Skinning a Statistical Cat
By SAURABH JHA MD
In this episode of Firing Line, Saurabh Jha (aka @RogueRad), has a conversation with Professor Brian Nosek, a metaresearcher and co-founder of Center for Open Science.
They discuss the implications of this study, which showed that there was a range of analytical methods when interrogating the database to answer a specific hypothesis: are soccer referees more likely to give red cards to dark skinned players? What is the significance of the variation? Does the variation in analysis explain the replication crisis?
Listen to our conversation at Radiology Firing Line Podcast.
Article source:The Health Care Blog
0 notes
Text
Metaresearchers study how research is done—and why it goes wrong
A Science special package explores the rise of research on research from Latest News from Science Magazine https://ift.tt/2xvFj6K via IFTTT
0 notes
Text
me at the beginning of the semester: for our final project we’re going to use serious metaresearch to compare All The Different Types Of Fertilizer That There Are and we’re going to use statistics to determine whether the differences are significant.
me now, two days before the thing is due: for our final project we’re going to compare cow shit and NPK. we’re using a completely arbitrary index system i made up yesterday. it is based almost entirely on okra.
#gay and obscure nonsense#plant school; for plants#it's not done by my share is so the remaining 5 pages are not my problem anymore#unless they turn out to be shit but i left like...specific enough instructions that they will hopefully not be shit
0 notes