Tag Archives: Career

The Economist: some problems with the peer-review process

From The Economist, of all places.

Excerpt:

The idea that the same experiments always get the same results, no matter who performs them, is one of the cornerstones of science’s claim to objective truth. If a systematic campaign of replication does not lead to the same results, then either the original research is flawed (as the replicators claim) or the replications are (as many of the original researchers on priming contend). Either way, something is awry.

It is tempting to see the priming fracas as an isolated case in an area of science—psychology—easily marginalised as soft and wayward. But irreproducibility is much more widespread. A few years ago scientists at Amgen, an American drug company, tried to replicate 53 studies that they considered landmarks in the basic science of cancer, often co-operating closely with the original researchers to ensure that their experimental technique matched the one used first time round. According to a piece they wrote last year in Nature, a leading scientific journal, they were able to reproduce the original results in just six. Months earlier Florian Prinz and his colleagues at Bayer HealthCare, a German pharmaceutical giant, reported in Nature Reviews Drug Discovery, a sister journal, that they had successfully reproduced the published results in just a quarter of 67 seminal studies.

Let’s take a look at some of the problems from the article.

Problems with researcher bias:

Other data-heavy disciplines face similar challenges. Models which can be “tuned” in many different ways give researchers more scope to perceive a pattern where none exists. According to some estimates, three-quarters of published scientific papers in the field of machine learning are bunk because of this “overfitting”, says Sandy Pentland, a computer scientist at the Massachusetts Institute of Technology.

Problems with journal referees:

Another experiment at the BMJ showed that reviewers did no better when more clearly instructed on the problems they might encounter. They also seem to get worse with experience. Charles McCulloch and Michael Callaham, of the University of California, San Francisco, looked at how 1,500 referees were rated by editors at leading journals over a 14-year period and found that 92% showed a slow but steady drop in their scores.

As well as not spotting things they ought to spot, there is a lot that peer reviewers do not even try to check. They do not typically re-analyse the data presented from scratch, contenting themselves with a sense that the authors’ analysis is properly conceived. And they cannot be expected to spot deliberate falsifications if they are carried out with a modicum of subtlety.

Problems with fraud:

Fraud is very likely second to incompetence in generating erroneous results, though it is hard to tell for certain. Dr Fanelli has looked at 21 different surveys of academics (mostly in the biomedical sciences but also in civil engineering, chemistry and economics) carried out between 1987 and 2008. Only 2% of respondents admitted falsifying or fabricating data, but 28% of respondents claimed to know of colleagues who engaged in questionable research practices.

Problems releasing data:

Reproducing research done by others often requires access to their original methods and data. A study published last month inPeerJ by Melissa Haendel, of the Oregon Health and Science University, and colleagues found that more than half of 238 biomedical papers published in 84 journals failed to identify all the resources (such as chemical reagents) necessary to reproduce the results. On data, Christine Laine, the editor of the Annals of Internal Medicine, told the peer-review congress in Chicago that five years ago about 60% of researchers said they would share their raw data if asked; now just 45% do. Journals’ growing insistence that at least some raw data be made available seems to count for little: a recent review by Dr Ioannidis which showed that only 143 of 351 randomly selected papers published in the world’s 50 leading journals and covered by some data-sharing policy actually complied.

Critics of global warming have had problems getting at data before, as Nature reported here:

Since 2002, McIntyre has repeatedly asked Phil Jones, director of CRU, for access to the HadCRU data. Although the data are made available in a processed gridded format that shows the global temperature trend, the raw station data are currently restricted to academics. While Jones has made data available to some academics, he has refused to supply McIntyre with the data. Between 24 July and 29 July of this year, CRUreceived 58 freedom of information act requests from McIntyre and people affiliated with Climate Audit. In the past month, the UK Met Office, which receives a cleaned-up version of the raw data from CRU, has received ten requests of its own.

Why would scientists hide their data? Well, recall that the Climategate scandal resulted from unauthorized release of the code used to generate the data used to promote global warming alarmism. The leaked code showed that the scientists had been generating faked data using a “fudge factor”.

Elsewhere, leaked e-mailed from global warmists revealed that they do indeed suppress articles that are critical of global warming alarmism:

As noted previously, the Climategate letters and documents show Jones and the Team using the peer review process to prevent publication of adverse papers, while giving softball reviews to friends and associates in situations fraught with conflict of interest. Today I’ll report on the spectacle of Jones reviewing a submission by Mann et al.

Let’s recall some of the reviews of articles daring to criticize CRU or dendro:

I am really sorry but I have to nag about that review – Confidentially I now need a hard and if required extensive case for rejecting (Briffa to Cook)

If published as is, this paper could really do some damage. It is also an ugly paper to review because it is rather mathematical, with a lot of Box-Jenkins stuff in it. It won’t be easy to dismiss out of hand as the math appears to be correct theoretically, (Cook to Briffa)

Recently rejected two papers (one for JGR and for GRL) from people saying CRU has it wrong over Siberia. Went to town in both reviews, hopefully successfully. (Jones to Mann)

One last quote from the Economist article. One researcher submitted a completely bogus paper to many journals, and many of them accepted it:

John Bohannon, a biologist at Harvard, recently submitted a pseudonymous paper on the effects of a chemical derived from lichen on cancer cells to 304 journals describing themselves as using peer review. An unusual move; but it was an unusual paper, concocted wholesale and stuffed with clangers in study design, analysis and interpretation of results. Receiving this dog’s dinner from a fictitious researcher at a made up university, 157 of the journals accepted it for publication.

Dr Bohannon’s sting was directed at the lower tier of academic journals. But in a classic 1998 study Fiona Godlee, editor of the prestigious British Medical Journal, sent an article containing eight deliberate mistakes in study design, analysis and interpretation to more than 200 of the BMJ’s regular reviewers. Not one picked out all the mistakes. On average, they reported fewer than two; some did not spot any.

The Economist article did not go into the problem of bias due to worldview presuppositions, though. So let me say something about that.

A while back Casey Luskin posted a list of problems with peer review.

Here was one that stuck out to me:

Point 5: The peer-review system is often biased against non-majority viewpoints.
The peer-review system is largely devoted to maintaining the status quo. As a new scientific theory that challenges much conventional wisdom, intelligent design faces political opposition that has nothing to do with the evidence. In one case, pro-ID biochemist Michael Behe submitted an article for publication in a scientific journal but was told it could not be published because “your unorthodox theory would have to displace something that would be extending the current paradigm.” Denyse O’Leary puts it this way: “The overwhelming flaw in the traditional peer review system is that it listed so heavily toward consensus that it showed little tolerance for genuinely new findings and interpretations.”

Recently, I summarized a podcast on the reviewer bias problem featuring physcist Frank Tipler. His concern in that podcast was that peer-review would suppress new ideas, even if they were correct. He gave examples of this happening. Even a paper by Albert Einstein was rejected by a peer-reviewed journal. Elsewhere, Tipler was explicitly told to remove positive references to intelligent design in order to get his papers published. Tipler’s advice was for people with new ideas to bypass the peer-reviewed journal system entirely.

Speaking about the need to bypass peer-review, you might remember that the Darwinian hierarchy is not afraid to have people sanctioned if they criticize Darwinism in peer-reviewed literature.

Recall the case of Richard Sternberg.

Excerpt:

In 2004, in my capacity as editor of The Proceedings of the Biological Society of Washington, I authorized “The Origin of Biological Information and the Higher Taxonomic Categories” by Dr. Stephen Meyer to be published in the journal after passing peer-review. Because Dr. Meyer’s article presented scientific evidence for intelligent design in biology, I faced retaliation, defamation, harassment, and a hostile work environment at the Smithsonian’s National Museum of Natural History that was designed to force me out as a Research Associate there. These actions were taken by federal government employees acting in concert with an outside advocacy group, the National Center for Science Education. Efforts were also made to get me fired from my job as a staff scientist at the National Center for Biotechnology Information.

So those are some of the issues to consider when thinking about the peer-review process. My view is that peer-reviewed evidence does count for something in a debate situation, but as you can see from the Economist article, it may not count for as much as it used to. I think my view of science in general has been harmed by what I saw from physicist Lawrence Krauss in his third debate with William Lane Craig. If a scientist can misrepresent another scientist and not get fired by his employer, then I think we really need to be careful about the level of honesty in the academy.

Dennis Prager explains what feminism has achieved for women

Dennis Prager has summarized many of my viewpoints on this blog in a tiny, tiny little article. He calls it “Four Legacies of Feminism“.

Read the whole glorious thing and bask in its wisdom!

Full text:

As we approach the 50th anniversary of the publication of Betty Friedan’s feminist magnum opus, The Feminine Mystique, we can have a perspective on feminism that was largely unavailable heretofore.

And that perspective doesn’t make feminism look good. Yes, women have more opportunities to achieve career success; they are now members of most Jewish and Christian clergy; women’s college sports teams are given huge amounts of money; and there are far more women in political positions of power. But the prices paid for these changes — four in particular — have been great, and outweigh the gains for women, let alone for men and for society.

1) The first was the feminist message to young women to have sex just as men do. There is no reason for them to lead a different sexual life than men, they were told. Just as men can have sex with any woman solely for the sake of physical pleasure, so, too, women ought to enjoy sex with any man just for the fun of it. The notion that the nature of women is to hope for at least the possibility of a long-term commitment from a man they sleep with has been dismissed as sexist nonsense.

As a result, vast numbers of young American women had, and continue to have, what are called “hookups”; and for some of them it is quite possible that no psychological or emotional price has been paid. But the majority of women who are promiscuous do pay prices. One is depression. New York Times columnist Ross Douthat recently summarized an academic study on the subject: “A young woman’s likelihood of depression rose steadily as her number of partners climbed and the present stability of her sex life diminished.”

Long before this study, I had learned from women callers to my radio show (an hour each week — the “Male-Female Hour” — is devoted to very honest discussion of sexual and other man-woman issues) that not only did female promiscuity coincide with depression, it also often had lasting effects on women’s ability to enjoy sex. Many married women told me that in order to have a normal sexual relationship with their husband, they had to work through the negative aftereffects of early promiscuity — not trusting men, feeling used, seeing sex as unrelated to love, and disdaining their husband’s sexual overtures. And many said they still couldn’t have a normal sex life with their husband.

2) The second awful legacy of feminism has been the belief among women that they could and should postpone marriage until they developed their careers. Only then should they seriously consider looking for a husband. Thus, the decade or more during which women have the best chance to attract men is spent being preoccupied with developing a career. Again, I cite woman callers to my radio show over the past 20 years who have sadly looked back at what they now, at age 40, regard as 20 wasted years. Sure, these frequently bright and talented women have a fine career. But most women are not programmed to prefer a great career to a great man and a family. They feel they were sold a bill of goods at college and by the media. And they were. It turns out that most women without a man do worse in life than fish without bicycles.

3) The third sad feminist legacy is that so many women — and men — have bought the notion that women should work outside the home that for the first time in American history, and perhaps world history, vast numbers of children are not primarily raised by their mothers or even by an extended family member. Instead they are raised for a significant part of their childhood by nannies and by workers at daycare centers. Whatever feminists may say about their only advocating choices, everyone knows the truth: Feminism regards work outside the home as more elevating, honorable, and personally productive than full-time mothering and making a home.

4) And the fourth awful legacy of feminism has been the demasculinization of men. For all of higher civilization’s recorded history, becoming a man was defined overwhelmingly as taking responsibility for a family. That notion — indeed the notion of masculinity itself — is regarded by feminism as the worst of sins: patriarchy.

Men need a role, or they become, as the title of George Gilder’s classic book on single men describes them: Naked Nomads. In little more than a generation, feminism has obliterated roles. If you wonder why so many men choose not to get married, the answer lies in large part in the contemporary devaluation of the husband and of the father — of men as men, in other words. Most men want to be honored in some way — as a husband, a father, a provider, as an accomplished something; they don’t want merely to be “equal partners” with a wife.

In sum, thanks to feminism, very many women slept with too many men for their own happiness; postponed marriage too long to find the right man to marry; are having hired hands do much of the raising of their children; and find they are dating boy-men because manly men are so rare.

Feminism exemplifies the truth of the saying, “Be careful what you wish for — you may get it.”

I wish I could add something to this, but I can’t because every time I think of something to add, he says it in the next sentence.

If you like this short essay, then this medium essay arguing against feminism authored by Barbara Kay would be nice follow-up.

It might be worth forwarding these articles along to your friends. And I highly recommend books on male-female relationships and roles by George Gilder, especially “Men and Marriage“.

Readers vote: who is to blame for this problematic marriage? The wife or the husband?

Please read the excerpt from the article BEFORE you vote in the poll at the bottom of the post! Thanks.

Letitia the Damsel posted this article from the UK Daily Mail on my Facebook page. The article is written by a woman who rejects the traditional roles and responsibilities of women in marriage.

She writes:

My husband is the kindest, most considerate man in the world. During the seven years we’ve been married, Ben has done most of the cooking, cleaning and ironing without ever being asked.

He brings me an organic buffalo milk cappuccino every morning in bed and once spent hours making fresh syrup from rhubarb to add to my favourite champagne after I’d given birth. And yes, he works full-time.

But for all he does for me, anxious to make everything in my life better, he gets a raw deal in return.

I am shamefully neglectful of my wifely duties. In fact, I am the anti-wife.

The trouble is that I just can’t do the subservient partner thing. Ben is more likely to arrive at our home in Twickenham, South-West London, after a hard day’s work and find me having a manicure or checking Facebook than slaving over a hot stove.

This may make me sound selfish, but I’m just being honest. At 39, I’ve never ironed a single item of my husband’s clothing. I rarely cook for him either. Why would I bother when he’s so much better at it than I am?

Last Christmas, he produced a lavish three-course lunch and booked a 15th-century cottage for our whole family to eat it in. All I did was hold out my champagne glass for him to refill while saying: ‘Well done, darling.’

And if you think I reward his sterling domestic efforts with treats in the bedroom, I’m afraid I fail in that department, too. Intimacy is reserved only for his birthdays – and then just the ones with a zero.

I felt occasional pangs of guilt about our unusual dynamic during the first year of our marriage, but now I find it liberating. He even refers to me as the ‘household manager’ because I’m an expert in the art of delegation.

Recently, Ben’s job for an organic fruit and vegetable box delivery scheme meant he was away on business for three weeks.

Before he left, I found him packing the freezer with organic ready meals and ringing round for short-term nannies to take care of our children, Ronnie, six, and Stanley, two.

The truth is that I’m just too busy and involved in my career as a writer to be a traditional, caring wife.

I work from home and, like most self-employed people in a recession, I push myself to the limit. I set my alarm for 6am so I can squeeze in an hour of work before the school run and I often write until midnight.

My job often means being away from home during the evenings and weekends, which means the lion’s share of the childcare falls to Ben. Even when I am home, I keep one eye glued to my iPhone for fear of missing a work call.

Ben bemoans my inability to achieve a work/life balance. He sees the word ‘driven’ as a negative, while I think I’m aspirational and ambitious. Now, I know what you’re thinking – that I must earn more than Ben. But no, I don’t.

He’s the breadwinner and a domestic god. But my work is so all-consuming there’s little of me left to go round by the time I switch off my laptop. Don’t get me wrong – I love Ben very much and regard our marriage as happy. And he could never claim breach of contract because he always knew I was a workaholic. 

[…]When we began dating in 2003, I was helping to launch a woman’s magazine, which required me to be at work from 8am until 11pm.

It was Ben’s touching gesture of sending boxes of Krispy Kreme doughnuts to the office that made me realise what an excellent husband he’d make.

But when, in the early throes of our relationship, he mooted the idea I might one day be a ‘stay-at-home mum’, I bristled. ‘But my mum stayed at home for the first five years of my life,’ he said. 

‘That’s never going to happen,’ I replied sharply. The matter was never raised again.

[…]It’s my fault that he returns home to find no dinner and our children running amok.

But I work hard, too, and that changes everything. While I love my children deeply, wiping noses, bottoms and encrusted beans off the floor doesn’t inspire me in the way my work does.

I’m too busy to share the chores. After a day of writing, I feel happy and complete; after a day with the children, I am frazzled.

After the birth of our first son, I went back to my £60,000-a-year job as deputy editor of a national magazine and put Ronnie full-time into an eye-wateringly expensive nursery.

I felt guilty about it, and working 8am to 6pm every day and barely seeing my son just compounded that guilt. But I didn’t want to give up work.

You might think me self-obsessed, but that’s a price I’m willing to pay for my happiness.

Just before the birth of our second son, I decided to leave my job and pursue a career as a writer after being offered a generous redundancy package.

But instead of relaxing into my new job, I allowed work to seep into all areas of my life.

That is why I ignored cripplingly painful contractions ten minutes apart and carried on writing to meet a deadline.

I was back at work just two weeks after giving birth to Stanley, breast-feeding while conducting tricky phone interviews.

Now that you read the excerpt, please vote in the poll:

I’ll vote and comment later tonight to say how I voted.

By the way, if you like the articles that Letitia finds, you can hear her on her Visible Conservative podcasts on Fridays. Here’s the most recent one and the opening monologue transcript is here on Letitia’s blog. If you’re like me, and you like hearing conservative women talk passionately about issues that matter, you’ll love this podcast. I never miss it.

UPDATE: I voted and my vote was to blame the man entirely. He chose this woman to marry and to mother his children. He knew she was unqualified to be a wife and mother and married her anyway. It’s ALL HIS FAULT. She is completely innocent because she was bad BEFORE the marriage and he knew it.

You cannot blame a bad woman for continuing to act badly after you marry her. If she is bad before, she’ll be bad after. If she has no moral standard for marriage before, then she’ll have no moral standard after. She doesn’t BELIEVE that she is doing anything wrong – either before or after marriage. You can’t blame her for acting according to her own feminist worldview. It’s the MAN who is to blame for choosing her.

The man shouldn’t even be opening his mouth to complain about her after he chose her. He chose her, and he has no right now to blame her or complain about it. You can’t expect traditional wife and mother behavior when you marry someone who explicitly repudiates those roles. Blame the man 100%. And what’s more he is EVIL to have inflicted this on his children.

You can’t go to the pet store and pass by all the cats, dogs and birds and buy an alligator then complain when you get the thing home and it bites your arms off. It’s a freaking alligator, and you knew that when you bought it. It’s your fault.