<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:georss="http://www.georss.org/georss" xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#" xmlns:media="http://search.yahoo.com/mrss/"
		>
<channel>
	<title>Comments on: How to Fix the NIH</title>
	<atom:link href="http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/feed/" rel="self" type="application/rss+xml" />
	<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/</link>
	<description>biomedical research, just another job...</description>
	<lastBuildDate>Fri, 18 Dec 2009 07:20:54 +0000</lastBuildDate>
	<generator>http://wordpress.com/</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: &#8220;&#8230;I think it&#8217;s a Lurker!&#8221; &#171; DrugMonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-2049</link>
		<dc:creator>&#8220;&#8230;I think it&#8217;s a Lurker!&#8221; &#171; DrugMonkey</dc:creator>
		<pubDate>Fri, 30 Nov 2007 20:07:48 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-2049</guid>
		<description>[...] Young Female Scientist reminded me of the suggestion in a Nature editorial that this summer&#8217;s RFI from the NIH to solicit input on the peer review and grant funding process drummed up about 2,000 [...]</description>
		<content:encoded><![CDATA[<p>[...] Young Female Scientist reminded me of the suggestion in a Nature editorial that this summer&#8217;s RFI from the NIH to solicit input on the peer review and grant funding process drummed up about 2,000 [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: NIH RFI on Peer Review Comment Period Closes 5pm Eastern Today &#171; DrugMonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-673</link>
		<dc:creator>NIH RFI on Peer Review Comment Period Closes 5pm Eastern Today &#171; DrugMonkey</dc:creator>
		<pubDate>Fri, 07 Sep 2007 16:09:29 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-673</guid>
		<description>[...] The long version including links to other blogging is here. [...]</description>
		<content:encoded><![CDATA[<p>[...] The long version including links to other blogging is here. [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: BiophysProf</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-555</link>
		<dc:creator>BiophysProf</dc:creator>
		<pubDate>Fri, 24 Aug 2007 20:11:15 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-555</guid>
		<description>The NIH is the primary funding agency for biomedical research in the United States and has funded outstanding work by many scientists who contributed to our health and economy. Since health care is the largest category of the GDP, it seems wise to for the US to see that the NIH is provided with proper funding.  For us to lobby Congress for increased funding, we need to have the data in hand showing that increased funding increases productivity. Since the NIH budget doubled in a short period of time (1999-2003), there should be a corresponding jump in productivity, and the simplest measure of that productivity is the number of publications. While the number of biomedical publications from US labs increased from 1999-2004, so did the number of publications from labs outside the US where the research budget did not double. Is this lack of correlation between funding and the publication rate an accident of choosing the wrong keyword?  “RNA”, “DNA”, “disease”, etc produced similar results. 

Apparently the increase in NIH funding had no effect on the rate of publishing new biomedical data. 
The lack of correlation between the publication rate and the budget is further supported by the fact that after 2003, when the budget flattened, the publication rate showed no inflection, positive or negative. 

This analysis is not inherently insensitive, since over the same period of time there was an enormous increase in publications originating from China. The trend to publish more articles over time seems to reflect the activity of the journal publishers rather than the science, since the number of indexed journals increased from 4500 to 6500 between 1994 and 2006.
 
Perhaps publication rate is not a good index of productivity and papers now contain twice the information as they did in 1996. That is hard to judge, but analysis of the literature suggest otherwise [1-7].  Discussion of the apparent lack of correlation between funding and productivity with NIH representatives led to the suggestion that there is a significant latency between funding and productivity. If this latency is on the order of ten years, then it seems inappropriate to fund grants for only three. 

The best data on US research quality is available at the NIH where the scientific quality of grant applications is judged to three significant figures more than 50,000 times a year. I encourage the NIH to make that data available.  

The lack of correlation between funding and publication rate does not suggest that the NIH is funding bad science, but that NIH is not spending its money efficiently. We need to encourage more students to enter science as a career, if for no other reason than young faculty must publish to survive. While senior scientists may do the most competent and voluminous work, revolutionary ideas tend to come from the young [8]. Currently there is little incentive for American students to enter a scientific career. The average age of an applicant to obtain their first independent NIH grant is 43, and there is currently &gt; 85% chance of rejection for each application. According to the director of NIH, doubling of the NIH budget led to a paradoxical  decrease in the grant funding rate [8]. The difficulty of getting funded is particularly frustrating for young faculty in research universities where tenure is decided primarily by grant funding. 

What did happen to all the extra money that flowed into the NIH [8]? Was it used for clinical trials [3,9]? Was it absorbed by inflation? [8]. Wherever the funds went, they left no clear scientific record. 

Reference List

	1. 	Ioannidis J.P.A. (2005). Why most published research findings are false. Plos Medicine 2: 696-701.
	2. 	Ioannidis J.P.A. (2005). Contradictions in highly cited clinical research - Reply. Jama-Journal of the American Medical Association 294: 2696.
	3. 	Marks A.R. (2006). Rescuing the NIH before it is too late. J Clin Invest 116: 844.
	4. 	Butler D. and Hogan J. (2007). Modellers seek reason for low retraction rates. Nature 447: 236-237.
	5. 	[Anon] (2006). Correction or retraction? Nature 444: 123-124.
	6. 	Abbott A. and Schwarz J. (2002). Dubious data remain in print two years after misconduct inquiry. Nature 418: 113.
	7. 	Lawrence P.A. (2007). The mismeasurement of science. Current Biology 17: R583-R585.
	8. 	Zerhouni E.A. (2006). Research funding - NIH in the post-doubling era: Realities and strategies. Science 314: 1088-1090.
	9. 	Marks A.R. (2006). Rescuing the NIH: the response. J Clin Invest 116: 1460-1461.</description>
		<content:encoded><![CDATA[<p>The NIH is the primary funding agency for biomedical research in the United States and has funded outstanding work by many scientists who contributed to our health and economy. Since health care is the largest category of the GDP, it seems wise to for the US to see that the NIH is provided with proper funding.  For us to lobby Congress for increased funding, we need to have the data in hand showing that increased funding increases productivity. Since the NIH budget doubled in a short period of time (1999-2003), there should be a corresponding jump in productivity, and the simplest measure of that productivity is the number of publications. While the number of biomedical publications from US labs increased from 1999-2004, so did the number of publications from labs outside the US where the research budget did not double. Is this lack of correlation between funding and the publication rate an accident of choosing the wrong keyword?  “RNA”, “DNA”, “disease”, etc produced similar results. </p>
<p>Apparently the increase in NIH funding had no effect on the rate of publishing new biomedical data.<br />
The lack of correlation between the publication rate and the budget is further supported by the fact that after 2003, when the budget flattened, the publication rate showed no inflection, positive or negative. </p>
<p>This analysis is not inherently insensitive, since over the same period of time there was an enormous increase in publications originating from China. The trend to publish more articles over time seems to reflect the activity of the journal publishers rather than the science, since the number of indexed journals increased from 4500 to 6500 between 1994 and 2006.</p>
<p>Perhaps publication rate is not a good index of productivity and papers now contain twice the information as they did in 1996. That is hard to judge, but analysis of the literature suggest otherwise [1-7].  Discussion of the apparent lack of correlation between funding and productivity with NIH representatives led to the suggestion that there is a significant latency between funding and productivity. If this latency is on the order of ten years, then it seems inappropriate to fund grants for only three. </p>
<p>The best data on US research quality is available at the NIH where the scientific quality of grant applications is judged to three significant figures more than 50,000 times a year. I encourage the NIH to make that data available.  </p>
<p>The lack of correlation between funding and publication rate does not suggest that the NIH is funding bad science, but that NIH is not spending its money efficiently. We need to encourage more students to enter science as a career, if for no other reason than young faculty must publish to survive. While senior scientists may do the most competent and voluminous work, revolutionary ideas tend to come from the young [8]. Currently there is little incentive for American students to enter a scientific career. The average age of an applicant to obtain their first independent NIH grant is 43, and there is currently &gt; 85% chance of rejection for each application. According to the director of NIH, doubling of the NIH budget led to a paradoxical  decrease in the grant funding rate [8]. The difficulty of getting funded is particularly frustrating for young faculty in research universities where tenure is decided primarily by grant funding. </p>
<p>What did happen to all the extra money that flowed into the NIH [8]? Was it used for clinical trials [3,9]? Was it absorbed by inflation? [8]. Wherever the funds went, they left no clear scientific record. </p>
<p>Reference List</p>
<p>	1. 	Ioannidis J.P.A. (2005). Why most published research findings are false. Plos Medicine 2: 696-701.<br />
	2. 	Ioannidis J.P.A. (2005). Contradictions in highly cited clinical research &#8211; Reply. Jama-Journal of the American Medical Association 294: 2696.<br />
	3. 	Marks A.R. (2006). Rescuing the NIH before it is too late. J Clin Invest 116: 844.<br />
	4. 	Butler D. and Hogan J. (2007). Modellers seek reason for low retraction rates. Nature 447: 236-237.<br />
	5. 	[Anon] (2006). Correction or retraction? Nature 444: 123-124.<br />
	6. 	Abbott A. and Schwarz J. (2002). Dubious data remain in print two years after misconduct inquiry. Nature 418: 113.<br />
	7. 	Lawrence P.A. (2007). The mismeasurement of science. Current Biology 17: R583-R585.<br />
	8. 	Zerhouni E.A. (2006). Research funding &#8211; NIH in the post-doubling era: Realities and strategies. Science 314: 1088-1090.<br />
	9. 	Marks A.R. (2006). Rescuing the NIH: the response. J Clin Invest 116: 1460-1461.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: drugmonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-172</link>
		<dc:creator>drugmonkey</dc:creator>
		<pubDate>Thu, 12 Jul 2007 19:35:24 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-172</guid>
		<description>&lt;i&gt;&quot;I don’t know much about NIH funding&quot;&lt;/i&gt;

For any readers who feel that they are not sufficiently &quot;up&quot; on NIH funding issues...please, please do not let this dissuade you from offering opinion, should you have it. At the very least you are a consumer of the fruits of the NIH mission, if in the US a taxpayer funding it. And didn&#039;t you read &quot;The rats of NIMH&quot; at least once??? :-)

The NIH request for information means you too...

And for grad students / postdocs and recently transitioned faculty, well, it is YOUR voice that is most missing from the process. Is it any wonder your grievances are so poorly addressed?</description>
		<content:encoded><![CDATA[<p><i>&#8220;I don’t know much about NIH funding&#8221;</i></p>
<p>For any readers who feel that they are not sufficiently &#8220;up&#8221; on NIH funding issues&#8230;please, please do not let this dissuade you from offering opinion, should you have it. At the very least you are a consumer of the fruits of the NIH mission, if in the US a taxpayer funding it. And didn&#8217;t you read &#8220;The rats of NIMH&#8221; at least once??? <img src='http://s.wordpress.com/wp-includes/images/smilies/icon_smile.gif' alt=':-)' class='wp-smiley' /> </p>
<p>The NIH request for information means you too&#8230;</p>
<p>And for grad students / postdocs and recently transitioned faculty, well, it is YOUR voice that is most missing from the process. Is it any wonder your grievances are so poorly addressed?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Dr. Shellie</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-162</link>
		<dc:creator>Dr. Shellie</dc:creator>
		<pubDate>Thu, 12 Jul 2007 00:51:08 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-162</guid>
		<description>Hi drugmonkey,
Thanks for the tag. I don&#039;t know much about NIH funding. But maybe I&#039;ll pick up on the general theme of going after grants and write a post soon.</description>
		<content:encoded><![CDATA[<p>Hi drugmonkey,<br />
Thanks for the tag. I don&#8217;t know much about NIH funding. But maybe I&#8217;ll pick up on the general theme of going after grants and write a post soon.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Core Values of the NIH System &#171; DrugMonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-146</link>
		<dc:creator>Core Values of the NIH System &#171; DrugMonkey</dc:creator>
		<pubDate>Tue, 10 Jul 2007 23:19:51 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-146</guid>
		<description>[...] 10th, 2007   Instead of only addressing the core values of the peer review system (that must be retained or enhanced), as requested in the [...]</description>
		<content:encoded><![CDATA[<p>[...] 10th, 2007   Instead of only addressing the core values of the peer review system (that must be retained or enhanced), as requested in the [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: drugmonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-140</link>
		<dc:creator>drugmonkey</dc:creator>
		<pubDate>Tue, 10 Jul 2007 18:13:22 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-140</guid>
		<description>JSinger, the pyramid structure of science is not at all different from many industries in my view. not too far down this road is critique of capitalism and evoking marxist theory, putting me way out of my element frankly. 

However, yes, a big lab is like a company in that the head gets disproportional credit and the worker bees get little. It is a debate as to whether there is an exploitative bait and switch. Are technician salaries our benchmark, at least for grad students? Well, grad students get paid less, generally, bought off with the promise of a career. For some fraction this is a scam or, at least, a willing gamble. Post-doctoral workers are a trickier case because of the intellectual input more similar to the PI level. Middle management gets paid less than the CEO, I fear, even if the CEO spends his time on the golf course. PIs flit around the country and world and spend the rest of the time on the phone-does this really contribute as much as the scientists back home to the eventual product? likely not. 

what&#039;s the solution, assuming this is a problem? returning to one PI and one trainee laboring side by side at the bench? not a big fan myself, but then I don&#039;t have any good criteria for how big is too big and how exploitative is too exploitative. 

as a caveat, I trained mostly in very small labs and never really felt exploited scientifically, intellectually or whatever. I was grumpy about the uncertain career prospects like anyone. I had some significant setbacks, sure. But I was never really in one of these giant depersonalized labs so YMMV.</description>
		<content:encoded><![CDATA[<p>JSinger, the pyramid structure of science is not at all different from many industries in my view. not too far down this road is critique of capitalism and evoking marxist theory, putting me way out of my element frankly. </p>
<p>However, yes, a big lab is like a company in that the head gets disproportional credit and the worker bees get little. It is a debate as to whether there is an exploitative bait and switch. Are technician salaries our benchmark, at least for grad students? Well, grad students get paid less, generally, bought off with the promise of a career. For some fraction this is a scam or, at least, a willing gamble. Post-doctoral workers are a trickier case because of the intellectual input more similar to the PI level. Middle management gets paid less than the CEO, I fear, even if the CEO spends his time on the golf course. PIs flit around the country and world and spend the rest of the time on the phone-does this really contribute as much as the scientists back home to the eventual product? likely not. </p>
<p>what&#8217;s the solution, assuming this is a problem? returning to one PI and one trainee laboring side by side at the bench? not a big fan myself, but then I don&#8217;t have any good criteria for how big is too big and how exploitative is too exploitative. </p>
<p>as a caveat, I trained mostly in very small labs and never really felt exploited scientifically, intellectually or whatever. I was grumpy about the uncertain career prospects like anyone. I had some significant setbacks, sure. But I was never really in one of these giant depersonalized labs so YMMV.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: drugmonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-138</link>
		<dc:creator>drugmonkey</dc:creator>
		<pubDate>Tue, 10 Jul 2007 17:28:28 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-138</guid>
		<description>Physioprof, the eligibility for K99/R00 is no more than five years out from Ph.D. &lt;em&gt;on funding&lt;/em&gt; so we&#039;re not really talking early/late career. Assuming at least one revision will be necessary, submitting the first proposal by the end of year 3 is the way to go. Since a lot of F32s are going to revision now, it is much rarer that a postdoc can round up NRSA funding by the start of the second year so again, most NRSAs are &quot;late&quot; postdocs! Apart from this current reality, I think there is nothing at all wrong with rolling back the number of years eventual faculty spend in postdoc appointments. Let&#039;s get the good ones out, employed and competing for funding within 3 years, say I. 

With respect to &quot;just give us the proper budget&quot;, well, sure I agree that our public dollars are better spent on the NIH than &lt;a href=&quot;http://drugmonkey.wordpress.com/2007/05/02/cost-of-war/&quot; rel=&quot;nofollow&quot;&gt;elsewhere&lt;/a&gt;. But we also have to face the fact that Congress is not likely to heed the scientists on this anytime soon. So why not use this time of pressure and hand wringing to advance some agenda? After all, when times are good, nobody wants to change the system either. Take the current worry about young investigators. The doubling worsened the situation because most of the gains went to expanding the operations of established investigators, permitted universities to shirk their responsibilities in paying salaries and some infrastructure costs, etc.</description>
		<content:encoded><![CDATA[<p>Physioprof, the eligibility for K99/R00 is no more than five years out from Ph.D. <em>on funding</em> so we&#8217;re not really talking early/late career. Assuming at least one revision will be necessary, submitting the first proposal by the end of year 3 is the way to go. Since a lot of F32s are going to revision now, it is much rarer that a postdoc can round up NRSA funding by the start of the second year so again, most NRSAs are &#8220;late&#8221; postdocs! Apart from this current reality, I think there is nothing at all wrong with rolling back the number of years eventual faculty spend in postdoc appointments. Let&#8217;s get the good ones out, employed and competing for funding within 3 years, say I. </p>
<p>With respect to &#8220;just give us the proper budget&#8221;, well, sure I agree that our public dollars are better spent on the NIH than <a href="http://drugmonkey.wordpress.com/2007/05/02/cost-of-war/" rel="nofollow">elsewhere</a>. But we also have to face the fact that Congress is not likely to heed the scientists on this anytime soon. So why not use this time of pressure and hand wringing to advance some agenda? After all, when times are good, nobody wants to change the system either. Take the current worry about young investigators. The doubling worsened the situation because most of the gains went to expanding the operations of established investigators, permitted universities to shirk their responsibilities in paying salaries and some infrastructure costs, etc.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: JSinger</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-137</link>
		<dc:creator>JSinger</dc:creator>
		<pubDate>Tue, 10 Jul 2007 17:18:16 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-137</guid>
		<description>&lt;I&gt;To be honest, I think the NIH system is designed about as well as possible, and doesn’t need “fixing”. What does need fixing is...&lt;/i&gt;

...IMHO, the systematic overproduction of PhDs and postdocs. Until the current pyramid scheme is replaced with a career ladder, the grant process is always going to serve as the limiting factor to continued growth. I&#039;d disagree with the claim that there&#039;s no room for improvement, but ultimately, as PhysioProf says, it&#039;s not the real problem.

Notes:
1) I&#039;m new here and have no idea if you&#039;ve discussed this issue before.

2) I did drop a note to the NIH about this after Zerhouni&#039;s &quot;The NIH budget was doubled, the number of applicants doubled and now we&#039;re back where we started. This is completely inexplicable, so you&#039;d better double our funding again!&quot; article in Science.</description>
		<content:encoded><![CDATA[<p><i>To be honest, I think the NIH system is designed about as well as possible, and doesn’t need “fixing”. What does need fixing is&#8230;</i></p>
<p>&#8230;IMHO, the systematic overproduction of PhDs and postdocs. Until the current pyramid scheme is replaced with a career ladder, the grant process is always going to serve as the limiting factor to continued growth. I&#8217;d disagree with the claim that there&#8217;s no room for improvement, but ultimately, as PhysioProf says, it&#8217;s not the real problem.</p>
<p>Notes:<br />
1) I&#8217;m new here and have no idea if you&#8217;ve discussed this issue before.</p>
<p>2) I did drop a note to the NIH about this after Zerhouni&#8217;s &#8220;The NIH budget was doubled, the number of applicants doubled and now we&#8217;re back where we started. This is completely inexplicable, so you&#8217;d better double our funding again!&#8221; article in Science.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: drugmonkey</title>
		<link>http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-135</link>
		<dc:creator>drugmonkey</dc:creator>
		<pubDate>Tue, 10 Jul 2007 16:17:47 +0000</pubDate>
		<guid isPermaLink="false">http://drugmonkey.wordpress.com/2007/07/09/how-to-fix-the-nih/#comment-135</guid>
		<description>hmm, never looked into the whole RSS feed feature of wordpress. i&#039;ll take a look at it.</description>
		<content:encoded><![CDATA[<p>hmm, never looked into the whole RSS feed feature of wordpress. i&#8217;ll take a look at it.</p>
]]></content:encoded>
	</item>
</channel>
</rss>
