<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Nate Silver and Veronique de Rugy demonstrate how a more modern peer review process could work.</title>
	<atom:link href="http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/</link>
	<description>Exploring Political Attitudes Through Moral Psychology</description>
	<lastBuildDate>Mon, 23 Jan 2012 07:25:35 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=2.9.2</generator>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<item>
		<title>By: Ravi</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-381</link>
		<dc:creator>Ravi</dc:creator>
		<pubDate>Sun, 11 Apr 2010 05:54:29 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-381</guid>
		<description>Jason, I apologize in advance if I&#039;m reading you wrong, but I can&#039;t help but think that you have a quasi-moral opinion about &quot;blogging your own research&quot; that makes me feel judged. I think the inherent bias of any blogger is self-evident in the fact that it&#039;s their blog...it&#039;s someone&#039;s opinion to be taken for what it&#039;s worth, judging the source of the information as part of that process. It&#039;s pretty obvious when something is a person&#039;s own work as most people say so fairly explicitly. I do.

I definitely think peer-reviewed research is likely of higher quality and people should treat it as such...but it&#039;s certainly not the only quantitative data that&#039;s worth sharing. Gallup and FiveThirtyEight.com share worthwhile quantitative data all the time. Peer review isn&#039;t usually about accuracy, but often about novelty or how much some piece of data advances the science. Reviewers don&#039;t reanalyze your data or make sure you actually did the methods you said you did. Rather, they assess how much your results advance the discipline you are in and whether that contribution is worthy of their journal...you could have an entirely accurate result...and reviewers will decline it because it&#039;s not novel enough or because it&#039;s hard to interpret, not because it&#039;s inaccurate. Unless reviewers start auditing labs and datasets, they can&#039;t really assess accuracy. The peer review process ends up being more about CV building, rather than sharing information....If it were truly about sharing information, we would see a lot more null results, failures to replicate, and insignificant findings, all of which are accurate results, but not novel enough....we&#039;d see auditing of accuracy rather than novelty.

...but I digress, my main point isn&#039;t really about the peer review process, but rather the fact that blogging is an inherently opinionated and subjective exercise, which is part of what readers sign up for....so unless people actually deceive others, I don&#039;t see anything strange about blogging about one&#039;s own amorphous non-peer reviewed research ideas. If people don&#039;t like it, they can stop reading or comment on how crappy the post is...:)  Indeed, the interactive medium invites more review in some ways (see Nate Silver and De Rugy&#039;s thread above), just as you are somewhat reviewing this post by your comment.</description>
		<content:encoded><![CDATA[<p>Jason, I apologize in advance if I&#8217;m reading you wrong, but I can&#8217;t help but think that you have a quasi-moral opinion about &#8220;blogging your own research&#8221; that makes me feel judged. I think the inherent bias of any blogger is self-evident in the fact that it&#8217;s their blog&#8230;it&#8217;s someone&#8217;s opinion to be taken for what it&#8217;s worth, judging the source of the information as part of that process. It&#8217;s pretty obvious when something is a person&#8217;s own work as most people say so fairly explicitly. I do.</p>
<p>I definitely think peer-reviewed research is likely of higher quality and people should treat it as such&#8230;but it&#8217;s certainly not the only quantitative data that&#8217;s worth sharing. Gallup and FiveThirtyEight.com share worthwhile quantitative data all the time. Peer review isn&#8217;t usually about accuracy, but often about novelty or how much some piece of data advances the science. Reviewers don&#8217;t reanalyze your data or make sure you actually did the methods you said you did. Rather, they assess how much your results advance the discipline you are in and whether that contribution is worthy of their journal&#8230;you could have an entirely accurate result&#8230;and reviewers will decline it because it&#8217;s not novel enough or because it&#8217;s hard to interpret, not because it&#8217;s inaccurate. Unless reviewers start auditing labs and datasets, they can&#8217;t really assess accuracy. The peer review process ends up being more about CV building, rather than sharing information&#8230;.If it were truly about sharing information, we would see a lot more null results, failures to replicate, and insignificant findings, all of which are accurate results, but not novel enough&#8230;.we&#8217;d see auditing of accuracy rather than novelty.</p>
<p>&#8230;but I digress, my main point isn&#8217;t really about the peer review process, but rather the fact that blogging is an inherently opinionated and subjective exercise, which is part of what readers sign up for&#8230;.so unless people actually deceive others, I don&#8217;t see anything strange about blogging about one&#8217;s own amorphous non-peer reviewed research ideas. If people don&#8217;t like it, they can stop reading or comment on how crappy the post is&#8230;:)  Indeed, the interactive medium invites more review in some ways (see Nate Silver and De Rugy&#8217;s thread above), just as you are somewhat reviewing this post by your comment.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jason</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-380</link>
		<dc:creator>Jason</dc:creator>
		<pubDate>Sat, 10 Apr 2010 20:50:53 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-380</guid>
		<description>As a general rule, I don&#039;t blog about amorphous research ideas (ever), and if I blogged my own research it would not be until AFTER it had been published in whichever journal and I could link to the original material. AND I&#039;d have to make it abundantly transparent that I was blogging my own research and inherently biased. And I&#039;d make an effort to invite relevant other bloggers to discuss the research as well.

Then, there&#039;s the issue of (at least for certain kinds of research), wanting protection from, say, animal rights extremists. If that became an issue, it would almost certainly stop me from blogging my own research.</description>
		<content:encoded><![CDATA[<p>As a general rule, I don&#8217;t blog about amorphous research ideas (ever), and if I blogged my own research it would not be until AFTER it had been published in whichever journal and I could link to the original material. AND I&#8217;d have to make it abundantly transparent that I was blogging my own research and inherently biased. And I&#8217;d make an effort to invite relevant other bloggers to discuss the research as well.</p>
<p>Then, there&#8217;s the issue of (at least for certain kinds of research), wanting protection from, say, animal rights extremists. If that became an issue, it would almost certainly stop me from blogging my own research.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Johnnie Linn</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-378</link>
		<dc:creator>Johnnie Linn</dc:creator>
		<pubDate>Fri, 09 Apr 2010 18:06:52 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-378</guid>
		<description>The feedback process can be speeded up if you present your paper at a conference first.  The input you get there is likely to be similar from what you would get from referees later, especially if you are presenting your paper at the conference whose society&#039;s journal is the one you want to publish in.

Conference proceedings are becoming increasingly available on line.  That means your work can be more easily found before you have reached the publication stage.  

I think that journals that are associated with major research universities will have less of a relative impact in the future in fields where research is not capital-intensive.  Lesser journals will have an increasing relative importance since they can disseminate information worldwide at no greater cost than the older journals.</description>
		<content:encoded><![CDATA[<p>The feedback process can be speeded up if you present your paper at a conference first.  The input you get there is likely to be similar from what you would get from referees later, especially if you are presenting your paper at the conference whose society&#8217;s journal is the one you want to publish in.</p>
<p>Conference proceedings are becoming increasingly available on line.  That means your work can be more easily found before you have reached the publication stage.  </p>
<p>I think that journals that are associated with major research universities will have less of a relative impact in the future in fields where research is not capital-intensive.  Lesser journals will have an increasing relative importance since they can disseminate information worldwide at no greater cost than the older journals.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: A Civilized Debate &#171; The Recovery Act</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-372</link>
		<dc:creator>A Civilized Debate &#171; The Recovery Act</dc:creator>
		<pubDate>Fri, 02 Apr 2010 13:44:24 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-372</guid>
		<description>[...] has also been suggested that this is a model for the quick, effective peer-review that the internet [...]</description>
		<content:encoded><![CDATA[<p>[...] has also been suggested that this is a model for the quick, effective peer-review that the internet [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Nance</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-371</link>
		<dc:creator>Nance</dc:creator>
		<pubDate>Fri, 02 Apr 2010 13:00:26 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-371</guid>
		<description>I think we have to bow to the inevitable direction of publication now (blogs, research groups&#039; proprietary websites, etc.) and watch the new formats evolve toward new kinds of unimagined excellence.  I read somewhere this week of math problems being solved by bloggers whose comments offered bits and pieces to produce a solution...much like a group of mathematicians clustered around a blackboard, but pulling in numbers of and diversity of contributors in unprecedented ways .  The news moves too fast, the moment is too pregnant for the old processes.  The concept of ownership of data and conclusion would have to change, I think, toward something more globally owned; the emphasis might become origination and contribution rather than ownership as we currently think of it.  Cooperation would ultimately out-produce competition in academia.  It sounds thrilling!</description>
		<content:encoded><![CDATA[<p>I think we have to bow to the inevitable direction of publication now (blogs, research groups&#8217; proprietary websites, etc.) and watch the new formats evolve toward new kinds of unimagined excellence.  I read somewhere this week of math problems being solved by bloggers whose comments offered bits and pieces to produce a solution&#8230;much like a group of mathematicians clustered around a blackboard, but pulling in numbers of and diversity of contributors in unprecedented ways .  The news moves too fast, the moment is too pregnant for the old processes.  The concept of ownership of data and conclusion would have to change, I think, toward something more globally owned; the emphasis might become origination and contribution rather than ownership as we currently think of it.  Cooperation would ultimately out-produce competition in academia.  It sounds thrilling!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Ravi</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-370</link>
		<dc:creator>Ravi</dc:creator>
		<pubDate>Fri, 02 Apr 2010 06:54:45 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-370</guid>
		<description>I suppose not, though I don&#039;t know if I have a concrete idea of what an ideal system would look like. What would you say the primary problems would be if people blogged their own research? I think someday all research groups will have some kind of dynamic internet presence. Just noticed that you have your own blog...do you blog about your own research ideas?  Or only stuff that has already been published?  I&#039;m interested in getting other people&#039;s ideas about these kinds of issues (hence my post).</description>
		<content:encoded><![CDATA[<p>I suppose not, though I don&#8217;t know if I have a concrete idea of what an ideal system would look like. What would you say the primary problems would be if people blogged their own research? I think someday all research groups will have some kind of dynamic internet presence. Just noticed that you have your own blog&#8230;do you blog about your own research ideas?  Or only stuff that has already been published?  I&#8217;m interested in getting other people&#8217;s ideas about these kinds of issues (hence my post).</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jason</title>
		<link>http://www.polipsych.com/2010/04/01/nate-silver-and-veronique-de-rugy-demonstrate-how-a-more-modern-peer-review-process-could-work/comment-page-1/#comment-369</link>
		<dc:creator>Jason</dc:creator>
		<pubDate>Fri, 02 Apr 2010 06:38:55 +0000</pubDate>
		<guid isPermaLink="false">http://www.polipsych.com/?p=134#comment-369</guid>
		<description>Would this be substantively different from - essentially - blogging your own research?</description>
		<content:encoded><![CDATA[<p>Would this be substantively different from &#8211; essentially &#8211; blogging your own research?</p>
]]></content:encoded>
	</item>
</channel>
</rss>

