Home » Blog, Featured

Michael Nielsen, the credit economy, and open science

23 April 2011 6 Comments
No credit cards please.......

Michael Nielsen is a good friend as well as being an inspiration to many of us in the Open Science community. I’ve been privileged to watch and in a small way to contribute to the development of his arguments over the years and I found the distillation of these years of effort into the talk that he recently gave at TEDxWaterloo entirely successful. Here is a widely accesible and entertaining talk that really pins down the arguments, the history, the successes and the failures of recent efforts to open up science practice.

Professional scientific credit is the central issue

I’ve been involved in many discussions around why the potential of opening up research practice hasn’t lead to wider adoption of these approaches. The answer is simple, and as Michael says very clearly in the opening section of the talk, the problem is that innovative approaches to doing science are not going to be adopted while those that use them don’t get conventional scientific credit. I therefore have to admit to being somewhat nonplussed by GrrlScientist’s assessment of the talk that “Dr Nielsen has missed — he certainly has not emphasised — the most obvious reason why the Open Science movement will not work: credit.”

For me, the entire talk is about credit. He frames the discussion of why the Qwiki wasn’t a huge success, compared to the Polymath project, in terms of the production of conventional papers, he discusses the transition from Galileo’s anagrams to the development of the scientific journal in terms of ensuring priority and credit. Finally he explicitly asks the non-scientist members of the audience to do something that even more closely speaks to the issue of credit, to ask their scientist friends and family what they are doing to make their results more widely available. Remember this talk is aimed at a wider audience, the TEDxWaterloo attendees and the larger audience for the video online (nearly 6,000 when I wrote this post). What happens when taxpayers start asking their friends, their family, and their legislative representatives how scientific results are being made available? You’d better believe that this has an affect on the credit economy.

Do we just need the celebrities to back us?

Grrl suggests that the answer to pushing the agenda forward is to enlist Nobelists to drive projects in the same way that Tim Gowers pushed the Polymath project. While I can see the logic and there is certainly value in moral support from successful scientists we already have a lot of this. Sulston, Varmus, Michael and Jon Eisen, and indeed Michael himself just to name a few are already pushing this agenda. But moral support and single projects are not enough. What we need to do is hack the underlying credit economy, provide proper citations for data and software, exploit the obsession with impact factors.

The key to success in my view is a pincer movement. First, showing that more (if not always completely) open approaches can outcompete closed approaches on traditional assessment measures, something demonstrated successfully by Galaxy Zoo, the Alzeimers Disease Neuroimaging Initiative, and the Polymath Projects. Secondly changing assessment policy and culture itself, both explicitly by changing the measures by which researchers are ranked, and implicitly by raising the public expectation that research should be open.

The pendulum is swinging and we’re pushing it just about every which-way we can

I guess what really gets my back up is that Grrl sets off with the statement that “Open Science will never work” but then does on to put her finger on exactly the point where we can push to make it work. Professional and public credit is absolutely at the centre of the challenge. Michael’s talk is part of a concerted, even quite carefully coordinated, campaign to tackle this issue at a wide range of levels. Michael’s tour of his talk, funded by the Open Society Institute seeks to raise awareness. My recent focus on research assessment (and a project also funded by OSI) is tackling the same problem from another angle. It is not entirely a coincidence that I’m writing this in a hotel room in Washington DC and it is not at all accidental that I’m very interested in progress towards widely accepted researcher identifiers. The development of Open Research Computation is a deliberate attempt to build a journal that exploits the nature of journal rankings to make software development more highly valued. 

All of these are part of a push to hack, reconfigure, and re-assess the outputs and outcomes that researchers get credit for and the the outputs and outcomes that are valued by tenure committees and grant panels. And from where I stand we’re making enough progress that Grrl’s argument seems a bit tired and outdated. I’m seeing enough examples of people getting credit and reward for being open and simply doing and enabling better science as a result that I’m confident the pendulum is shifting. Would I advise a young scientist that being open will lead to certain glory? No, it’s far from certain, but you need to distinguish yourself from the crowd one way or another and this is one way to do it. It’s still high risk but show me something in a research career that is low risk and I’ll show something that isn’t worth doing.

What can you do?

If you believe that a move towards more open research practice is a good thing then what can you do to make this happen? Well follow what Michael says, give credit to those who share, explicitly acknowledge the support and ideas you get from others. Ask researchers how they go about ensuring that their research is widely available and above all used. The thing is, in the end changing the credit economy itself isn’t enough, we actually have to change the culture that underlies that economy. This is hard but it is done by embedding the issues and assumptions in the everyday discourse about research. “How useable are your research outputs really?” is the question that gets to the heart of the problem. “How easily can people access, re-use, and improve on your research? And how open are you to getting the benefit of other people’s contribution?” are the questions that I hope will become embedded in the assumptions around how we do research. You can make that happen by asking them.

 

Enhanced by Zemanta

6 Comments »

  • Manoel Galdino said:

    I really think that we should copy peer-to-peer download norms. If you use torrent in a private trackback, they monitore what is your shared ratio, i.e, how much you shared viz-a-viz how much you got from others. This could be our “impact factor” measure and would help to get wider acceptance among scientists.

  • Linkfest, 26 April said:

    […] arguing that Open Science as presented by Nielsen simply won’t work. Cameron Neylon wrote this great response, which I agree with. And they kind of agree with each other too.National Geographic are taking over […]

  • Cameron Neylon said:

    Manoel,

    Thanks for the comment. I agree in general principles but I think this tit-for-tat approach has two problems. One is that re-use in a research setting is much harder to measure than uploads and downloads as it goes through many more channels. The other is that pure mechanistic approaches bother me. This is the distinction between changing credit mechanisms and changing culture. We need to do one first but we musn’t forget that the long term aim is to work towards an assumption that good behaviour is the default. This makes it an intrinsic motivator rather than an extrinsic one which is much more powerful.

  • Jordi Cabot said:

    I do agree that credit is the central issue here (I explain my view: “Be honest, curing cancer is not your primary goal” here: http://myresearchrants.wordpress.com/2011/05/03/be-honest-curing-cancer-is-not-your-primary-goal/) but I don’t think putting “pressure” on young researchers to change their approach to be more “open science oriented” is the solution. Researchers trying to get a permanent position (and they are many!) will not do anything that may risk their career (even if they completely believe in open science).

    Senior researchers must lead the change on government evaluation policies that allows researchers to work in cooperation and not in competition (to take all the “credit”)

  • Cameron Neylon said:

    Hi Jordi, very much liked your piece incidentally. I don’t think I’m advocating putting pressure on any one particularly, and certainly not asking them to risk their career. What we’re advocating is implementing (or just hacking) reward and credit systems so that the best way to not risk your career is by being open, where by being closed you’re actually very clearly taking a much bigger risk. I don’t even think it requires a massive change to existing systems. Just carefully placed hacks in the current system that change the incentives.

  • Drafting proposals in the open – a practical test said:

    […] better than many online equivalents: storing the metadata of some key references, and giving credit to at least some of those who influenced us in writing this post. Suggestions on how to achieve […]