• Monday, February 20, 2012
February 20, 2012, 05:46:12 AM *
Welcome, Guest. Please login or register.

Login with your Chronicle username and password
News: Talk about how to cope with chronic illness, disability, and other health issues in the academic workplace.
 
Pages: [1] 2
  Print  
Author Topic: measuring the influence of an article  (Read 1592 times)
untenured
On far too many committees
Member-Moderator
Distinguished Senior Member
*****
Posts: 5,542


« on: September 03, 2009, 02:08:06 PM »

I'm researching the influence of a journal through citation of its published articles.  The obvious way is to check for citations in leading databases.  The problem with that is that many citations will be redundant and make the work painstakingly slow.  If this was one article, no problem, but I would like to measure the influence of a large number of articles.

Do you have any suggestions as to perform such a measurement efficiently?

Are there any articles in your field that measure the influence of a journal through various methods?

Thanks,

Untenured
Logged

Quote from: kedves link=topic=56697.msg1152543#msg1152543
You are among the Pure and Truthful, however small their Number.
My goodness, that was an exceptionally good analysis of the forum.
locutus
Wielder of the Chillax
Distinguished Senior Member
*****
Posts: 2,223


« Reply #1 on: September 03, 2009, 02:10:27 PM »

Do you mean like an Impact Factor? All of the top journals in my field have some sort of metric like that. I'm not sure the details off hand, but I could get back to you.
Logged

Render unto Geedorah what is Geedorah's.
untenured
On far too many committees
Member-Moderator
Distinguished Senior Member
*****
Posts: 5,542


« Reply #2 on: September 03, 2009, 02:43:18 PM »

Do you mean like an Impact Factor? All of the top journals in my field have some sort of metric like that. I'm not sure the details off hand, but I could get back to you.

Sort of.  I am familiar with the impact factor of a journal overall.  What I would like to measure instead is the 'impact' of individual articles within a journal and be able to make objective and relative comparisons between those individual journal articles.

Untenured
Logged

Quote from: kedves link=topic=56697.msg1152543#msg1152543
You are among the Pure and Truthful, however small their Number.
My goodness, that was an exceptionally good analysis of the forum.
locutus
Wielder of the Chillax
Distinguished Senior Member
*****
Posts: 2,223


« Reply #3 on: September 03, 2009, 02:54:07 PM »

Do you mean like an Impact Factor? All of the top journals in my field have some sort of metric like that. I'm not sure the details off hand, but I could get back to you.

Sort of.  I am familiar with the impact factor of a journal overall.  What I would like to measure instead is the 'impact' of individual articles within a journal and be able to make objective and relative comparisons between those individual journal articles.

Untenured

I think this (http://www.harzing.com/pop.htm ) unfortunately named program might be of interest. I played around with it a few years ago. It had some issues but was at least an interesting idea.
Logged

Render unto Geedorah what is Geedorah's.
menotti
Distinguished Senior Member
*****
Posts: 1,018


« Reply #4 on: September 03, 2009, 04:09:51 PM »

I'm confused.  Journal Impact Factor should address the issue of "a whole bunch of articles".  Science citation index can give you the number of times an article has been cited.
Logged
offthemarket
Still a
Distinguished Senior Member
*****
Posts: 1,632


« Reply #5 on: September 03, 2009, 04:46:59 PM »

I don't think the original poster knows about the impact factor.  Find out the journal's impact factor.  It is a number produced by ISI using the average number of citations to papers in the journal published within the last two years. You might also try the H index.

Check out this link: http://www.scimagojr.com/journalrank.php
Logged
onestep
Senior member
****
Posts: 818


« Reply #6 on: September 03, 2009, 05:20:27 PM »

Check out this article.  It's method, network analysis, appears far better than just using the impact factor.


http://www.ajph.org/cgi/content/abstract/95/8/1330?maxtoshow=&HITS=10&hits=10&RESULTFORMAT=&fulltext=social+capital&searchid=1&FIRSTINDEX=0&sortspec=relevance&resourcetype=HWCIT
Logged
svenc
My CV says I'm a
Distinguished Senior Member
*****
Posts: 3,361


« Reply #7 on: September 03, 2009, 05:31:19 PM »

Untenured, are you familiar with the Citation Indices on ISI Web of Science?  Your university definitely has access to it, and it's the standard way for seeing who has cited articles.

Google Scholar can also provide a useful citation list, and is much broader in scope that ISI.
Logged

In foris veritas.
runwithscissors
Senior member
****
Posts: 350


« Reply #8 on: September 03, 2009, 06:38:16 PM »

The SCImago Journal and Country Rank website has some useful tools for comparing journal impact according to different criteria:

http://www.scimagojr.com/journalrank.php

I'm not sure if that is what you are looking for but it could be useful.
Logged

"Space is invisible mind dust, and stars are but wishes"
cogscientist
Headologist Extraordinaire
Senior member
****
Posts: 305


« Reply #9 on: September 03, 2009, 07:05:30 PM »

If you are interested in the impact of articles within a single journal, one thing you can do on ISI WoS is first to do a search query for all publications from this journal, and then to play with "Analyze Results". This should give you all sorts of possibilities.

You can also create a citation report from the results of the search query, for an interesting perspective on the journal (for example, it will compute the h-index of the journal, a rather intriguing idea).
Logged

Not posting much ever since I've been lured to the Dark Side
neil9
Senior member
****
Posts: 383


« Reply #10 on: September 03, 2009, 07:55:07 PM »

In my view, the citation number of a particular paper is far more important than the impact factor of the journal the paper was published in.

I do not care about the journal's impact factor. I care about the impact of my particular paper.
Logged

Officially the bad guy on this forum.
sciencephd
Distinguished Senior Member
*****
Posts: 6,040


« Reply #11 on: September 03, 2009, 08:19:16 PM »


I do not care about the journal's impact factor. I care about the impact of my particular paper.


And you're in the sciences ?  If so, this is either incredibly naive or disingenuous.

Logged

I just hate it that I constantly have to like everyone and everything. -- moonstone

O, what a hateful feminist concoction!
Jews, communists, "lesbians", feminists and marihuana addicts  --Pyshnov
collegekidsmom
Distinguished Senior Member
*****
Posts: 2,663


« Reply #12 on: September 03, 2009, 11:00:04 PM »

Could you describe more specifically what you are looking for? As a librarian, I can say that there are many variations on common metrics depending on both discipline, or even subfield, and whether you are interested in journal ranking in terms of identifying "top tier" journals, or more influential journal titles based on citations. There are also journals listed as core titles to disciplines (for discrete subject areas). These titles, considered the "core" of the discipline are somewhat different. "Eigenfactor" values are another measure of journal impact(other than impact factor) and may be what you are looking for. Eigenfactor data has to do with "vast networks of citations" to evaluate journals. Data used is from Thomson Reuters and is now reported through their databases.
Is this the kind of thing your are looking for:?

http://www.eigenfactor.org/whyeigenfactor.htm

If not, could you describe what you need more specifically?
Logged
untenured
On far too many committees
Member-Moderator
Distinguished Senior Member
*****
Posts: 5,542


« Reply #13 on: September 04, 2009, 07:42:12 AM »

These are great tips and I appreciate your help.  Some have already provided good leads.  I'll try to explain in more detail what I am looking for.

Although it is important and I may need it later, I am not looking for information about a journal's impact.  There are good metrics available and there's one specific to my discipline that works.  Rather, I am trying to measure the impact of individual articles within a journal.  So, for example, volume 21 of a journal contains five articles: A,B,C,D, and E.  How can I efficiently and accurately measure the impact of each journal article in relation to the other and in relation to the broader articles in the discipline.

My overall goal might clarify things too.  I am the editorial board member of a journal.  I would like to write a brief retrospective of the journal and discuss the influence of individual articles within that journal.  For example, "articles in the Journal of Fungus have changed the discipline.  For example, Frank's article in volume 9 has been cited thirty times and this and that."  I want to capture the scope and influence of both the journal itself and the articles within it.  Efficient and accurate metrics to help me do that would be much appreciated.

Thanks for suggestions so far and more are welcome.

Untenured
Logged

Quote from: kedves link=topic=56697.msg1152543#msg1152543
You are among the Pure and Truthful, however small their Number.
My goodness, that was an exceptionally good analysis of the forum.
neil9
Senior member
****
Posts: 383


« Reply #14 on: September 04, 2009, 07:51:28 AM »

I may have carried my theme to the extreme. But the basic idea is still sound, I think. There can be high impact papers in a low impact journal and low impact papers in a high impact journal. It is the real impact of a particular paper, instead of the journal, that is really important.


I do not care about the journal's impact factor. I care about the impact of my particular paper.


And you're in the sciences ?  If so, this is either incredibly naive or disingenuous.


Logged

Officially the bad guy on this forum.
Pages: [1] 2
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.9 | SMF © 2006-2008, Simple Machines LLC Valid XHTML 1.0! Valid CSS!