ResearchBlog‎ > ‎

FW: scholar.py - A parser for Google Scholar, written in Python

posted Oct 30, 2013, 9:21 AM by Teng-Yok Lee   [ updated Oct 30, 2013, 9:22 PM ]
This is cool. I want to use it to analyze whether certain topics have more self citations than others.

The following paragraph is quoted from the official site http://www.icir.org/christian/scholar.html
Google Scholar is great resource, but it's lacking an API. Until there is one, scholar.py is a Python module that implements a querier and parser for Google Scholar's output. Its classes can be used independently, but it can also be invoked as a command-line tool. It could definitely use a few more features, such as detailed author extraction and multi-page crawling. If you're interested in adding features, do send patches! (Thanks to those of you who have—you know who you are.)
 
Note:This script only use BeautifulSoup. Only version 3 can work.  Change the line from BeautifulSoup import BeautifulSoup to from bs4 import BeautifulSoup does not help.

Here is the result I search. It seems that only the author name can be used to query, but I prefer to search with the paper title. Otherwise, it will be more helpful if it can return the authors too.
$ python scholar.py --author="Teng-Yok Lee" "Visualization"
         Title An information-theoretic framework for flow visualization
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5613461
     Citations 37
      Versions 12
Citations list http://scholar.google.com/scholar?cites=9106169218819595071&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=9106169218819595071&hl=en&as_sdt=1,5
          Year 2010

         Title Visualization and exploration of temporal trend relationships in multivariate time-varying data
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5290749
     Citations 15
      Versions 12
Citations list http://scholar.google.com/scholar?cites=2642186061934580966&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=2642186061934580966&hl=en&as_sdt=1,5
          Year 2009

         Title View point evaluation and streamline filtering for flow visualization
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5742376
     Citations 14
      Versions 7
Citations list http://scholar.google.com/scholar?cites=441434512775469568&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=441434512775469568&hl=en&as_sdt=1,5
          Year 2011

         Title Scalable parallel building blocks for custom data analysis
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6092324
     Citations 17
      Versions 7
Citations list http://scholar.google.com/scholar?cites=13422225121812586831&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=13422225121812586831&hl=en&as_sdt=1,5
          Year 2011

         Title A study of parallel particle tracing for steady-state and time-varying flow fields
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6012871
     Citations 19
      Versions 7
Citations list http://scholar.google.com/scholar?cites=2563345291252687165&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=2563345291252687165&hl=en&as_sdt=1,5
          Year 2011

         Title Visualizing time-varying features with tac-based distance fields
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4906831
     Citations 8
      Versions 8
Citations list http://scholar.google.com/scholar?cites=6779999163248662192&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=6779999163248662192&hl=en&as_sdt=1,5
          Year 2009

         Title An image-based modeling approach to gpu-based unstructured grid volume rendering
           URL http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.79.3377&rep=rep1&type=pdf
     Citations 9
      Versions 5
Citations list http://scholar.google.com/scholar?cites=16150139904233454381&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=16150139904233454381&hl=en&as_sdt=1,5
          Year 2006

         Title Load-balanced parallel streamline generation on large scale vector fields
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=6064941
     Citations 10
      Versions 8
Citations list http://scholar.google.com/scholar?cites=15819879486830507892&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=15819879486830507892&hl=en&as_sdt=1,5
          Year 2011

         Title Cyclestack: Inferring periodic behavior via temporal sequence visualization in ultrasound video
           URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5429602
     Citations 2
      Versions 9
Citations list http://scholar.google.com/scholar?cites=405296597063639844&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=405296597063639844&hl=en&as_sdt=1,5
          Year 2010

         Title Exploring flow fields using fractal analysis of field lines
           URL http://www.cse.ohio-state.edu/~chaudhua/Publications/postersummary1_vis12.pdf
     Citations 1
      Versions 2
Citations list http://scholar.google.com/scholar?cites=15634671221111833227&as_sdt=2005&sciodt=1,5&hl=en
 Versions list http://scholar.google.com/scholar?cluster=15634671221111833227&hl=en&as_sdt=1,5
          Year 2011


Comments