{"id":6,"date":"2015-05-08T18:15:14","date_gmt":"2015-05-08T18:15:14","guid":{"rendered":"https:\/\/alandix.com\/ref2014\/?page_id=6"},"modified":"2018-02-08T15:22:07","modified_gmt":"2018-02-08T15:22:07","slug":"data","status":"publish","type":"page","link":"https:\/\/alandix.com\/ref2014\/data\/","title":{"rendered":"data"},"content":{"rendered":"

All analysis has been performed on public-domain data.<\/p>\n

REF submission data<\/h2>\n

Full data for all disciplines\u00a0is available at:
\nhttp:\/\/results.ref.ac.uk\/<\/a><\/p>\n

Data for computing is available at “Download submission data: 11 \u2013 Computer Science and Informatics.”
\nhttp:\/\/results.ref.ac.uk\/DownloadSubmissions\/ByUoa\/11<\/a><\/p>\n

Downloadable files include an Access database and two zip files each containing a spreadsheet listing outputs, staff, and other metadata and full copies of all environment templates, impact templates and impact case studies. \u00a0They vary slightly:<\/p>\n

Microsoft Excel 2007 spreadsheet for browsing (75.4MB): \u00a0The spreadsheet has easily sortable columns and human readable column names, but only has a selection of the columns in the full data.<\/p>\n

Normalised Microsoft Excel 2007 spreadsheet (76.9MB): The spreadsheet has all columns and the zip file also includes documentation as web pages.<\/p>\n

REF\u00a0Contextual Data<\/h2>\n

This spreadsheet was distributed by the REF team to institutions prior to submission in 2013, and its purpose and derivation is described in detail at:<\/p>\n

http:\/\/www.ref.ac.uk\/about\/guidance\/citationdata\/contextualdata\/<\/a>
\ndata at\u00a0https:\/\/www.hesa.ac.uk\/news\/18-12-2014\/research-excellence-framework-data<\/a><\/p>\n

“Citation counts depend partly on the field of research and a publication\u2019s age. Therefore, where sub-panels are making use of citation data the REF team will provide contextual data to assist in the sub-panel’s interpretation of the citation counts. This will consist of information about the citation behaviour of groups of papers worldwide, published in a similar subject area and of a similar age.” (extract)<\/em><\/p><\/blockquote>\n

This\u00a0used data from Scopus to give a profile for each area. \u00a0For each area and age of publication it gives the number of citations required to put\u00a0the paper in the top 1%, 5%, 10% or 25% of papers within its area.<\/p>\n

The full spreadsheet covers all academic\u00a0areas, but the computing topics are\u00a0reproduced in this excerpt.<\/p>\n

\"ref-contextual\"<\/a><\/p>\n

Morris Sloman’s Sub-panel 11 Computer-Science and Informatics REF Analysis<\/h2>\n

This has been widely distributed and a copy is here<\/a>.<\/p>\n

Some highlights (click for full size) …<\/p>\n

\"Sloman-topic-analysis\"
\n<\/a>Table with 4*\/3*\/2*\/1* profile for each sub-sea of computing using the ACM codes provided as part of the submission.<\/p>\n

\"sloman-scopus-vs-4-star\"
\n<\/a>Cross tabulation of Scopus citation counts and REF scores.<\/p>\n

\"sloman-gs-vs-4-star\"
\n<\/a>The same for Google scholar citations<\/p>\n

Derived data<\/h2>\n

The following of CSV and JSON files contain data derived from the raw REF submission data.<\/p>\n

outputs.csv<\/a><\/strong> — The outputs worksheet from “Normalised Microsoft Excel 2007” exported as a CSV file. \u00a0The fields are described\u00a0in the REF documentation. \u00a0Note that the ‘AdditionalInformation’ field includes a digit in angle brackets (e.g. “<23> This work proposes a method …”), which is the ACM topic code. \u00a0Note too the column ‘CitedByCount’, which contains the Scopus citations for the output (at census date in last 2013)<\/p>\n

outputs_with_google.csv<\/a><\/strong> — Copy of the\u00a0above with two extra columns. ‘ACM_Code’ is the ACM code extracted from the ‘AdditionalInformation’ field.\u00a0 ‘Google_Cites’ is the google citations for the output where available (at census date late 2014)<\/p>\n

outputs_with_google.json<\/a><\/strong> — The above in JSON format (often faster and easier to read than CSV).<\/p>\n

g_outputs_with_scores.csv<\/a><\/strong>\u00a0— Copy of outputs.csv with five\u00a0extra columns. ‘ACM_Code’ is the ACM code as previously described. ‘Context_Code’ is the code from the REF contextual data. \u00a0‘Q_Score’ is a quartile score based on Scopus citations; high is best: 100 means top quartile, 25 bottom quartile and 50, and 75 and the middle quartiles. \u00a0‘C_Score’ is a score based on the REF contextual data; low is best: 1 means top 1% in its area worldwide, 5 top 5%, similar for 10, 25 and 100 means somewhere in the lower 75% of outputs. ‘G_Score’ is calculated the same as ‘Q_Score’, but using Google scholar citations. \u00a0In each case a blank field means the data is unavailable.<\/p>\n

g_outputs_with_scores.json<\/a><\/strong>\u00a0— The above in JSON format.<\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n

 <\/p>\n","protected":false},"excerpt":{"rendered":"

All analysis has been performed on public-domain data. REF submission data Full data for all disciplines\u00a0is available at: http:\/\/results.ref.ac.uk\/ Data for computing is available at “Download submission data: 11 \u2013 Computer Science and Informatics.” http:\/\/results.ref.ac.uk\/DownloadSubmissions\/ByUoa\/11 Downloadable files include an Access … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":2,"comment_status":"open","ping_status":"open","template":"","meta":{"_themeisle_gutenberg_block_has_review":false,"footnotes":""},"class_list":["post-6","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/pages\/6","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/comments?post=6"}],"version-history":[{"count":15,"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/pages\/6\/revisions"}],"predecessor-version":[{"id":103,"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/pages\/6\/revisions\/103"}],"wp:attachment":[{"href":"https:\/\/alandix.com\/ref2014\/wp-json\/wp\/v2\/media?parent=6"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}