Small library for extracting references used in scholarly communication.
Project description
Small library for extracting references used in scholarly communication.
Free software: GPLv2
Documentation: http://pythonhosted.org/refextract/
Issues and pull requests: https://github.com/inspirehep/refextract
Originally exported from Invenio https://github.com/inveniosoftware/invenio.
Dependencies
[file](http://linux.die.net/man/1/file)
[pdftotext](http://linux.die.net/man/1/pdftotext)
Installation
pip install refextract
Usage
To get structured info from a publication reference:
from refextract import extract_journal_reference
reference = extract_journal_reference("J.Phys.,A39,13445")
print(reference)
{
'extra_ibids': [],
'is_ibid': False,
'misc_txt': u'',
'page': u'13445',
'title': u'J. Phys.',
'type': 'JOURNAL',
'volume': u'A39',
'year': ''
}
To extract references from a publication full-text PDF:
from refextract import extract_references_from_file
reference = extract_references_from_file("some/fulltext/1503.07589v1.pdf")
print(reference)
[
{'author': [u'F. Englert and R. Brout'],
'doi': [u'10.1103/PhysRevLett.13.321'],
'journal_page': [u'321'],
'journal_reference': ['Phys.Rev.Lett.,13,1964'],
'journal_title': [u'Phys.Rev.Lett.'],
'journal_volume': [u'13'],
'journal_year': [u'1964'],
'linemarker': [u'1'],
'title': [u'Broken symmetry and the mass of gauge vector mesons'],
'year': [u'1964']}, ...
]
You can also extract directly from a URL:
from refextract import extract_references_from_url
reference = extract_references_from_url("http://arxiv.org/pdf/1503.07589v1.pdf")
print(reference)
[
{'author': [u'F. Englert and R. Brout'],
'doi': [u'10.1103/PhysRevLett.13.321'],
'journal_page': [u'321'],
'journal_reference': ['Phys.Rev.Lett.,13,1964'],
'journal_title': [u'Phys.Rev.Lett.'],
'journal_volume': [u'13'],
'journal_year': [u'1964'],
'linemarker': [u'1'],
'title': [u'Broken symmetry and the mass of gauge vector mesons'],
'year': [u'1964']}, ...
]
Changes
Version 0.2.3 (2017-12-19)
Handle all possible errors thrown by pyPDF2
Fix normalization of CLIC report numbers.
Version 0.2.2 (2017-07-17)
Handle pyPDF2 internal errors.
Version 0.2.1 (2017-07-02)
Named destinations may not always have left and top coordinates. This case is now handled gracefully: no TeXkeys are returned by extract_texkeys_from_pdf instead of raising an uncaught exception.
Makes CFG_PATH_GFILE and CFG_PATH_PDFTOTEXT configurable through shell variables, with fallback on the output of which, in order to allow for easier containerization.
Version 0.2.0 (2017-06-26)
Substantial rewrite of the API. In particular:
extract_references_from_file, extract_references_from_string, and extract_references_from_url now return a list of the references, instead of an object with keys stats and references.
If the number of TeXkeys that were extracted from the PDF metadata matches the number of references parsed by RefExtract, an extra texkey field is added to each returned reference.
The API now raises exceptions when it encounters an unrecoverable error.
Finally, the API now returns the list of raw references on which refextract worked.
Version 0.1.0 (2016-01-12)
Initial export from Invenio Software <https://github.com/inveniosoftware/invenio>
Restructured into stripped down, standalone version
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
File details
Details for the file refextract-0.2.3.tar.gz
.
File metadata
- Download URL: refextract-0.2.3.tar.gz
- Upload date:
- Size: 4.2 MB
- Tags: Source
- Uploaded using Trusted Publishing? No
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | e127ff730099681cf9a310098b16961301fe9da4b2893b14da236cf33a734207 |
|
MD5 | 5ba96bcbb993525e76f9b02934f5ad87 |
|
BLAKE2b-256 | 9391fda4ddc5d5a8bef4605ca767622890f42094bf924aa17e42ba96665b0d0f |