Wrapper for Products.ZSPARQLMethod
Project description
EEA Sparql is a plone product for fetching data from Linked open data servers (sparql endpoints).
Introduction
It is simple to use, you only have to specify the sparql endpoint url and the sparql query. The results will be converted in an exhibit json, what can easily be reused (ex. by eea.daviz).
Main features
The main features are:
create sparql queries
create sparql bookmark folders, sparql queries are created automatically, and can be synchronized manually or automatically (with a cronjob). If a query is changed, a new version of the object is created, so older ones are not lost.
results are downloadable in various formats: JSON, Exhibit JSON, HTML, XML, XML with Schema, CSV, TSV
Installation
To install eea.sparql into the global Python environment (or a workingenv), using a traditional Zope 2 instance, you can do this:
When you’re reading this you have probably already run easy_install eea.sparql. Find out how to install setuptools (and EasyInstall) here: http://peak.telecommunity.com/DevCenter/EasyInstall
If you are using Zope 2.9 (not 2.10), get pythonproducts and install it via:
python setup.py install --home /path/to/instance
into your Zope instance.
Create a file called eea.sparql-configure.zcml in the /path/to/instance/etc/package-includes directory. The file should only contain this:
<include package="eea.sparql" />
Alternatively, if you are using zc.buildout and the plone.recipe.zope2instance recipe to manage your project, you can do this:
Add eea.sparql to the list of eggs to install, e.g.:
[buildout] eggs = eea.sparql
Tell the plone.recipe.zope2instance recipe to install a ZCML slug:
[instance] recipe = plone.recipe.zope2instance zcml = eea.sparql
You can skip the ZCML slug if you are going to explicitly include the package from another package’s configure.zcml file.
You will also need a worker instance to be set up. This is required for the async update of the last working results.
For both, normal and worker instances, the plone.app.async should be added in the EGG slug:
eggs = ... plone.app.async
For the normal instances, the plone.app.async-single_db_instance should be added in the ZCML slug:
zcml = ... plone.app.async-single_db_instance
For the worker instances, the plone.app.async-single_db_worker should be added in the ZCML slug:
zcml = ... plone.app.async-single_db_worker
Re-run buildout, e.g. with:
$ ./bin/buildout
Dependecies
Products.ZSPARQLMethod
eea.versions
plone.app.async
eea.cache 7.0+ (optional)
Source code
Latest source code (Plone 4 compatible): - Plone Collective on Github - EEA on Github
Copyright and license
The Initial Owner of the Original Code is European Environment Agency (EEA). All Rights Reserved.
The EEA Sparql (the Original Code) is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
More details under docs/License.txt
Links
Funding
EEA - European Environment Agency (EU)
Changelog
4.9 - (2015-12-08)
Bug fix: fixed pylint warnings. Fixed HISTORY.txt markup [ghicaale refs #30813]
4.8 - (2015-12-07)
Feature: Add a Control Panel entry to show the async queue status of sparql queries [danielm-gh refs #30665]
4.7 - (2015-11-16)
Bug fix: Fixed upgrade step 4400 for eea.sparql to start all async jobs for sparal methods [szabozo0 refs #30673]
4.6 - (2015-11-03)
Bug fix: added profile dependency to Products.DataGridField [szabozo0]
Bug fix: use ‘code/pre’ tags instead of ‘blockquote’ for sparql queries and errors [danielm-gh refs #29992]
4.5 - (2015-08-18)
Change: Auto-include zcml within plone context in order to make this package work without having to add it within buildout zcml directive. [avoinea]
4.4 - (2015-07-06)
Bug fix: Added upgrade step to restart the sparql sync jobs [szabozo0 refs #25448]
4.3 - (2015-05-15)
Bug fix: Fixed a conflict between provenance info for sparql and arguments for sparql queries [szabozo0 refs #25341]
4.2 - (2015-05-05)
Bug fix: updateLastWorkingResults now checks for Querytimeout exception in order to avoid crash of async_updateLastWorkingResults [ichimdav refs #25018]
Bug fix: quote the query when user tries to download the dataset [szabozo0]
Change: endpoint_url now uses the isURL validator in order to ensure that the endpoint url is a proper link [ichimdav refs #24130]
Change: download links for datasets no longer carry a question mark if there are no arguments massed [ichimdav refs #18753]
4.1 - (2015-04-02)
Change: Updated Multiple data source schema extender adapter to correlate with the changes in eea.daviz [olimpiurob refs #24121]
4.0 - (2015-03-17)
Change: Switched to curl in the jenkins build install script [olimpiurob refs #22402]
Change: Changed fetch url for jenkins build install script to the install script from the main EEA CPB repository [olimpiurob refs #22402]
3.9 - (2015-02-03)
Feature: refined history messages for results [szabozo0 refs #22240]
3.8 - (2014-11-20)
Bug fix: fixed “add new argument” CSS [ghicaale refs #20945]
3.7 - (2014-10-15)
Feature: added a howto for building Sparqls with arguments [pasoviul refs #19537]
Feature: changed dropdown values to labels insted of URIs [pasoviul refs #19537]
Bug fix: fixed error on ‘Test and preview query’ [pasoviul refs #19537]
Bug fix: fixed argument handling between sparq and ZSPARQL [pasoviul refs #19537]
Change: updated sparqls to provide queries for arguments, besides names and types [pasoviul refs #19537]
Bug fix: fixed documentation generated by Jenkins [ghicaale refs #19537]
3.6 - (2014-10-01)
Feature: removed “Caching” action. We are now using the more complex “Cache” action registered by eea.cache [ghicaale refs #21143]
Feature: added upgrade step to remove absolete “Caching” action [ghicaale refs #21143]
3.5 - (2014-09-15)
Bug fix: Fixed html, csv, tsv and exhibit json exports [pasoviul refs #19537]
3.4 - (2014-08-27)
Change: Cleanup memcache invalidation code as it’s already handled by eea.cache (7.0+) [voineali refs #20678]
3.3 - (2014-01-21)
Bug fix: removed wrongly added blockquotes within README.rst [ichim-david refs #18064]
Feature: adding Sphinx-generated documentation in Page Template format [batradav refs #9502]
3.2 - (2013-12-10)
Bug fix: fixed ReST markup of HISTORY.txt [ghicaale refs #17716]
3.1 - (2013-12-10)
Change: removed versions macro; now using viewlet [simiamih refs #17321]
3.0 - (2013-11-20)
Bug fix: Fixed syncing of sparql bookmark folders [szabozo0 refs #17260]
2.9 - (2013-08-08)
Change: Update the latest working results with plone.app.async [szabozo0 #14826]
2.8 - (2013-07-08)
Change: On preview use a LIMIT 10 to have faster response. When a new resultset is too large don’t store it’s text version for comparasion is it takes a lot of time, and blocks the instance [szabozo0 #14826]
2.7 - (2013-06-17)
Feature: Changed data provenance to allow multiple data provenances [szabozo0 #9561]
2.6 - (2013-05-24)
Bug fix: Updated for eea.versions v6.0 [szabozo0 refs #14627]
2.5 - (2013-05-20)
Feature: Removed lovely.memcached dependency [voineali refs #14343]
Bug fix: Fixed preview for sparql queries when arguments are missing [szabozo0 #14349]
Bug fix: conform to latest eea.versions api changes [tiberich #14008]
2.4 - (2013-02-05)
Feature: added information for contributors [ciobabog refs #13892]
Upgrade step: Within “Plone > Site setup > Add-ons” click on upgrade button available for eea.sparql.
Bug fix: Fixed tests for eea.sparql [szabozo0 refs #9424]
Feature: Handling specific annotations for data values [voineali refs #9558]
Bug fix: Fixed preview for queries returning empty fields [szabozo0 refs #9608]
Feature: Added quick preview for sparql queries [szabozo0 refs #9608]
Feature: Data persistence and versioning - Added versioning for sparql results - Possibility to select static & live queries [szabozo0 refs #9424]
2.3 - (2013-01-18)
Bug fix: Fixed compatibility with jquery 1.7.2 [szabozo0]
2.2 - (2013-01-10)
Change: moved the olderVersions to the portalMessage div that displays the old versions link for eea.sparql templates [ichimdav #10182]
2.1 - (2012-11-09)
Feature: Added i18n translations [avoinea]
2.0 - (2012-10-08)
Feature: Added Visualization data source provenance adapter for Sparql objects [voineali refs #5490]
Bug fix: Updated converter for results containing exceptions [szabozo0 refs #5515]
Change: Merged daviz-view.json and daviz-relateditems.json into one single json file called daviz.json [voineali refs #5449]
Bug fix: Allow forcing Sparql column-types within daviz-view.json [voineali refs #5511]
Bug fix: Fixed SPARQL bookmarks folder default view [szabozo0 #5512]
Bug fix: don’t break bookmarks view page when endpoint doesn’t work [tiberich #5534]
1.8 - (2012-08-27)
Feature: Show action “create visuallization” for anonymous. This makes it clear what functions are available and “call new users to action”. [demarant]
Bug fix: existing visualisation of sparql are now shown even though the image tile is not available (valentine.imagescales). Use grid style for table. [demarant fixes #5458]
Bug fix: fixed issue with column names json coversion when ending with ‘label’. Now it uses simile exhibit explicit type formatting. [demarant]
1.7 - (2012-08-10)
Bug fix: Fixed columns order [szabozo0 refs #5137]
Feature: Added shortcuts on sparql bookmarks for creating visualizations. [szabozo0 refs #5347]
1.6 - (2012-07-23)
Bug fix: Fixed sparql bookmarks view [szabozo0 #5388]
1.5 - (2012-07-13)
Bug fix: Fixed sparql table preview CSS when used as jQuery overlay [voineali]
Bug Fix: Improved layout of sparql bookmarks folder. Focus on datasets. Do not show administrative actions for anonymous. Removed unnecessary code. Improved i18n and labels. [demarant refs #5151]
Change: layout changes to the view page to focus on the dataset download, clarify formats and the linked data information. better labels and descriptions. [demarant fixes #5317]
Bug Fix: Fixed i18n missing tags and duplicate keys in .pt files [prospchr refs #5162]
1.4 - (2012-06-13)
Bug fix: fixed markup of HISTORY.txt file [ciobabog refs #5231]
Feature: Add visualizations column on sparql folder listing view [voineali refs #5005]
Bug fix: Include dependencies within zcml and profile metadata [voineali]
1.3 - (2012-04-26)
Bug fix: Split @@sparql-download into multiple views (download.tsv, download.csv, etc) in order to easily cache and purge them with plone.app.caching [voineali #5074]
Bug fix: Set default format to html on download view [szabozo0 #5089]
1.2 - (2012-04-11)
Bug fix: Invalidate memcache and varnish for Sparql instances and related items [voineali #5074]
Feature: Made timeout mandatory, and set default value to 10 seconds [szabozo0 #5079]
Bug fix: Fixed synchronization problems for sparql bookmark folders [szabozo0 #5078]
Bug fix: Remove comments from queries so sparql-query should not fail [szabozo0 #5073]
Bug fix: Explicitly close connections with remote servers and serve files in small chuncks on sparql to JSON/XML export. [voineali #5073]
Upgrade step: Manually remove apache quickfixes from frontend servers
1.1 - (2012-03-30)
Change: Added default workflow mapping. [demarant #5002]
Upgrade step: Within ZMI > Site setup > Import types. For workflow change if have old content to migrate: Plone > Types > change workflow: - Sparql -> one_state_workflow; - SparqlBookmarksFolder -> folder_workflow define the state mapping as you prefer.
Upgrade step: Within “Plone > Site setup > Add-ons” click on upgrade button available for eea.sparql [voineali #4968]
Feature: Added a table preview for sparql objects when used togheter with eea.relations and eea.facetednavigation [voineali #4968]
Change: moved sparql.css in portal_css [szabozo0 #4968]
Feature: added page for syncing all sparql bookmark folders [szabozo0 #5004]
Change: added default icons for sparql and sparql bookmarks folder [demarant]
Change: Improved table preview dissolve design and template headings [demarant]
Bug fix: Fixed default view for sparql, so workflow dropdown is now displayed [szabozo0 #5002]
Bug fix: Fixed format of column properties in exhibit json [szabozo0 #4992]
1.0 - (2012-03-05)
Initial release [Zoltan Szabo]
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
