Index DBnomics data with Apache Solr for full-text and faceted search

These details have not been verified by PyPI

Project links

Project description

DBnomics Solr

Index DBnomics data into Apache Solr for full-text and faceted search.

Requirements:

a running instance of Apache Solr; at the time this documentation is written, we use the version 7.3.

See dbnomics-docker to run a local DBnomics instance with Docker that includes a service for Apache Solr.

Configuration

Environment variables:

DEBUG_PYSOLR: display pysolr DEBUG logging messages (cf https://github.com/django-haystack/pysolr)

Index a provider

Replace wto by the real provider slug in the following command:

dbnomics-solr index-provider /path/to/wto-json-data

Full mode vs incremental mode

When data is stored in a regular directory, the script always indexes all datasets and series of a provider. This is called full mode.

When data is stored in a Git repository, the script runs by default in incremental mode: it indexes only the datasets modified since the last indexation.

It is possible to force the full mode with the --full option.

Bare repositories

The script has an option --bare-repo-fallback which tries to add .git at the end of the storage dir name, if not found.

Remove all data from a provider

To remove all the documents related to a provider (type:provider, type:dataset and type:series):

dbnomics-solr --debug delete-provider --code <provider_code>
dbnomics-solr --debug delete-provider --slug <provider_slug>

# Examples:
dbnomics-solr --debug delete-provider --code WTO
dbnomics-solr --debug delete-provider --slug wto

Project details

These details have not been verified by PyPI

Project links

Release history Release notifications | RSS feed

1.1.19

Oct 30, 2024

1.1.18

Jun 30, 2023

1.1.17 yanked

Jun 28, 2023

Reason this release was yanked:

import error

1.1.16

Feb 17, 2023

1.1.15

Jan 6, 2023

1.1.14

Dec 15, 2022

This version

1.1.13

Nov 25, 2022

1.1.12

Nov 17, 2022

1.1.11

Nov 16, 2022

1.1.10

Jul 8, 2022

1.1.9

Jun 28, 2022

1.1.8 yanked

Jun 28, 2022

Reason this release was yanked:

missing Solr commit

1.1.7

Jun 27, 2022

1.1.6

Apr 8, 2022

1.1.5

Apr 7, 2022

1.1.4

Apr 4, 2022

1.1.3

Apr 4, 2022

1.1.2

Mar 28, 2022

1.1.1

Mar 28, 2022

1.1.0

Mar 25, 2022

1.0.5

Apr 28, 2021

1.0.4

Oct 6, 2020

1.0.3

Jul 21, 2020

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dbnomics_solr-1.1.13.tar.gz (25.7 kB view details)

Uploaded Nov 25, 2022 Source

Built Distribution

dbnomics_solr-1.1.13-py3-none-any.whl (30.0 kB view details)

Uploaded Nov 25, 2022 Python 3

File details

Details for the file dbnomics_solr-1.1.13.tar.gz.

File metadata

Download URL: dbnomics_solr-1.1.13.tar.gz
Upload date: Nov 25, 2022
Size: 25.7 kB
Tags: Source
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_solr-1.1.13.tar.gz
Algorithm	Hash digest
SHA256	`6097c6c263d160a68550f9fac78aed16380b3e30f9d9da18a6e9db71290bfb4e`
MD5	`938533ce2f46b6a2b8112917be9086df`
BLAKE2b-256	`399ac02fc5760d8f7dacacc6008058e85f7862b87bebc8241df6677f62657bcf`

See more details on using hashes here.

File details

Details for the file dbnomics_solr-1.1.13-py3-none-any.whl.

File metadata

Download URL: dbnomics_solr-1.1.13-py3-none-any.whl
Upload date: Nov 25, 2022
Size: 30.0 kB
Tags: Python 3
Uploaded using Trusted Publishing? No
Uploaded via: poetry/1.2.2 CPython/3.10.8 Linux/5.10.0-14-amd64

File hashes

Hashes for dbnomics_solr-1.1.13-py3-none-any.whl
Algorithm	Hash digest
SHA256	`0edcaeae7f1be6d28df8c16b20b0dc66c8a82e403bd29b30ab4cc2c7049cbc6b`
MD5	`4304a1569fe868b08d66161f01a4f4a3`
BLAKE2b-256	`4d2200e32316035c2c75b8fdd035e363a74460d3551e57943b6b063fb2632a5c`