Skip to main content

"Record indexer for Invenio."

Project description

https://img.shields.io/github/license/inveniosoftware/invenio-indexer.svg https://github.com/inveniosoftware/invenio-indexer/workflows/CI/badge.svg https://img.shields.io/coveralls/inveniosoftware/invenio-indexer.svg https://img.shields.io/pypi/v/invenio-indexer.svg

Record indexer for Invenio.

Further documentation is available on https://invenio-indexer.readthedocs.io/

Changes

Version 2.4.0 (released 2024-10-28) - config: remove INDEXER_DEFAULT_INDEX default value - cli: run command accepts a new parameter ‘chunk_size’ - ci: remove docker-compose line

Version 2.3.0 (released 2024-03-04)

  • indexer: Allow the definition of indices in index_templates, instead of mappings

Version 2.2.1 (released 2023-09-28)

  • bulk: make configurable the number of records to be bulk indexed per task

Version 2.2.0 (released 2023-05-25)

  • cli: add queue selection options

  • tests: remove redis as message backend

Version 2.1.2 (released 2023-05-05)

  • Allow passing message queue producer publish arguments via the RecordIndexer constructor and the INDEXER_MQ_PUBLISH_KWARGS config.

Version 2.1.1 (released 2022-10-07)

  • Change schema_to_index to return only the index and not a tuple with index and doc type.

Version 2.1.0 (released 2022-10-03)

  • Add support to OpenSearch v2

  • Remove doc_type param

  • Change record_to_index to return only the index and not a tuple with index and doc type.

  • Remove the config var INDEXER_DEFAULT_DOC_TYPE

Version 2.0.1 (released 2022-09-26)

  • Bump upper pin of invenio-records

Version 2.0.0 (released 2022-09-23)

  • Integrate invenio-search v2, add support to OpenSearch

  • Require Elasticsearch >= 7.5

  • Remove old versions of Elasticsearch mappings

  • Breaking: rename kwarg param es_bulk_kwargs to search_bulk_kwargs

Version 1.2.7 (released 2022-05-17)

  • Add exists method to RecordIndexer API class.

Version 1.2.6 (released 2022-05-13)

  • Add refresh method to RecordIndexer API class.

Version 1.2.5 (released 2022-05-05)

  • Add a config to defined the max number of concurrent consumers when bulk indexing.

  • Allows to retrieve all registered indexers.

Version 1.2.4 (released 2022-04-26)

  • Aligns with best practice from Kombu that producers should also declare queues.

Version 1.2.3 (released 2022-04-06)

  • Add indexer registry and use it in celery tasks.

Version 1.2.2 (released 2022-03-30)

  • Add support for Click v8.1+ and Flask v2.1+.

Version 1.2.1 (released 2021-03-05)

  • Remove pytest runner from setup dependencies

Version 1.2.0 (released 2020-09-16)

  • Changes delete requests to optimistic concurrency control by providing the the version and version_type in delete requests. The previous behavior can restored by calling RecordIndexer().delete(record, version=None, version_type=None) instead.

  • Adds support for using new-style record dumping controlled via the Record.enable_jsonref flag.

Version 1.1.2 (released 2020-04-28)

  • Introduces RecordIndexer.record_cls for customizing the record class.

  • Removes Python 2 support.

Version 1.1.1 (released 2019-11-21)

  • Fix bulk action parameters compatibility for Elasticsearch v7.

Version 1.1.0 (released 2019-07-19)

  • Add support for Elasticsearch v7.

  • Integrate index prefixing.

  • Add before_record_index.dynamic_connect() signal utility for more flexible indexer receivers.

  • Add schema_to_index utility from invenio-search (will be removed in next minor version of invenio-search).

Version 1.0.2 (released 2019-05-27)

  • Allow Elasticsearch indexing arguments to be modified by subscribing to before_record_index signal.

Version 1.0.1 (released 2018-10-11)

  • Allow forwarding arguments from RecordIndexer.process_bulk_queue to elasticsearch.helpers.bulk calls via the es_bulk_kwargs parameter.

Version 1.0.0 (released 2018-03-23)

  • Initial public release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

invenio-indexer-2.4.0.tar.gz (37.2 kB view details)

Uploaded Source

Built Distribution

invenio_indexer-2.4.0-py2.py3-none-any.whl (20.5 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file invenio-indexer-2.4.0.tar.gz.

File metadata

  • Download URL: invenio-indexer-2.4.0.tar.gz
  • Upload date:
  • Size: 37.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/5.1.1 CPython/3.8.20

File hashes

Hashes for invenio-indexer-2.4.0.tar.gz
Algorithm Hash digest
SHA256 f11c752d7b3cffe4db6a659106e48316963b4771505e0a72375339eea1be7ba0
MD5 fdd6dc42dfd4525e43a32bb245363c36
BLAKE2b-256 0448bdd3c316ce041f7a42cbacfa55900586bced223ecb345d667709829c0e36

See more details on using hashes here.

Provenance

File details

Details for the file invenio_indexer-2.4.0-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for invenio_indexer-2.4.0-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 99d6a7edb63025cc439d87cf18789c89321e23ca8e34aae9775243e9a6402d79
MD5 5097835c13bc6cfb0547167ee02cf2f6
BLAKE2b-256 25d0edda3f40ddad6a6f44f9636fc42d6923fdd564c3aba59b0c52b2a50d02f8

See more details on using hashes here.

Provenance

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page