Skip to main content

A package that suggests similar titles to one being added

Project description

Introduction

EEA Similarity is a Plone add-on which provides content suggestions based on similarity scores to a search string. It uses NLP algorithms like TF-IDF (frequency–inverse document frequency) and LSI (Latent Semantic Indexing).

Initial use case is to provide a list of possible duplicates when adding content (based on the entered title).

Installation

zc.buildout

If you are using zc.buildout and the plone.recipe.zope2instance recipe to manage your project, you can do this:

  • Update your buildout.cfg file:

    [instance]
    ...
    eggs =
      ...
      eea.similarity
    
    zcml =
      ...
      eea.similarity
  • Re-run buildout, e.g. with:

    $ ./bin/buildout

You can skip the ZCML slug if you are going to explicitly include the package from another package’s configure.zcml file.

Dependencies

EEA Similarity has the following dependencies:
  • stemming

  • gensim (which in turn depends on numpy and scipy)

On CentOS you need to install:
  • blas-devel

  • lapack-devel

  • gcc-fortran

On Debian/Ubuntu you need to install:
  • libblas-dev

  • liblapack

  • gfortran

Possible issues with scipy and numpy:

Due to a bug in scipy, it is possible that the packages will not install when running buildout. There are two solutions/options:

  1. Install them with easy_install pip before running the buildout.

  2. Update zc.buildout to version 2.9.0 and activate the wheel support via buildout.wheel and the dependencies will be installed normally.

Source code

Funding

EEA - European Environment Agency (EU)

Changelog

1.3 - (2017-04-19)

  • Bug fix: fixed issue with the equivalent sets [valipod refs #84294]

  • Feature: added metadata info to the suggestion dialog [valipod refs #84294]

1.2 - (2017-04-14)

  • Bug fix: Remove hard dependency on plone.app.async and eea.versions [avoinea refs #83163]

  • Bug fix: removed hard coded path in the dialog’s javascript [valipod refs #83163]

  • Bug fix: added some defaults to the control panel settings [valipod refs #83163]

  • Bug fix: removed mandatory status for some control panel settings [valipod refs #83163]

1.1 - (2017-04-13)

  • Bug fix: fixed README markup [alecghica refs #82296]

  • Upgrade step: trigger index generation once (/www/create_idf_index) Feature: added index update frequency to the registry settings [valipod refs #83163]

1.0 - (2017-04-12)

  • Feature: related to index and score:
    • moved the index creation to the async instance

    • add similarity score next to object link in dialog

    • [valipod refs #83163]

  • Feature: added to registry settings:
    • equivalent content types sets, use of stopwords, number of shown suggestions

    • max. score difference between suggestions, dialog title and text

    • [valipod refs #83163]

  • Pre-upgrade step: run etc/scripts/prereq.sh on each backend [alecghica refs #82296]

  • Pre-upgrade step: run deploy.sh [alecghica refs #82296]

  • Upgrade step: from control panel instal eea.similarity [valipod refs #82296] [alecghica refs #82296]

  • Feature: Initial release [valipod refs #82296]

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

eea.similarity-1.3.zip (55.5 kB view details)

Uploaded Source

File details

Details for the file eea.similarity-1.3.zip.

File metadata

  • Download URL: eea.similarity-1.3.zip
  • Upload date:
  • Size: 55.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for eea.similarity-1.3.zip
Algorithm Hash digest
SHA256 0a07c893ce68e3649462c5992178f61e6d7d880a301c00a24cef14d65db67a9f
MD5 afe0858a2f0f0720399d02d5009802b1
BLAKE2b-256 81320f31c1f917f43d8273ea0a868efaa1aafbb35ff4b9fd61085c46b0282827

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page