Presidio anonymizer

Description

The Presidio anonymizer is a Python based module for anonymizing detected PII text entities with desired values.

Deploy Presidio anonymizer to Azure

Use the following button to deploy presidio anonymizer to your Azure subscription.

Anonymizer

Presidio anonymizer comes by default with the following anonymizers:

• Replace - replaces the PII with desired value

  Parameters: new_value - replaces existing text with the given value.

  If new_value is not supplied or empty, default behavior will be: <entity_type> e.g: <PHONE_NUMBER>

• Redact - removes the PII completely from text Parameters: None

• Hash - hash the PII using either sha256, sha512 or md5. Parameters:

  • hash_type - sets the type of hashing. can be either sha256, sha512 or md5. The default hash type is sha256.

• Mask - replaces the PII with a given character.

  Parameters:

  • chars_to_mask - the amount of characters out of the PII that should be replaced.
  • masking_char - the character to be replaced with.
  • from_end - Whether to mask the PII from it's end.

Please notice: if default value is not stated in anonymizers object, the default anonymizer is "replace" for all entities. The replacing value will be the entity type e.g.: <PHONE_NUMBER>

As the input text could potentially have overlapping PII entities, there are different anonymization scenarios:

• No overlap (single PII) - single PII over text entity, uses a given or default anonymizer to anonymize and replace the PII text entity.
• Full overlap of PIIs - When one text have several PIIs, the PII with the higher score will be taken. Between PIIs with identical scores, the selection will be arbitrary.
• One PII is contained in another - anonymizer will use the PII with larger text.
• Partial intersection - both will be returned concatenated.

Example of how each scenario would work. Our text will be:

My name is Inigo Montoya. You Killed my Father. Prepare to die. BTW my number is: 03-232323.

• No overlaps - only Inigo was recognized as NAME: My name is Montoya. You Killed my Father. Prepare to die. BTW my number is: 03-232323.
• Full overlap - the number was recognized as PHONE_NUMBER with score of 0.7 and as SSN with score of 0.6, we will take the higher score: My name is Inigo Montoya. You Killed my Father. Prepare to die. BTW my number is: < PHONE_NUMBER>
• One PII is contained is another - Inigo was recognized as FIRST_NAME and Inigo Montoya was recognized as NAME, we will take the larger one: My name is . You Killed my Father. Prepare to die. BTW my number is: 03-232323.
• Partial intersection - the number 03-2323 is recognized as a PHONE_NUMBER but 232323 is recognized as SSN: My name is Inigo Montoya. You Killed my Father. Prepare to die. BTW my number is: < PHONE_NUMBER>.

Installation

As package:

To get started with Presidio-anonymizer, run the following:

pip install presidio-anonymizer

Getting started

from presidio_anonymizer import AnonymizerEngine
from presidio_anonymizer.entities import RecognizerResult, AnonymizerConfig

# Initialize the engine with logger.
engine = AnonymizerEngine()

# Class the anonymize function with the text, analyzer results and
# Anonymizers config to define the anonymization type.
result = engine.anonymize(
    text="My name is Bond, James Bond",
    analyzer_results=[RecognizerResult("PERSON", 11, 15, 0.8),
                      RecognizerResult("PERSON", 17, 27, 0.8)],
    anonymizers_config={"PERSON": AnonymizerConfig("replace", {"new_value": "BIP"})}
)

print(result)

As docker service:

In folder presidio/presidio-anonymizer run:

docker-compose up -d

HTTP API

POST /anonymize

Payload:

{
    "text": "hello world, my name is Jane Doe. My number is: 034453334",
    "anonymizers": {
        "PHONE_NUMBER": {
            "type": "mask",
            "masking_char": "*",
            "chars_to_mask": 4,
            "from_end": true
        }
    },
    "analyzer_results": [
        {
            "start": 24,
            "end": 32,
            "score": 0.8,
            "entity_type": "NAME"
        },
        {
            "start": 24,
            "end": 28,
            "score": 0.8,
            "entity_type": "FIRST_NAME"
        },
        {
            "start": 29,
            "end": 32,
            "score": 0.6,
            "entity_type": "LAST_NAME"
        },
        {
            "start": 48,
            "end": 57,
            "score": 0.95,
            "entity_type": "PHONE_NUMBER"
        }
    ]
}

Result:

200 OK
hello world, my name is <NAME>. My number is: 03445****

/anonymizers

Returns a list of supported anonymizers.

Method: GET

No paramaters are required.

Response sample:

["hash", "mask", "redact", "replace"]