Skip to main content

UNKNOWN

Project description

vumi-go-data-tools
=======

Praekelt Foundation does a lot of work using the Vumi Go messaging platform.
Vumi Go makes all data captured available as CSV files but as of yet does not
provide tools for doing pivot table based analysis on that data. The idea is
to develop set of reusable tools that allows a developer to quickly do pivot
tables on large CSV files that Vumi Go produces on behalf of the project owner
for post campaign analysis. These tools should give insight into session counts,
returning visitors and effectiveness of different approaches taken with differing
Vumi Go contact groups that interact with a service.

Set up
~~~~~~~~~~

::

$ virtualenv ve
$ . ve/bin/activate
$ pip install -e .

Usage
~~~~~~~~~~

::

$ gdt --help

usage: gdt [-h] [-c CODEC_CLASS]

{msisdn,daterange,weekrange,direction,session,contacts,regex,extract,aggregate,count}
...

Vumi Go Data Tools for CSV and JSON formatted data from STDIN. Use `--codec`
to specify. Designed to pipe output from one subcommand to another. Use `gdt
subcommand --help` for more info.

positional arguments:
{msisdn,daterange,weekrange,direction,session,contacts,regex,extract,aggregate,count}
use `command --help`.
msisdn Filter on an msisdn
daterange Filter on a date range.
weekrange Filter on a week range.
direction Filter on message direction.
session Filter on session events.
contacts Filter for certain contact addresses
regex Filter for regex matches
extract Extract named fields from file.
aggregate Aggregate fields
count Count fields

optional arguments:
-h, --help show this help message and exit
-c CODEC_CLASS, --codec CODEC_CLASS
Which codec to use.


Examples
~~~~~~~~~~

::

$ cat gdt/tests/messages-export-good.csv | gdt msisdn -m +27817030792 -t to_addr | gdt direction -d outbound | gdt daterange -s "2013-09-09 19:24" -e "2013-09-09 19:38"

$ cat gdt/tests/messages-export-week-spread.csv | gdt weekrange -y 2013 -w 1 2 3 4

$ cat gdt/tests/messages-export-good.csv | gdt session -t new

$ cat gdt/tests/messages-export-good.csv | gdt contacts -a +123456 +123457

$ cat gdt/tests/messages-export-good.csv | gdt contacts -a @contact_file.txt

$ cat gdt/tests/messages-export-good.csv | gdt regex -f content -p "^we think" -i

$ cat gdt/tests/messages-export-good.csv | gdt extract -f to_addr session_event -df "%M"

$ cat gdt/tests/messages-export-good.csv | gdt extract -f to_addr session_event -df "%M" | gdt aggregate -f to_addr

$ cat gdt/tests/messages-export-good.csv | gdt extract -f to_addr session_event -df "%M" | gdt count -f to_addr

$ cat gdt/tests/messages-export-week-spread.csv | gdt weekrange -y 2013 -w 1 2 3 4

Project details


Release history Release notifications | RSS feed

This version

0.1

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gdt-0.1.tar.gz (8.1 kB view details)

Uploaded Source

File details

Details for the file gdt-0.1.tar.gz.

File metadata

  • Download URL: gdt-0.1.tar.gz
  • Upload date:
  • Size: 8.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for gdt-0.1.tar.gz
Algorithm Hash digest
SHA256 5741040eadfe03902cc130121aeb35201a4ac213ae7f3f530a3c912197eff47b
MD5 3cb53499bfd6f1adb035d03ef5c4d8f4
BLAKE2b-256 6dce0dff2261bfde7f53c20ddf834a38079b572664afd98e05534a49fb57cea4

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page