s3stat 1.1.0

Install goaccess

You should install goaccess

Generating an AWS user

First you should create a user that has approriate rights to read your log files, and you should have its AWS access keys ready.

1. Log in to the aws console

2. Create a new user and select the option to generate an access key for the user

3. Save the access key and secure keys, as these will be needed soon

4. Open the Permissions tab for the user, and attach a new user policy. Select custom policy, and copy the following:

   {
     "Statement": [
       {
         "Sid": "Stmt1334764540928",
         "Action": [
           "s3:GetBucketAcl",
           "s3:GetBucketLogging",
           "s3:GetObject",
           "s3:ListAllMyBuckets",
           "s3:ListBucket",
           "s3:PutBucketAcl",
           "s3:PutBucketLogging",
           "s3:PutObject",
           "s3:PutObjectAcl"
         ],
         "Effect": "Allow",
         "Resource": [
           "arn:aws:s3:::*"
         ]
       },
       {
         "Sid": "Stmt1334764631669",
         "Action": [
           "cloudfront:GetDistribution",
           "cloudfront:GetDistributionConfig",
           "cloudfront:GetStreamingDistribution",
           "cloudfront:GetStreamingDistributionConfig",
           "cloudfront:ListDistributions",
           "cloudfront:ListStreamingDistributions",
           "cloudfront:UpdateDistribution",
           "cloudfront:UpdateStreamingDistribution"
         ],
         "Effect": "Allow",
         "Resource": [
           "*"
         ]
       }
     ]
   }

Set up logging in your buckets

First you should ask Amazon to generate logs for your buckets and cloudfront distributions.

Run this script

s3stat.py <aws key> <aws secret> <bucket> <log_path>

This will download all the log files for today, and start a goaccess instance in your console.

For further options you might run:

s3stat.py -h