Skip to content

As a user, I want to load web logs to the web analytics bucketΒ #232

@jordanpadams

Description

@jordanpadams

Checked for duplicates

Yes - I've already checked

πŸ§‘β€πŸ”¬ User Persona(s)

Node Operator

πŸ’ͺ Motivation

...so that I can push my logs directly to the cloud, vs. requiring an interim on-prem server

πŸ“– Additional Details

Compressed logs in one of the accepted formats (i.e., Apache Combined, IIS, FTP, and Tomcat log formats)

Acceptance Criteria

Given
When I perform
Then I expect

βš™οΈ Engineering Details

Beyond S3 data, we want to be able to support nodes uploading web logs directly to S3. This will probably require a new flag to DUM and some handling in Lambda where if they are trying to upload web logs, they are directed to some other bucket with some other prefix.

The base prefix will be the node name, e.g. sbn/. There will be an additional prefix directory, but I haven't had a chance to think about this. See pds-dev-web-analytics bucket to get an idea of the prefixes per node. Ideas welcome...

πŸŽ‰ I&T

No response

Metadata

Metadata

Assignees

Projects

Status

ToDo

Status

Todo

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions