Skip to content

Retention time is getting removed when stream info is loaded from the storage. #654

@gurjotkaur20

Description

@gurjotkaur20

Retention time is getting removed from .stream.json. Before server start, data/backend/.stream.json had retention set.

{ "version": "v3", "objectstore-format": "v3", "created-at": "2024-01-21T12:34:03.035370651+05:30", "first-event-at": "2024-01-21T12:34:03.036609461+05:30", "owner": { "id": "admin", "group": "admin" }, "permissions": [ { "id": "admin", "group": "admin", "access": [ "all" ] } ], "stats": { "events": 3, "ingestion": 451, "storage": 7566 }, "snapshot": { "version": "v1", "manifest_list": [ { "manifest_path": "home/gurjot/open/parseable/data/backend/date=2024-01-21/manifest.json", "time_lower_bound": "2024-01-21T00:00:00Z", "time_upper_bound": "2024-01-21T23:59:59.999999999Z" }, { "manifest_path": "home/gurjot/open/parseable/data/backend/date=2024-01-23/manifest.json", "time_lower_bound": "2024-01-23T00:00:00Z", "time_upper_bound": "2024-01-23T23:59:59.999999999Z" } ] }, "cache_enabled": false, "retention": [ { "description": "deletes after 4 days", "action": "delete", "duration": "4d" } ] }

When the server starts and first event is ingested for a new day in the same stream then the retention gets removed by the update_snapshot method.

{"version":"v3","objectstore-format":"v3","created-at":"2024-01-21T12:34:03.035370651+05:30","owner":{"id":"admin","group":"admin"},"permissions":[{"id":"admin","group":"admin","access":["all"]}],"stats":{"events":4,"ingestion":602,"storage":10188},"snapshot":{"version":"v1","manifest_list":[{"manifest_path":"home/gurjot/open/parseable/data/backend/date=2024-01-21/manifest.json","time_lower_bound":"2024-01-21T00:00:00Z","time_upper_bound":"2024-01-21T23:59:59.999999999Z"},{"manifest_path":"home/gurjot/open/parseable/data/backend/date=2024-01-23/manifest.json","time_lower_bound":"2024-01-23T00:00:00Z","time_upper_bound":"2024-01-23T23:59:59.999999999Z"},{"manifest_path":"home/gurjot/parseable/data/backend/date=2024-02-07/manifest.json","time_lower_bound":"2024-02-07T00:00:00Z","time_upper_bound":"2024-02-07T23:59:59.999999999Z"}]},"cache_enabled":false}

I have checked it with local-store.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions