DID Finder Cache should expire after a week

[gordonwatts]

The current DID Finder cache remains forever.

• The locations of files on the GRID periodically move
• Datasets replica numbers change over time as their popularity fluctuates

This causes open file errors (or missed files because new replicas aren't picked up). To counter this, have the DID finder's cache reset periodically.

Start with a week.

[ponyisi]

Suggest this is done by adding a Kubernetes cronjob whose schedule is configurable via values.yaml. Ilija suggested this run every day by default; I'm not sure what's optimal but I guess we can offload that to the sites.

[gordonwatts]

I like the idea of running that once a day. Do we have any way to retire something in the list? It would be bad if it just got longer and longer over time until we were querying every dataset for years. ;-)

[ponyisi]

We have an option to only list datasets that aren't stale, so that should be fine.