[Feature Request] Plugins to support controlling multiple configuration points at once

[tconley1428]

Is your feature request related to a problem? Please describe.

See parent temporalio/features#652

Describe the solution you'd like

Should support OpenAI integration as an example.

Additional context