Make fewer requests in heartbeat, handle exceptions

[grahamalama]

This PR adjusts the heartbeat so that we make fewer requests in it.

Before, this PR we'd make (n * 3) + 1 API calls, where n equals the number of configured projects:

• "all_projects_are_visible": - 1 API call
• "all_projects_have_permissions": n API calls (in a threadpool)
• "all_projects_components_exist": n API calls (not in a threadpool)
• "all_projects_issue_types_exist": n API calls (not in a threadpool)

With 22 configured prod projects, that's 67 API calls (😱).

Now, we make n + 3 API calls:

• "all_projects_are_visible": - 1 API call
• "all_projects_have_permissions": 1 API call
• "all_project_custom_components_exist" (renamed): up to n API calls (in a threadpool)
  • only makes calls for actions that specify custom components
• "all_projects_issue_types_exist": 1 API call

For a grand total of 25 6 API calls in prod.

(edit: we only make component requests for projects that specify custom components, and only 3 projects do that)

This was done by using different API endpoints (or params on those endpoints) to fetch more results at once. It's annoying that Jira doesn't provide an API endpoint to fetch components by project, but we were luckily able to make an improvement

This PR also adds a little more exception handling to functions we call in the heartbeat

[alexcottner]

Two small questions, but definitely good to approve.

[sentry]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ HTTPError: 400 Client Error: Bad Request for url: https://bugzilla-dev.allizom.org/rest/whoami /__heartbeat__ View Issue
• ‼️ HTTPError: 429 Client Error: Too Many Requests for url: https://mozilla-hub.atlassian.net/rest/api/2/project... /__heartbeat__ View Issue
• ‼️ HTTPError: 429 Client Error: Too Many Requests for url: https://mozilla-hub.atlassian.net/rest/api/2/project... /__heartbeat__ View Issue
• ‼️ HTTPError: 429 Client Error: Too Many Requests for url: https://mozilla-hub.atlassian.net/rest/api/2/project... jbi.services.jira in raise_for_status View Issue
• ‼️ HTTPError: 429 Client Error: Too Many Requests for url: https://mozilla-hub.atlassian.net/rest/api/2/permiss... /__heartbeat__ View Issue

_{Did you find this useful? React with a 👍 or 👎}

[leplatrem]

Thanks 🙏

Although, honestly, for a product that is used by so many companies in the world, 67 requests on an API should not even be considered an issue

[grahamalama]

Tagged this issue as a "breaking change" since we renamed a field of the heartbeat payload