Skip to content

List data changes from cmu-delphi/covidcast-indicators#47 in a changelog #117

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jun 2, 2020
Merged

List data changes from cmu-delphi/covidcast-indicators#47 in a changelog #117

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
376b478
List data changes from cmu-delphi/covidcast-indicators#47 in a changelog
krivard May 31, 2020
acd1d7a
Switch to GitHub-Markdown format for anchors, and link to source sect…
krivard Jun 2, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions docs/api/covidcast_changelog.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,27 @@
# Delphi's COVID-19 Surveillance Streams Changelog

When Delphi makes substantial changes to the computation of a signal, we will typically publish it under a new name rather than revising the existing signal. By contrast, the changes documented here are bug fixes and pipeline repairs.

## Sources and Signals
### `doctor-visits`
### `fb-survey`

#### 3 June 2020: v1.3
Copy link
Contributor

@capnrefsmmat capnrefsmmat Jun 1, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In theory, this heading already has an anchor with id 3-june-2020-v1.3 or something like that.

I think, though, that it would be easier for each source section in covidcast_signals.md to link to the corresponding section in covidcast_changelog.md, rather than the section for the most recent update. So you'd only have to link to covidcast_changelog.md#fb-survey, where the user would immediately see the latest changes. That would make updates easier.

Copy link
Contributor Author

@krivard krivard Jun 2, 2020

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Done.


Duplicate survey weights had corrupted historical figures for the following signals and dates. The correct data has been restored to the API.
* `raw_wcli`
* `county`: 20200406, 20200408, 20200410, 20200430
* `hrr`: 20200406, 20200408-20200410, 20200430
* `msa`: 20200408, 20200410, 20200430
* `state`: 20200408-20200410, 20200430
* `smoothed_wcli`
* `county`: 20200406, 20200408-20200414, 20200430-20200506
* `hrr`: 20200406-20200415, 20200430-20200506
* `msa`: 20200408-20200414, 20200430-20200506
* `state`: 20200408-20200416, 20200430-20200506

### `google-survey`
### `ght`
### `quidel`
### `jhu-csse`
### `indicator-combination`
21 changes: 21 additions & 0 deletions docs/api/covidcast_signals.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,9 @@ several days after they occur, these signals are typically available with
several days of lag. This means that estimates for a specific day are only
available several days later.

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

### `fb-survey`

Data source based on symptom surveys run by Carnegie Mellon. Facebook directs a
Expand Down Expand Up @@ -66,6 +69,9 @@ the way in which our smoothing works, which is based on pooling data across
successive days), these smoothed signals are generally available at many more
counties (and MSAs) than the raw signals.

* Number of data revisions since 19 May 2020: 1
* Date of last change: [3 June 2020](covidcast_changelog.md#fb-survey)

### `google-survey`

Data source based on Google-run symptom surveys, through publisher websites,
Expand Down Expand Up @@ -94,6 +100,9 @@ specific geographical areas as needed to support forecasting efforts.
| `raw_cli` | Estimated percentage of people who know someone in their community with COVID-like illness |
| `smoothed_cli` | Estimated percentage of people who know someone in their community with COVID-like illness, smoothed in time |

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

### `ght`

Data source based on Google searches, provided to us by Google Health
Expand All @@ -109,6 +118,9 @@ so county estimates are not available from the API.
| `raw_search` | Google search volume for COVID-related searches, in arbitrary units that are normalized for population |
| `smoothed_search` | Google search volume for COVID-related searches, in arbitrary units that are normalized for population, smoothed in time using a local linear smoother with Gaussian kernel |

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

### `quidel`

Data source based on flu lab tests, provided to us by Quidel, Inc. When a
Expand All @@ -134,6 +146,9 @@ small. The data may be updated again when the Winter 2020 flu season begins.
| `raw_tests_per_device` | The number of flu tests conducted by each testing device; measures volume of testing |
| `smoothed_tests_per_device` | Same as above, but smoothed in time |

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

### `jhu-csse`

Data source of confirmed COVID-19 cases and deaths, based on reports made
Expand All @@ -153,6 +168,9 @@ Our signals here are taken directly from the JHU CSSE
[COVID-19 GitHub repository](https://github.com/CSSEGISandData/COVID-19) without
filtering, smoothing, or changes.

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

### `indicator-combination`

This source provides signals which are statistical combinations of the other
Expand All @@ -175,6 +193,9 @@ sources above. It is not a primary data source.
`smoothed_adj_cli`. This signal is deprecated and is no longer updated as of
May 28, 2020.

* Number of data revisions since 19 May 2020: 0
* Date of last change: Never

## COVIDcast Map Signals

The following signals are currently displayed on [the public COVIDcast
Expand Down