Skip to content

Commit c5b836a

Browse files
awaelchliakihironittaBordapre-commit-ci[bot]dependabot[bot]
authored
Weekly Patch Release v1.9.2 (#16725)
* Add .git-blame-ignore-revs (#16709) Co-authored-by: Jirka Borovec <[email protected]> * Fix strategy type validation in connectors (#16693) * Disable strict loading in multiprocessing launcher (#16365) Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Jirka <[email protected]> * Fix min-epochs and early-stopping triggering too many validation runs (#16719) Co-authored-by: Jirka Borovec <[email protected]> * Update hydra-core requirement from <1.3.0,>=1.0.5 to >=1.0.5,<1.4.0 in /requirements (#16736) Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * [App] Add support for private data (#16738) Co-authored-by: thomas <[email protected]> * [App] Add rm one level below project level (#16740) Co-authored-by: Ethan Harris <[email protected]> Co-authored-by: Justus Schock <[email protected]> Co-authored-by: thomas <[email protected]> * ci: cleaning caches (#16752) * CI: Update colossalai version (#16747) Co-authored-by: Carlos Mocholí <[email protected]> type * Update version and changelog for 1.9.2 --------- Co-authored-by: Akihiro Nitta <[email protected]> Co-authored-by: Jirka Borovec <[email protected]> Co-authored-by: pre-commit-ci[bot] <66853113+pre-commit-ci[bot]@users.noreply.github.com> Co-authored-by: Jirka <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: thomas chaton <[email protected]> Co-authored-by: thomas <[email protected]> Co-authored-by: Ethan Harris <[email protected]> Co-authored-by: Justus Schock <[email protected]>
1 parent 3add657 commit c5b836a

File tree

38 files changed

+478
-201
lines changed

38 files changed

+478
-201
lines changed

‎.azure/gpu-tests-pytorch.yml‎

Lines changed: 1 addition & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -100,19 +100,14 @@ jobs:
100100

101101
- bash: pip uninstall -y -r requirements/pytorch/strategies.txt
102102
condition: eq(variables['scope'], '')
103-
displayName: 'UnInstall strategies'
103+
displayName: 'Uninstall strategies'
104104

105105
- bash: |
106106
set -e
107107
CUDA_VERSION_BAGUA=$(python -c "print([ver for ver in [116,113,111,102] if $CUDA_VERSION_MM >= ver][0])")
108108
pip install "bagua-cuda$CUDA_VERSION_BAGUA"
109109
110-
CUDA_VERSION_MM_COLOSSALAI=$(python -c "import torch ; print(''.join(map(str, torch.version.cuda)))")
111-
CUDA_VERSION_COLOSSALAI=$(python -c "print([ver for ver in [11.3, 11.1] if $CUDA_VERSION_MM_COLOSSALAI >= ver][0])")
112-
pip install "colossalai==0.1.12+torch${PYTORCH_VERSION}cu${CUDA_VERSION_COLOSSALAI}" --find-links https://release.colossalai.org
113-
114110
pip install -r requirements/pytorch/strategies.txt --find-links ${TORCH_URL}
115-
116111
python requirements/pytorch/check-avail-strategies.py
117112
condition: eq(variables['scope'], 'strategies')
118113
displayName: 'Install strategies'

‎.azure/ipu-tests.yml‎

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -71,7 +71,8 @@ jobs:
7171
for fpath in `ls requirements/**/*.txt`; do \
7272
python ./requirements/pytorch/adjust-versions.py $fpath; \
7373
done
74-
pip install -e .[dev]
74+
pip install -e .[extra,examples,test]
75+
7576
pip list
7677
env:
7778
PACKAGE_NAME: "pytorch"

‎.git-blame-ignore-revs‎

Lines changed: 16 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,16 @@
1+
# copyright Lightning AI team (#16647)
2+
770b7929255389503e907350e2380ff449229816
3+
# [App] Add Missing Copyright (#16625)
4+
2bab2bac01694680b6c3e4f3a19d5bcd361fcaf4
5+
# adding license (#16450)
6+
e4c3441b25a8c194a873c8850e9507771de7053c
7+
# update copyright in PL & Fabric (#16481)
8+
98f7696d1681974d34fad59c03b4b58d9524ed13
9+
# add copyr (#6661)
10+
d471fa30b3bf95cfe601014bac544754067241ca
11+
# add copyright to tests (#5143)
12+
35401706bf0b89b07bc1748fdc2df612baa2be2a
13+
# added copyright notices (#3062)
14+
f43028f3ae5333b4ef0b08cc34f5560736381962
15+
# copyright (#2710)
16+
44d85c12191098b9bad40536375b29b154d91a47

‎.github/workflows/cleanup-caches.yml‎

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# https://docs.github.com/en/actions/using-workflows/caching-dependencies-to-speed-up-workflows#force-deleting-cache-entries
2+
name: cleanup caches by a branch
3+
on:
4+
pull_request:
5+
types: [closed]
6+
7+
jobs:
8+
9+
pr-cleanup:
10+
runs-on: ubuntu-latest
11+
steps:
12+
- name: Check out code
13+
uses: actions/checkout@v3
14+
15+
- name: Cleanup
16+
run: |
17+
gh extension install actions/gh-actions-cache
18+
19+
REPO=${{ github.repository }}
20+
BRANCH="refs/pull/${{ github.event.pull_request.number }}/merge"
21+
22+
echo "Fetching list of cache key"
23+
cacheKeysForPR=$(gh actions-cache list -R $REPO -B $BRANCH | cut -f 1 )
24+
25+
## Setting this to not fail the workflow while deleting cache keys.
26+
set +e
27+
echo "Deleting caches..."
28+
for cacheKey in $cacheKeysForPR
29+
do
30+
gh actions-cache delete $cacheKey -R $REPO -B $BRANCH --confirm
31+
done
32+
echo "Done"
33+
env:
34+
GH_TOKEN: ${{ secrets.GITHUB_TOKEN }}

‎dockers/base-cuda/Dockerfile‎

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -152,10 +152,7 @@ RUN \
152152
# install ColossalAI
153153
# TODO: 1.13 wheels are not released, remove skip once they are
154154
if [[ $PYTORCH_VERSION != "1.13" ]]; then \
155-
CUDA_VERSION_MM_COLOSSALAI=$(python -c "import torch ; print(''.join(map(str, torch.version.cuda)))") ; \
156-
CUDA_VERSION_COLOSSALAI=$(python -c "print([ver for ver in [11.3, 11.1] if $CUDA_VERSION_MM_COLOSSALAI >= ver][0])") ; \
157-
pip install "colossalai==0.1.12+torch${PYTORCH_VERSION}cu${CUDA_VERSION_COLOSSALAI}" "setuptools==59.5.0" \
158-
--find-links https://release.colossalai.org ; \
155+
pip install "colossalai==0.2.3"; \
159156
python -c "import colossalai; print(colossalai.__version__)" ; \
160157
fi
161158

‎dockers/base-xla/tpu_workflow_pytorch.jsonnet‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -42,7 +42,7 @@ local tputests = base.BaseTest {
4242
for fpath in `ls requirements/**/*.txt`; do
4343
python requirements/pytorch/adjust-versions.py $fpath {PYTORCH_VERSION};
4444
done
45-
PACKAGE_NAME=pytorch pip install .[dev]
45+
PACKAGE_NAME=pytorch pip install .[extra,test]
4646
pip list
4747
4848
echo $KUBE_GOOGLE_CLOUD_TPU_ENDPOINTS

‎requirements/app/base.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,4 +1,4 @@
1-
lightning-cloud>=0.5.24
1+
lightning-cloud>=0.5.26
22
packaging
33
typing-extensions>=4.0.0, <=4.4.0
44
deepdiff>=5.7.0, <6.2.4

‎requirements/pytorch/extra.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44
# extended list of package dependencies to reach full functionality
55
matplotlib>3.1, <3.6.2
66
omegaconf>=2.0.5, <2.4.0
7-
hydra-core>=1.0.5, <1.3.0
7+
hydra-core>=1.0.5, <1.4.0
88
jsonargparse[signatures]>=4.18.0, <4.19.0
99
rich>=10.14.0, !=10.15.0.a, <13.0.0
1010
tensorboardX>=2.2, <=2.5.1 # min version is set by torch.onnx missing attribute

‎requirements/pytorch/strategies.txt‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,9 +1,9 @@
11
# NOTE: the upper bound for the package version is only set for CI stability, and it is dropped while installing this package
22
# in case you want to preserve/enforce restrictions on the latest compatible version, add "strict" as an in-line comment
33

4-
# colossalai>=0.1.12
4+
colossalai>=0.2.0, <=0.2.4
55
fairscale>=0.4.5, <0.4.13
6-
deepspeed>=0.6.0, <=0.8.0
6+
deepspeed>=0.6.0, <0.8.0 # TODO: Include 0.8.x after https://github.com/microsoft/DeepSpeed/commit/b587c7e85470329ac25df7c7c2521ff9b2833db7 gets released
77
# no need to install with [pytorch] as pytorch is already installed
88
horovod>=0.21.2, !=0.24.0, <=0.26.1
99
hivemind==1.1.5; sys_platform == 'linux'

‎src/lightning_app/CHANGELOG.md‎

Lines changed: 4 additions & 23 deletions
Original file line numberDiff line numberDiff line change
@@ -5,32 +5,13 @@ All notable changes to this project will be documented in this file.
55
The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/).
66

77

8-
## [1.9.2] - 2023-02-DD
8+
## [1.9.2] - 2023-02-15
99

1010
### Added
1111

12-
-
13-
14-
15-
### Changed
16-
17-
-
18-
19-
20-
### Deprecated
21-
22-
-
23-
24-
25-
### Removed
26-
27-
-
28-
29-
30-
### Fixed
31-
32-
-
33-
12+
- Added Storage Commands ([#16740](https://github.com/Lightning-AI/lightning/pull/16740))
13+
* `rm`: Delete files from your Cloud Platform Filesystem
14+
- Added `lightning connect data` to register data connection to private s3 buckets ([#16738](https://github.com/Lightning-AI/lightning/pull/16738))
3415

3516

3617
## [1.9.1] - 2023-02-10

0 commit comments

Comments
 (0)