Skip to content

feature: add support for SageMaker workflow tuning step #2497

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 21 commits into from
Jul 1, 2021
Merged

feature: add support for SageMaker workflow tuning step #2497

merged 21 commits into from
Jul 1, 2021

Conversation

@jerrypeng7773
Copy link
Contributor

@jerrypeng7773 jerrypeng7773 commented Jun 30, 2021

Issue #, if available:

Description of changes:

This PR adds the support for tuning step.

Change

Testing done:

unite & integ test

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

  • I have read the CONTRIBUTING doc
  • I used the commit message format described in CONTRIBUTING
  • I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
  • I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

  • I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • I have checked that my tests are not configured for a specific region or account (if appropriate)
  • I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

jerrypeng7773 and others added 20 commits May 10, 2021 20:18
@jerrypeng7773
add helper function to generate no-op (data ingestion only) recipe
868db55
@jerrypeng7773
Merge branch 'aws:master' into master
21bedbb
@jerrypeng7773
separate flow generation by source input type + move generation helpe…
854dd10 
…rs to sagemaker.wrangler.ingestion
@jerrypeng7773
Merge branch 'aws:master' into master
8798b65
@jerrypeng7773
create an internal helper function to generate output node
69ae4bd
@jerrypeng7773
Merge branch 'master' of github.com:jerrypeng7773/sagemaker-python-sdk
a6a8449
@jerrypeng7773
Merge branch 'aws:master' into master
2aa256e
@jerrypeng7773
add ingestion test using dw processor via pipeline execution
06557a8
@jerrypeng7773
Merge branch 'aws:master' into master
dcbfd13
@jerrypeng7773
verify the fg query df
fc6522e
@ahsan-z-khan
Merge branch 'master' into master
b6f9371
@jerrypeng7773
fix tests
86fa47d
@ahsan-z-khan
Merge branch 'master' into master
05ccfa6
@jerrypeng7773
Merge branch 'aws:master' into master
0716e9f
@jerrypeng7773
add tuning step support
7ca5af4
@jerrypeng7773
fix docstyle check
8cf18b8
@jerrypeng7773
add helper function to get tuning step top performing model s3 uri
1f95b82
@jerrypeng7773
Merge branch 'aws:master' into master
1b9d66b
@jerrypeng7773
Merge branch 'aws:master' into master
603b934
@jerrypeng7773
Merge branch 'master' of github.com:jerrypeng7773/sagemaker-python-sdk
664f2a8
@jerrypeng7773 jerrypeng7773 requested review from danabens and staubhp and removed request for danabens June 30, 2021 22:37
@jerrypeng7773 jerrypeng7773 marked this pull request as ready for review June 30, 2021 22:42
@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jun 30, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-unit-tests
  • Commit ID: 664f2a8
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jun 30, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-pr
  • Commit ID: 664f2a8
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jun 30, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-slow-tests
  • Commit ID: 664f2a8
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jun 30, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-local-mode-tests
  • Commit ID: 664f2a8
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jun 30, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-notebook-tests
  • Commit ID: 664f2a8
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-notebook-tests
  • Commit ID: 664f2a8
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@danabens danabens self-requested a review July 1, 2021 00:45
@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-unit-tests
  • Commit ID: a8755ec
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-notebook-tests
  • Commit ID: a8755ec
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-slow-tests
  • Commit ID: a8755ec
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-local-mode-tests
  • Commit ID: a8755ec
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

sagemaker-bot commented Jul 1, 2021

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-pr
  • Commit ID: a8755ec
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@apogupta2018 apogupta2018 merged commit efdf3ec into aws:master Jul 1, 2021
@ahsan-z-khan ahsan-z-khan changed the title add support for SageMaker workflow tuning step feature: add support for SageMaker workflow tuning step Jul 1, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

4 more reviewers

@staubhp staubhp staubhp approved these changes

@rads-1996 rads-1996 rads-1996 approved these changes

@danabens danabens danabens approved these changes

@apogupta2018 apogupta2018 apogupta2018 approved these changes

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

7 participants

@jerrypeng7773 @sagemaker-bot @staubhp @rads-1996 @danabens @apogupta2018 @ahsan-z-khan