Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add deepar_retail_forecasting example #272

Closed
wants to merge 6 commits into from
Closed

Conversation

robperc
Copy link

@robperc robperc commented Jun 7, 2018

This example shows a more compelling real world use-case of DeepAR where the algorithm is used to predict clothing retail product sales using a synthetic retail dataset.

@robperc
Copy link
Author

robperc commented Jun 12, 2018

Fixed some bugs introduced due to an update to the pandas version used by the notebook.

robperc and others added 2 commits June 13, 2018 17:13
Rename "sess" to "sagemaker_session"
@eoghanmull
Copy link

I have a quick query on the model output i.e. "mean" vs "quantiles". In this example you use the quantile of 0.9, in other examples I have seen the use of 0.5 and also the separate output parameter "mean". Which one should be used as the "prediction" is there a rule of thumb or is it a more case by case basis.

@robperc
Copy link
Author

robperc commented Aug 22, 2019

The "mean" output type provides a single a single output series that is the mean of the number of samples specified in the "num_samples" configuration parameter. The "quantiles" output type returns all series for the samples that fall into the quantiles specified in the "quantiles" configuration parameter.

@eoghanmull
Copy link

Thank you Rob, I think I may have phrased the question incorrectly, what I'm trying to figure out is what the quantiles signify.

My current intuition is that each quantile is a bias for the predictions trend i.e 0.9 signifies an "over prediction" and 0.1 an "under prediction" is this correct?

Copy link

@Kerstin123 Kerstin123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for your example:)

I have a question regarding the cat-operator you integrated in your code.
You have two categories but only one cat in your final json file. Is this category a combination you generated in your code which contains a combination of both categories?
And do you know a way to imlement the categories seperately?

I tried to implement the categories seperatly within your code but I got an error message that the training set did not contain examples for all categories of the 1th categorical feature.

I think the reason is that the encodeing of the categories is a loop over all categories but it should be seperate for each one.

Do you know a way to encode all categories serperately?

Thanks in advance

@sagemaker-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: amazon-sagemaker-examples-pr
  • Commit ID: bebef85
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@hongshanli23
Copy link
Contributor

Dear SageMaker Community,
In our attempts to provide this repository with a better level of support going forward, we’re closing issues that were opened prior to the v2 release of the SDK. This is because we believe that over time many of the issues posted were solved with the latest release or other recent changes to the repo. This will help us reallocate resources towards issues that are more likely to still be relevant today. Some of the issues experienced now can be resolved by referencing the v2 guide: https://sagemaker.readthedocs.io/en/stable/v2.html In this guide, you can find simple solutions to common notebook errors, like the renaming of parameters and classes. If you believe your issue is still ongoing and you have updated error messaging or other info, please re-open it, and we investigate the issue.
Best Regards,
AWS SageMaker Team

atqy pushed a commit to atqy/amazon-sagemaker-examples that referenced this pull request Aug 16, 2022
* Initial commit

* Add test for PT-DT

* Rename file

* Remove extraneous file

* Add function back

* Add check for horovod.torch

* Fix f-string

* catch ImportError

* Remove try-catch

* Address Rahul's comment

* Check that torch.distributed is available

* Add trial.workers() check

* Wrap race condition

* Add reset_collections() to test cases

* peace offering to CI
akrishna1995 pushed a commit that referenced this pull request Nov 30, 2023
* UCI heart example for step decorator with EMR step for preprocessing (#266)

* UCI heart example for step decorator with EMR step for preprocessing

* UCI heart example for step decorator with EMR step, after linter

* UCI heart example for step decorator with EMR step, after linter

* removed content_types

* using prod S3 bucket

* using XGBClassifier

* fix code format

---------

Co-authored-by: feliplp <[email protected]>
Co-authored-by: Dewen Qi <[email protected]>

* add notebook example on basic pipeline for batch inference using step decorator (#264)

* add basic pipeline for batch inference using step decorator

* change Booster to XGBClassifier; incorporating feedback from aws/amazon-sagemaker-examples-staging#264

* fix minor typos

* incorporate comments from PR aws/amazon-sagemaker-examples-staging#264

* incorporate feedback from aws/amazon-sagemaker-examples-staging#264

---------

Co-authored-by: pprasety <[email protected]>

* Add remote-function notebook fixes (#265)

Co-authored-by: svia3 <[email protected]>

* Add pipeline step decorator quick start notebook (#267)

add pipeline scheduler examples

Address comments and refine

Add pipeline step decorator ablone notebook

Address review meeting comments

Update clean up sections

Add rate-based schedules back

Udpate notebooks for Public Beta

Fix the colliding endpoint name across different executions

Upgrading pandas to fix ImportError in Studio DataScience 3.0 image

add scheduler-light additions to quick_start notebook

add scheduler-light additions to quick_start notebook

fix invalid notebook json

Update notebooks for GA

Add modular package for lightsaber

Add a simple notebook to demonstrate mix use of training step and step deco

Address comments

fix pipeline delete resouce leak issue in using_step_decorator notebook

dummy commit

Co-authored-by: Dewen Qi <[email protected]>

* remove local SDK tar and retrieve SDK from public

---------

Co-authored-by: Felipe Lopez <[email protected]>
Co-authored-by: feliplp <[email protected]>
Co-authored-by: Dewen Qi <[email protected]>
Co-authored-by: Philips Kokoh <[email protected]>
Co-authored-by: pprasety <[email protected]>
Co-authored-by: Stephen Via <[email protected]>
Co-authored-by: svia3 <[email protected]>
akrishna1995 added a commit that referenced this pull request Nov 30, 2023
* feat: Add notebooks for step decorator (#272)

* UCI heart example for step decorator with EMR step for preprocessing (#266)

* UCI heart example for step decorator with EMR step for preprocessing

* UCI heart example for step decorator with EMR step, after linter

* UCI heart example for step decorator with EMR step, after linter

* removed content_types

* using prod S3 bucket

* using XGBClassifier

* fix code format

---------

Co-authored-by: feliplp <[email protected]>
Co-authored-by: Dewen Qi <[email protected]>

* add notebook example on basic pipeline for batch inference using step decorator (#264)

* add basic pipeline for batch inference using step decorator

* change Booster to XGBClassifier; incorporating feedback from aws/amazon-sagemaker-examples-staging#264

* fix minor typos

* incorporate comments from PR aws/amazon-sagemaker-examples-staging#264

* incorporate feedback from aws/amazon-sagemaker-examples-staging#264

---------

Co-authored-by: pprasety <[email protected]>

* Add remote-function notebook fixes (#265)

Co-authored-by: svia3 <[email protected]>

* Add pipeline step decorator quick start notebook (#267)

add pipeline scheduler examples

Address comments and refine

Add pipeline step decorator ablone notebook

Address review meeting comments

Update clean up sections

Add rate-based schedules back

Udpate notebooks for Public Beta

Fix the colliding endpoint name across different executions

Upgrading pandas to fix ImportError in Studio DataScience 3.0 image

add scheduler-light additions to quick_start notebook

add scheduler-light additions to quick_start notebook

fix invalid notebook json

Update notebooks for GA

Add modular package for lightsaber

Add a simple notebook to demonstrate mix use of training step and step deco

Address comments

fix pipeline delete resouce leak issue in using_step_decorator notebook

dummy commit

Co-authored-by: Dewen Qi <[email protected]>

* remove local SDK tar and retrieve SDK from public

---------

Co-authored-by: Felipe Lopez <[email protected]>
Co-authored-by: feliplp <[email protected]>
Co-authored-by: Dewen Qi <[email protected]>
Co-authored-by: Philips Kokoh <[email protected]>
Co-authored-by: pprasety <[email protected]>
Co-authored-by: Stephen Via <[email protected]>
Co-authored-by: svia3 <[email protected]>

* Notebook Job Step Example (#274)

* Create README.md

* Adding notebooks

* Delete sagemaker-pipelines/notebook-job-step/README.md

* Adding example for inference components and managed instance scaling for SageMaker real time hosting and inference (#275)

* Cleaned up notebooks

Cleaned up for initial push to staging

* removed references to goldfinch

* Updated readme

* moved to proper directory

* fixed session object reference

* Updated session variable

* Updated with logic to check store vars. Need to remove internal only code

* linted notebooks and added test header and footers

* Fixed prompt and parameters for codegen25

* Updated descriptions, added handling

* Removed custom model shapes

* Making Jumpstart notebooks Python 3.10 compatible (#269)

* removed roleARN which is not needed

* smart sifting notebooks (#281)

* smart sifting notebooks

* smart sifting notebooks updated description

* Added new flow diagram

---------

Co-authored-by: Arun Lokanatha <[email protected]>

---------

Co-authored-by: qidewenwhen <[email protected]>
Co-authored-by: Felipe Lopez <[email protected]>
Co-authored-by: feliplp <[email protected]>
Co-authored-by: Dewen Qi <[email protected]>
Co-authored-by: Philips Kokoh <[email protected]>
Co-authored-by: pprasety <[email protected]>
Co-authored-by: Stephen Via <[email protected]>
Co-authored-by: svia3 <[email protected]>
Co-authored-by: Ram Vegiraju <[email protected]>
Co-authored-by: James Park <[email protected]>
Co-authored-by: Pooja Karadgi <[email protected]>
Co-authored-by: Arun Lokanatha <[email protected]>
Co-authored-by: Arun Lokanatha <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants