-
Notifications
You must be signed in to change notification settings - Fork 6.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add deepar_retail_forecasting example #272
Conversation
Fixed some bugs introduced due to an update to the pandas version used by the notebook. |
Rename "sess" to "sagemaker_session"
I have a quick query on the model output i.e. "mean" vs "quantiles". In this example you use the quantile of 0.9, in other examples I have seen the use of 0.5 and also the separate output parameter "mean". Which one should be used as the "prediction" is there a rule of thumb or is it a more case by case basis. |
The "mean" output type provides a single a single output series that is the mean of the number of samples specified in the "num_samples" configuration parameter. The "quantiles" output type returns all series for the samples that fall into the quantiles specified in the "quantiles" configuration parameter. |
Thank you Rob, I think I may have phrased the question incorrectly, what I'm trying to figure out is what the quantiles signify. My current intuition is that each quantile is a bias for the predictions trend i.e 0.9 signifies an "over prediction" and 0.1 an "under prediction" is this correct? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for your example:)
I have a question regarding the cat-operator you integrated in your code.
You have two categories but only one cat in your final json file. Is this category a combination you generated in your code which contains a combination of both categories?
And do you know a way to imlement the categories seperately?
I tried to implement the categories seperatly within your code but I got an error message that the training set did not contain examples for all categories of the 1th categorical feature.
I think the reason is that the encodeing of the categories is a loop over all categories but it should be seperate for each one.
Do you know a way to encode all categories serperately?
Thanks in advance
AWS CodeBuild CI Report
Powered by github-codebuild-logs, available on the AWS Serverless Application Repository |
Dear SageMaker Community, |
* Initial commit * Add test for PT-DT * Rename file * Remove extraneous file * Add function back * Add check for horovod.torch * Fix f-string * catch ImportError * Remove try-catch * Address Rahul's comment * Check that torch.distributed is available * Add trial.workers() check * Wrap race condition * Add reset_collections() to test cases * peace offering to CI
* UCI heart example for step decorator with EMR step for preprocessing (#266) * UCI heart example for step decorator with EMR step for preprocessing * UCI heart example for step decorator with EMR step, after linter * UCI heart example for step decorator with EMR step, after linter * removed content_types * using prod S3 bucket * using XGBClassifier * fix code format --------- Co-authored-by: feliplp <[email protected]> Co-authored-by: Dewen Qi <[email protected]> * add notebook example on basic pipeline for batch inference using step decorator (#264) * add basic pipeline for batch inference using step decorator * change Booster to XGBClassifier; incorporating feedback from aws/amazon-sagemaker-examples-staging#264 * fix minor typos * incorporate comments from PR aws/amazon-sagemaker-examples-staging#264 * incorporate feedback from aws/amazon-sagemaker-examples-staging#264 --------- Co-authored-by: pprasety <[email protected]> * Add remote-function notebook fixes (#265) Co-authored-by: svia3 <[email protected]> * Add pipeline step decorator quick start notebook (#267) add pipeline scheduler examples Address comments and refine Add pipeline step decorator ablone notebook Address review meeting comments Update clean up sections Add rate-based schedules back Udpate notebooks for Public Beta Fix the colliding endpoint name across different executions Upgrading pandas to fix ImportError in Studio DataScience 3.0 image add scheduler-light additions to quick_start notebook add scheduler-light additions to quick_start notebook fix invalid notebook json Update notebooks for GA Add modular package for lightsaber Add a simple notebook to demonstrate mix use of training step and step deco Address comments fix pipeline delete resouce leak issue in using_step_decorator notebook dummy commit Co-authored-by: Dewen Qi <[email protected]> * remove local SDK tar and retrieve SDK from public --------- Co-authored-by: Felipe Lopez <[email protected]> Co-authored-by: feliplp <[email protected]> Co-authored-by: Dewen Qi <[email protected]> Co-authored-by: Philips Kokoh <[email protected]> Co-authored-by: pprasety <[email protected]> Co-authored-by: Stephen Via <[email protected]> Co-authored-by: svia3 <[email protected]>
* feat: Add notebooks for step decorator (#272) * UCI heart example for step decorator with EMR step for preprocessing (#266) * UCI heart example for step decorator with EMR step for preprocessing * UCI heart example for step decorator with EMR step, after linter * UCI heart example for step decorator with EMR step, after linter * removed content_types * using prod S3 bucket * using XGBClassifier * fix code format --------- Co-authored-by: feliplp <[email protected]> Co-authored-by: Dewen Qi <[email protected]> * add notebook example on basic pipeline for batch inference using step decorator (#264) * add basic pipeline for batch inference using step decorator * change Booster to XGBClassifier; incorporating feedback from aws/amazon-sagemaker-examples-staging#264 * fix minor typos * incorporate comments from PR aws/amazon-sagemaker-examples-staging#264 * incorporate feedback from aws/amazon-sagemaker-examples-staging#264 --------- Co-authored-by: pprasety <[email protected]> * Add remote-function notebook fixes (#265) Co-authored-by: svia3 <[email protected]> * Add pipeline step decorator quick start notebook (#267) add pipeline scheduler examples Address comments and refine Add pipeline step decorator ablone notebook Address review meeting comments Update clean up sections Add rate-based schedules back Udpate notebooks for Public Beta Fix the colliding endpoint name across different executions Upgrading pandas to fix ImportError in Studio DataScience 3.0 image add scheduler-light additions to quick_start notebook add scheduler-light additions to quick_start notebook fix invalid notebook json Update notebooks for GA Add modular package for lightsaber Add a simple notebook to demonstrate mix use of training step and step deco Address comments fix pipeline delete resouce leak issue in using_step_decorator notebook dummy commit Co-authored-by: Dewen Qi <[email protected]> * remove local SDK tar and retrieve SDK from public --------- Co-authored-by: Felipe Lopez <[email protected]> Co-authored-by: feliplp <[email protected]> Co-authored-by: Dewen Qi <[email protected]> Co-authored-by: Philips Kokoh <[email protected]> Co-authored-by: pprasety <[email protected]> Co-authored-by: Stephen Via <[email protected]> Co-authored-by: svia3 <[email protected]> * Notebook Job Step Example (#274) * Create README.md * Adding notebooks * Delete sagemaker-pipelines/notebook-job-step/README.md * Adding example for inference components and managed instance scaling for SageMaker real time hosting and inference (#275) * Cleaned up notebooks Cleaned up for initial push to staging * removed references to goldfinch * Updated readme * moved to proper directory * fixed session object reference * Updated session variable * Updated with logic to check store vars. Need to remove internal only code * linted notebooks and added test header and footers * Fixed prompt and parameters for codegen25 * Updated descriptions, added handling * Removed custom model shapes * Making Jumpstart notebooks Python 3.10 compatible (#269) * removed roleARN which is not needed * smart sifting notebooks (#281) * smart sifting notebooks * smart sifting notebooks updated description * Added new flow diagram --------- Co-authored-by: Arun Lokanatha <[email protected]> --------- Co-authored-by: qidewenwhen <[email protected]> Co-authored-by: Felipe Lopez <[email protected]> Co-authored-by: feliplp <[email protected]> Co-authored-by: Dewen Qi <[email protected]> Co-authored-by: Philips Kokoh <[email protected]> Co-authored-by: pprasety <[email protected]> Co-authored-by: Stephen Via <[email protected]> Co-authored-by: svia3 <[email protected]> Co-authored-by: Ram Vegiraju <[email protected]> Co-authored-by: James Park <[email protected]> Co-authored-by: Pooja Karadgi <[email protected]> Co-authored-by: Arun Lokanatha <[email protected]> Co-authored-by: Arun Lokanatha <[email protected]>
This example shows a more compelling real world use-case of DeepAR where the algorithm is used to predict clothing retail product sales using a synthetic retail dataset.