Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proposal and tutorial of unstructured lifelong learning #391

Merged
merged 4 commits into from
Apr 18, 2023
Merged

Proposal and tutorial of unstructured lifelong learning #391

merged 4 commits into from
Apr 18, 2023

Conversation

luosiqi
Copy link
Contributor

@luosiqi luosiqi commented Jan 18, 2023

Proposal of unstructured lifelong learning and describe the following key points:

  1. Support unstructured data
  2. Add unseen task processing online and offline
  3. Change of system architecture

@kubeedge-bot kubeedge-bot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Jan 18, 2023
@kubeedge-bot kubeedge-bot added size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Mar 13, 2023
@@ -0,0 +1,238 @@
# How to make user-defined configuration of lifelong learning
Copy link
Collaborator

@MooreZheng MooreZheng Mar 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The tutorial currently looks like a dictionary... Would be better to write it in a user-case way, i.e., considering what users would want to do, in what situation users would need certain procedures and what the procedures are.

# Unstructured Lifelong Learning
## Motivation

Edge cloud synergy lifelong learning has been proposed and realized through Sedna in [ATCII example](https://github.com/kubeedge/sedna/blob/main/examples/lifelong_learning/atcii/README.md) which handles structured data. However, the last version of Sedna lifelong learning scheme has the following limitations.
Copy link
Collaborator

@MooreZheng MooreZheng Mar 14, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When talking about "However, the last version of Sedna lifelong learning scheme", would be better to specify which the mentioned version is.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The version has been specified.

In this version of lifelong learning, we seek to fundamentally overcome the above challenges of edge-cloud distributed machine learning.
### Goals

* Supports unstructured lifelong learning.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is not clear for reader to understand, like "the goal of unstructured lifelong learning is to support unstructured lifelong learning". I suggest to give a concrete explain about this goal, at least you can say "Support unstructured dataset like images"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

## Motivation


At present, edge-cloud synergy machine learning is confronted with the challenge of heterogeneous data distributions in complex scenarios and small samples on the edge. The edge-cloud synergy lifelong learning is accordingly proposed: 1) In order to learn with shared knowledge between historical scenarios, the scheme is essentially the combination of another two learning schemes, i.e., multi-task learning and incremental learning; 2) The cloud knowledge base in lifelong learning empowers the scheme with memory ability, which helps to adapt historical knowledge to new and unseen situations on the edge. Joining the forces of multi-task learning, incremental learning and the knowledge base, the lifelong learning scheme seeks to fundamentally overcome the above challenges of edge-cloud synergy machine learning.
### Goals
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

More details are needed

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Supplemented

@luosiqi luosiqi changed the title Proposal of unstructured lifelong learning Proposal and tutorial of unstructured lifelong learning Mar 31, 2023
@MooreZheng
Copy link
Collaborator

/lgtm

@kubeedge-bot kubeedge-bot added the lgtm Indicates that a PR is ready to be merged. label Mar 31, 2023
@jaypume
Copy link
Member

jaypume commented Apr 11, 2023

it looks good to me of the proposal, but please squash these commits to make commit history more clear, before it be merged.

@jaypume
Copy link
Member

jaypume commented Apr 18, 2023

/lgtm

@jaypume
Copy link
Member

jaypume commented Apr 18, 2023

/approve

@kubeedge-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jaypume

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kubeedge-bot kubeedge-bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Apr 18, 2023
@kubeedge-bot kubeedge-bot merged commit 0197964 into kubeedge:main Apr 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants