Skip to content

Commit

Permalink
Remove kedro.extras.datasets and kedro.extras (#3057)
Browse files Browse the repository at this point in the history
* release note

Signed-off-by: Nok Chan <[email protected]>

* remove datasets tests

Signed-off-by: Nok Chan <[email protected]>

* Remove kedro.extras.datasets and kedro.extras

Signed-off-by: Nok Chan <[email protected]>

* Update `kedro.extas.datasets` -> `kedro_datasets` for tests

Signed-off-by: Nok Chan <[email protected]>

* remove extras.datasets from importlinter

Signed-off-by: Nok <[email protected]>

* lint

Signed-off-by: Nok <[email protected]>

* Update base type

Signed-off-by: Nok <[email protected]>

* suppress coverage temporarily

Signed-off-by: Nok <[email protected]>

* update importlinter

Signed-off-by: Nok <[email protected]>

* Remove kedro.extras from the .rst source

Signed-off-by: Nok <[email protected]>

---------

Signed-off-by: Nok Chan <[email protected]>
Signed-off-by: Nok <[email protected]>
  • Loading branch information
noklam authored Sep 22, 2023
1 parent 2aef571 commit 94f26f2
Show file tree
Hide file tree
Showing 145 changed files with 27 additions and 17,279 deletions.
1 change: 1 addition & 0 deletions RELEASE.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@
## Breaking changes to the API

### DataSets
* Remove `kedro.extras.datasets` and tests.
* Reduced constructor arguments for `APIDataSet` by replacing most arguments with a single constructor argument `load_args`. This makes it more consistent with other Kedro DataSets and the underlying `requests` API, and automatically enables the full configuration domain: stream, certificates, proxies, and more.

### CLI
Expand Down
1 change: 0 additions & 1 deletion docs/source/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -319,7 +319,6 @@
"kedro.pipeline",
"kedro.runner",
"kedro.config",
"kedro.extras.datasets",
"kedro_datasets",
]

Expand Down
2 changes: 1 addition & 1 deletion docs/source/experiment_tracking/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -135,7 +135,7 @@ export AWS_REGION="your_aws_region"

## Set up experiment tracking datasets

There are two types of tracking datasets: [`tracking.MetricsDataSet`](/kedro.extras.datasets.tracking.MetricsDataSet) and [`tracking.JSONDataSet`](/kedro.extras.datasets.tracking.JSONDataSet). The `tracking.MetricsDataSet` should be used for tracking numerical metrics, and the `tracking.JSONDataSet` can be used for tracking any other JSON-compatible data like boolean or text-based data.
There are two types of tracking datasets: [`tracking.MetricsDataSet`](/kedro_datasets.tracking.MetricsDataSet) and [`tracking.JSONDataSet`](/kedro_datasets.tracking.JSONDataSet). The `tracking.MetricsDataSet` should be used for tracking numerical metrics, and the `tracking.JSONDataSet` can be used for tracking any other JSON-compatible data like boolean or text-based data.

Set up two datasets to log the columns used in the companies dataset (`companies_columns`) and experiment metrics for the data science pipeline (`metrics`) like the coefficient of determination (`r2 score`), max error (`me`) and mean absolute error (`mae`) by adding the following in the `conf/base/catalog.yml` file:

Expand Down
50 changes: 0 additions & 50 deletions docs/source/kedro.extras.datasets.rst

This file was deleted.

13 changes: 0 additions & 13 deletions docs/source/kedro.extras.rst

This file was deleted.

2 changes: 0 additions & 2 deletions kedro/extras/__init__.py

This file was deleted.

22 changes: 0 additions & 22 deletions kedro/extras/datasets/README.md

This file was deleted.

19 changes: 0 additions & 19 deletions kedro/extras/datasets/__init__.py

This file was deleted.

Empty file.
8 changes: 0 additions & 8 deletions kedro/extras/datasets/biosequence/__init__.py

This file was deleted.

136 changes: 0 additions & 136 deletions kedro/extras/datasets/biosequence/biosequence_dataset.py

This file was deleted.

8 changes: 0 additions & 8 deletions kedro/extras/datasets/dask/__init__.py

This file was deleted.

Loading

0 comments on commit 94f26f2

Please sign in to comment.