Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Golem update #11

Merged
merged 77 commits into from
Jan 30, 2023
Merged

Golem update #11

merged 77 commits into from
Jan 30, 2023

Conversation

staeros
Copy link
Collaborator

@staeros staeros commented Jan 26, 2023

Core was updated for GOLEM framework

…ter limitation for max possible numbers of trainable parameters (from 7e8 to 2e8).
staeros and others added 13 commits January 19, 2023 20:28
Code update

Unit tests update

Unit tests update

Requirements update

Code refactoring

WIP Model builder and LayerInitializer

NasGraph refactoring; Added option to specify train parameters more flexible

Dataset builder preprocessor fixes; Added unit tests for dataset builder

Refactoring; Added unit test for DatasetBuilder

Refactoring

Refactoring

BaseNasDatasetBuilder preprocessor fix; cases update

BaseNasDatasetBuilder preprocessor fix

Added class BaseNasDatasetBuilder for InputData preparation for model train

Minor composer changes; Composer refactoring

Redundant code was removed

Added unit tests for requirements

Default requirements hotfix

Requirements update; Added unit tests for base layer requirements

Requirements update

golem imports update; requirements refactoring

requirements update

golem update

history functional object remove

memory hotfix

Added performance callback

Added unfit method

Minor hotfixes

Minor hotfixes

Minor fixes

Branch Manager fix

requirements update

requirements update

Builder fixes

Builder fixes

Hotfixes for val rules: added ty except in dimension check rule

Hotfixes for val rules

callbacks update

callbacks update

setup update

Added callback for model performance

Minor changes

Minor changes

Keras optimizer changed

minor changes

minor changes

save path fix

Added temporary val rules for resnet-like networks + small fixes

Refactoring; Subcalssing from Keras model was replaced with ModelConverter class.

Refactoring + Updates for model generation

Added graph branch manager and class for convert node to layer

Added graph branch manager and class for convert node to layer

Memory leak fixing

Skip connections fix, minor Resnet builder fixes

ResNet builder updates

ResNet builder implementation for initial assumption

val rule update for trainable parameters

requirements update; serializer error fix

Fix for trainable restrictions.

Fix for trainable restrictions.

Added trainable restrictions.

Possible pool of conv layer types was extended; validation rules update; refactoring

Pre-refactoring changes. Updating class for graph generation and solving issue with keras OOM

Added layers repository

Fixes for simple mutation bug

Fixes for simple mutation bug

Graph requirements were extended for convolutional nodes; Added stricter limitation for max possible numbers of trainable parameters (from 7e8 to 2e8).
@staeros staeros requested a review from nicl-nno January 26, 2023 17:27
from nas.graph.node.nn_graph_node import NNNode


class GraphStruct:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Вот тут непонятно - это что-то keras-специфичное или нет? Хорошо бы всё что относится к keras в какой-то отдельный модуль вынести - так проще будет рефакторить. Можно в след. PR уже

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Разделил на 2 разных файла и переименовал GraphStruct. Этот класс больше вспомогательный для сбора сетки независимо от фреймворка

import tensorflow


class CustomCallback(tensorflow.keras.callbacks.Callback):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Лучше назвать более конкретно.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Переименовал в PerformanceChecker

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Лучше PerformanceCheckingCallback.

@staeros staeros merged commit 2881657 into master Jan 30, 2023
@staeros staeros deleted the golem-update branch January 30, 2023 10:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants