You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I noticed the introduction of LazyVector in Velox, along with its related code implementation. The design concept of LazyVector is excellent; it employs lazy loading to only fetch the necessary rows of data as needed during expression evaluation, thereby minimizing I/O as much as possible.
However, I find it somewhat odd that, the loading process for LazyVector is synchronous, whereas data loading by the connector is generally performed asynchronously from storage. Moreover, since expression execution occurs on threads rather than coroutines, this synchronous calling can continuously occupy thread resources when encountering I/O wait.
Is this current approach viable? Or are there any other techniques or considerations to take into account when using it?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi Guys,
I noticed the introduction of LazyVector in Velox, along with its related code implementation. The design concept of LazyVector is excellent; it employs lazy loading to only fetch the necessary rows of data as needed during expression evaluation, thereby minimizing I/O as much as possible.
However, I find it somewhat odd that, the loading process for LazyVector is synchronous, whereas data loading by the connector is generally performed asynchronously from storage. Moreover, since expression execution occurs on threads rather than coroutines, this synchronous calling can continuously occupy thread resources when encountering I/O wait.
Is this current approach viable? Or are there any other techniques or considerations to take into account when using it?
Beta Was this translation helpful? Give feedback.
All reactions