Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added statfs for block-cache #1470

Merged
merged 48 commits into from
Jan 15, 2025
Merged

Added statfs for block-cache #1470

merged 48 commits into from
Jan 15, 2025

Conversation

ashruti-msft
Copy link
Member

@ashruti-msft ashruti-msft commented Jul 24, 2024

Added statfs for block_cache which will show the memory available if disk is not configured otherwise the disk space. Added corresponding tests for this and fixed a few unit changes in file_cache.

Used a VM with an attached disk of size 5G for the follwoing outputs:

When file cache/block cache uses the attached disk for disk caching
Screenshot 2024-11-22 153142

When config has block_cache component without disk cache it will show the memory available:
Screenshot 2024-11-22 153029

Output when file cache/block cache uses the same VM as disk cache
Screenshot 2024-11-22 152615

Anubhuti Shruti and others added 18 commits May 7, 2024 16:34
@vibhansa-msft vibhansa-msft modified the milestones: V2-2.3.1, v2-2.3.2 Jul 26, 2024
@jainakanksha-msft
Copy link
Collaborator

@ashruti-msft Please add the output in the PR description and details of the change.

@jainakanksha-msft
Copy link
Collaborator

@vibhansa-msft
This PR changes will represent temp disk details with the notation of root Filesystem.
I think that can confuse the users.
Should we change the FileSystem representation also for this somehow if that is feasible?

@vibhansa-msft vibhansa-msft modified the milestones: v2-2.4.0, v2-2.4.1 Nov 12, 2024
@ashruti-msft
Copy link
Member Author

@ashruti-msft Please add the output in the PR description and details of the change.

@jainakanksha-msft I have added the output please have a look

@vibhansa-msft vibhansa-msft changed the base branch from main to blobfuse/2.4.1 November 29, 2024 07:58
@vibhansa-msft vibhansa-msft merged commit c16d3d2 into blobfuse/2.4.1 Jan 15, 2025
8 checks passed
@vibhansa-msft vibhansa-msft deleted the ashruti/disk branch January 15, 2025 09:12
vibhansa-msft added a commit that referenced this pull request Feb 3, 2025
* feat: support workload identity token (#1556)

* feat: support workload identity token

* Create block pool only once in child process (#1581)

* create block pool in child only

* Update golang.org/x/crypto to v0.31.0 (#1594)

* Update golang.org/x/crypto to v0.31.0

* sync with main (#1603)

* updated year in copyright message (#1601)

* Use ListBlob for hns accounts  (#1555)

* Optimize HNS listing

* Added statfs for block-cache (#1470)

* Added statfs for block_cache

* Add strong consistency check for data on disk (#1604)

* Add strong consistency check for data on disk

* bug in block cache open call (#1580)

* current implementation of open file when opened in O_WRONLY will truncate the file to zero. This is incorrect behaviour.
We don't see it in the normal scenario as write-back cache is on by default. Hence all the open calls with O_WRONLY will be redirected O_RDWR.
To simulate this turn of the write-back cache and then open file in O_WRONLY.

* Feature: Blob filter (#1595)

* Integrating blob filter in azstorage

* Serve getAttr call for destination file after the Copy finishes from the cache

* Cleanup on start shall be set to cleanup temp cache (#1613)

* Add Tests

* Refactor the code and refresh the cache after copying the attributes

* Automate blobfuse2 setup for new VM (#1575)

added script for blobfuse setup and azsecpack setup in VM

* * Update the Unit tests.
* Refactor the Code

* Update Changelog

* do go fmt on src

* Downgrade go version to 1.22.7 due to memory issues in 1.23 (#1619)

* Enable ETAG based validation on every block download to provide higher consistency (#1608)

* Make etag validation a defualt option

* BUG#31069208:  Fixed Prefix filtering from File Path (#1618)

* Fixed the logic to filter out folder prefix from path
* Added/Updated/Removed test case

---------

Co-authored-by: weizhi <[email protected]>
Co-authored-by: Sourav Gupta <[email protected]>
Co-authored-by: Jan Jagusch <[email protected]>
Co-authored-by: ashruti-msft <[email protected]>
Co-authored-by: syeleti-msft <[email protected]>
Co-authored-by: jainakanksha-msft <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants