Skip to content

Releases: dragonflyoss/dragonfly

v2.1.0-beta.4

01 Aug 12:17
b723181
Compare
Choose a tag to compare

Changelog

  • 58f486a chore(deps): bump github.com/aliyun/aliyun-oss-go-sdk from 2.2.7+incompatible to 2.2.8+incompatible (#2588)
  • 0f25876 chore(deps): bump github.com/aws/aws-sdk-go from 1.44.306 to 1.44.312 (#2584)
  • e12523a chore(deps): bump github.com/casbin/casbin/v2 from 2.72.1 to 2.73.0 (#2585)
  • 310a717 chore(deps): bump github.com/onsi/gomega from 1.27.8 to 1.27.10 (#2586)
  • a478be6 chore(deps): bump google.golang.org/api from 0.132.0 to 0.134.0 (#2587)
  • 3044b86 chore: clean temporary file when backsource error (#2575)
  • b723181 feat: add personal access token middleware to open api (#2590)
  • d894aff feat: add personal access tokens api to rest server (#2583)
  • f1fbfde feat: provide support for JuiceFS objectStorage implementation (#2578)
  • 75ddb8b feat: support tls in manager rest server (#2580)
  • cb41c0e feat: update api version (#2577)
  • 0299830 refactor: support for JuiceFS objectStorage implementation (#2579)

v2.1.0-beta.3

26 Jul 12:34
55cb752
Compare
Choose a tag to compare

Changelog

v2.1.0-beta.2

25 Jul 13:54
96ec90e
Compare
Choose a tag to compare

Changelog

  • 9da77c8 chore(deps): bump github.com/MysteriousPotato/go-lockable from 0.1.0 to 0.2.0 (#2504)
  • 93f17f5 chore(deps): bump github.com/MysteriousPotato/go-lockable from 0.2.0 to 1.0.0 (#2548)
  • 700c299 chore(deps): bump github.com/aws/aws-sdk-go from 1.44.258 to 1.44.306 (#2565)
  • e5ebce9 chore(deps): bump github.com/bits-and-blooms/bitset from 1.7.0 to 1.8.0 (#2551)
  • 3586704 chore(deps): bump github.com/casbin/casbin/v2 from 2.68.0 to 2.71.1 (#2501)
  • c7d02aa chore(deps): bump github.com/casbin/casbin/v2 from 2.71.1 to 2.72.1 (#2561)
  • 28f162a chore(deps): bump github.com/shirou/gopsutil/v3 from 3.23.5 to 3.23.6 (#2535)
  • e2b334a chore(deps): bump golang.org/x/oauth2 from 0.9.0 to 0.10.0 (#2532)
  • a35e83b chore(deps): bump google.golang.org/api from 0.128.0 to 0.129.0 (#2503)
  • 9ed62a2 chore(deps): bump google.golang.org/api from 0.129.0 to 0.130.0 (#2533)
  • de5bc37 chore(deps): bump google.golang.org/api from 0.130.0 to 0.131.0 (#2549)
  • 0f52e2e chore(deps): bump google.golang.org/api from 0.131.0 to 0.132.0 (#2564)
  • 52b36cb chore(deps): bump google.golang.org/protobuf from 1.30.0 to 1.31.0 (#2502)
  • 6fb518c chore(deps): bump gorm.io/driver/postgres from 1.5.0 to 1.5.2 (#2534)
  • fbd23d1 chore(deps): bump gorm.io/gorm from 1.25.1 to 1.25.2 (#2505)
  • 25ff199 chore(deps): bump helm/kind-action from 1.7.0 to 1.8.0 (#2553)
  • a7ef2c3 chore(deps): bump k8s.io/component-base from 0.27.2 to 0.27.4 (#2562)
  • bfb6440 chore: add fcgxz2003 to maintainer (#2522)
  • 864943f chore: change tainer address port from 9000 to 9090 in scheduler (#2571)
  • 3e6a5fc chore: change trainer expose port from 8002 to 9090 in Dockerfile (#2569)
  • a7f3c7c feat: add GNNModelIDV1 and MLPModelIDV1 in idgen (#2540)
  • be6d808 feat: add finished piece count element in types (#2557)
  • b58879a feat: add inference client in grpc (#2493)
  • 778b90c feat: add optional to build information (#2567)
  • aa95dfe feat: add pieces element in download record (#2531)
  • c7e43be feat: add training service (#2543)
  • 355d9dd feat: add update model rest api (#2530)
  • 1da3550 feat: implement FindProbedHosts and add LoadRandomHosts to host manager (#2519)
  • 9d1e07c feat: implement Train grpc api in trainer (#2541)
  • 6301d22 feat: manager adds createModel function (#2521)
  • 0736617 feat: manager adds trainer config (#2494)
  • a45fcd9 feat: remove ProbedAt function in network topology (#2529)
  • 1d1e696 feat: replace keys with scan in redis client (#2507)
  • 9a36cc5 feat: set scan count for redis client (#2508)
  • cede829 feat: update api verison to v1.9.7 and compatible with tiny task response (#2547)
  • bd3d76a feat: update api version to 2.0.8 (#2566)
  • b4a390d feat: update api version to v2.0.7 (#2560)
  • b3f23f7 feat: update dy7.io/api to v2 (#2558)
  • 512ad52 fix: also add ca to RootCAs (#2516)
  • 01287f4 fix: change model state in the same scheduler id (#2537)
  • 0490a7b fix: if condition judgment of clearing file in trainer service (#2544)
  • 96ec90e fix: remove archives.rlcp in .goreleaser.yaml refer to https://gorele… (#2573)
  • 22e7d62 fix: response of cluster rest api (#2572)
  • 4b2759c fix: scheduler.template.yaml comments (#2526)
  • 650cc67 fix: storage and announcer unit tests (#2542)
  • a8f7c56 refactor: create model grpc api in manager (#2528)
  • 2cb0acc refactor: store pieceRecords in download record (#2539)

v2.1.0-beta.1

28 Jun 12:10
91a9d6f
Compare
Choose a tag to compare

Changelog

Read more

v2.1.0-beta.0

15 Jun 15:03
b3a5168
Compare
Choose a tag to compare

Changelog

  • aaec21c chore(deps): bump github.com/gin-gonic/gin from 1.9.0 to 1.9.1 (#2419)
  • ebe1a68 chore(deps): bump github.com/mdlayher/vsock from 1.2.0 to 1.2.1 (#2405)
  • 1867095 chore(deps): bump github.com/montanaflynn/stats from 0.7.0 to 0.7.1 (#2407)
  • 5a1a4fb chore(deps): bump github.com/shirou/gopsutil/v3 from 3.23.3 to 3.23.5 (#2434)
  • 73998b2 chore(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3 (#2408)
  • dd8f18e chore(deps): bump go.uber.org/atomic from 1.10.0 to 1.11.0 (#2404)
  • b66d098 chore(deps): bump google.golang.org/grpc from 1.56.0-dev to 1.57.0-dev (#2433)
  • 5901576 chore(deps): bump k8s.io/component-base from 0.26.0 to 0.27.2 (#2432)
  • 86ce24c chore: update dfget recursive log (#2459)
  • 09570c3 chore: update grpc api definition to v1.9.0 (#2444)
  • 0da92ef chore: update grpc proto version (#2463)
  • b3a5168 feat: add Access-Control-Expose-Headers to headers (#2467)
  • 5ffa7bb feat: add ProbedAt to network topology (#2413)
  • 37d43ad feat: add ip to uk_scheduler index and uk_seed_peer index in manager (#2426)
  • 499ad60 feat: add storage to trainer (#2431)
  • 6c3116c feat: change DefaultProbeInterval to 20 minute (#2440)
  • c233730 feat: change Dequeue to private func (#2420)
  • 812f37a feat: enable configuration of some directory modes for dfdaemon (#2340)
  • 2b5b96b feat: implement Enqueue and AverageRTT in probes.go (#2393)
  • 47e5427 feat: implement SyncProbes api in scheduler grpc service (#2449)
  • 32eac81 feat: optimize announcer in scheduler and client (#2445)
  • f53d966 feat: optimize dfpath format (#2460)
  • af95813 feat: optimize network topology comment (#2415)
  • 739fee6 feat: remove dirty file
  • 40fb466 feat: remove redis Pipelined in network topology (#2416)
  • b24f1df feat: remove useless fields in network topology (#2439)
  • 579798f feat: specify the version of golangci-lint as v1.52.2 (#2421)
  • f673583 feat: support breakpoint resume for running tasks (#2457)
  • ec85ae5 feat: support to collect and snapshot in network topology (#2429)
  • 284d437 fix: Interval in SyncProbesResponse (#2466)
  • 64062c1 fix: announcer in scheduler (#2451)
  • 3b2a926 fix: delete host in network topology (#2417)
  • 0bbd437 fix: e2e test dfget recursive (#2458)
  • 73e11e0 refactor: network topology package (#2412)

v2.1.0-alpha.9

26 May 07:35
e33804e
Compare
Choose a tag to compare

Changelog

v2.1.0-alpha.8

25 May 13:32
f65513a
Compare
Choose a tag to compare

Changelog

  • 63f3003 chore(deps): bump github.com/huaweicloud/huaweicloud-sdk-go-obs from 3.22.11+incompatible to 3.23.4+incompatible (#2373)
  • ba9b526 chore(deps): bump go.opentelemetry.io/otel/exporters/jaeger from 1.14.0 to 1.15.1 (#2376)
  • ea2cffd chore(deps): bump golang.org/x/oauth2 from 0.7.0 to 0.8.0 (#2372)
  • c0ea922 chore(deps): bump gorm.io/driver/mysql from 1.5.0 to 1.5.1 (#2374)
  • 8a3051b chore: change gorm-adaptor version to v3.5.0 (#2370)
  • e4deba0 chore: check grpc peer info for download service (#2385)
  • dec9948 feat: add Reverse function to slice (#2381)
  • 5f457ca feat: add announceToTrainer in scheduler (#2371)
  • 0b269ff feat: add network topology package (#2364)
  • eaac3b5 feat: hide sensitive information in log (#2369)
  • 1764fd7 feat: move redis key to pkg/redis package (#2378)
  • f65513a feat: scheduler supports to disable redis (#2389)
  • 1a11fc2 fix: call MakeNamespaceKeyInScheduler function error (#2383)
  • a4fecf3 fix: package declaration error (#2379)
  • 04f2585 refactor: network topology package in scheduler (#2380)
  • b9c9b95 refactor: probes package in network topology (#2382)

v2.1.0-alpha.7

22 May 07:17
d6387da
Compare
Choose a tag to compare

Changelog

  • 7c60fdf chore: checkout code first in CI (#2346)
  • 53b921b chore(deps): bump github.com/casbin/gorm-adapter/v3 from 3.16.1 to 3.17.0 (#2353)
  • b57427f chore(deps): bump go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc from 0.39.0 to 0.41.1 (#2352)
  • 0a5982e chore(deps): bump golang.org/x/crypto from 0.8.0 to 0.9.0 (#2355)
  • bb30434 chore: checkout code first in CI (#2347)
  • 1e2471a chore: update redis config in docker compose and update helm chart version (#2344)
  • acff931 feat: add traffic type of peer task download duration (#2349)
  • cd0b95d feat: change DefaultServerPort to 9090 in trainer (#2348)
  • f9c5805 feat: remove deprecated field in manager and scheduler (#2345)
  • 4849b0a feat: remove traffic_type in DownloadPeerDuration metric (#2357)
  • db463fc feat: replace net dial with grpc health check in client (#2361)
  • d6387da fix: evaluate after filter (#2363)
  • 1c5eb86 fix: when bufferSize is zero, storage can not write data to file (#2366)
  • 02e1113 misspelling (#2351)

v2.1.0-alpha.6

11 May 09:24
2e3db55
Compare
Choose a tag to compare

Changelog

  • 63e9e43 chore(deps): bump github.com/aws/aws-sdk-go from 1.44.244 to 1.44.258 (#2334)
  • 83ef647 chore(deps): bump github.com/go-sql-driver/mysql from 1.7.0 to 1.7.1 (#2333)
  • 3381989 chore(deps): bump github.com/onsi/ginkgo/v2 from 2.7.1 to 2.9.4 (#2332)
  • b6ef266 chore(deps): bump github.com/swaggo/swag from 1.8.12 to 1.16.1 (#2331)
  • d036222 chore(deps): bump go.opentelemetry.io/otel/trace from 1.15.0 to 1.15.1 (#2335)
  • 2e3db55 feat: add database config and move redis to it (#2338)
  • 5792bed feat: optimize job new in internal (#2341)
  • 2260614 feat: remove compatibility logic for manager config testing (#2342)
  • 10de8e0 fix: SyncPieceViaHTTPS not work (#2329)

v2.0.9

08 May 04:18
3170ad6
Compare
Choose a tag to compare

Dragonfly v2.0.9 is released! 🎉🎉🎉 Thanks to the Google Cloud Platform (GCP) Team, Volcano Engine Team, and Baidu AI Cloud Team for helping Dragonfly integrate with their public clouds. Welcome to visit d7y.io website.

Features

  • Download tasks based on priority. Priority can be passed as parameter during the download task, or can be associated with priority in the application of the Manager console, refer to priority protoc definition.
  • Scheduler adds PieceDownloadTimeout parameter, which indicates that if the piece download times out, the scheduler will change the task state to TaskStateFailed.
  • Add health service to each GRPC service.
  • Add reflection to each GRPC service.
  • Manager supports redis sentinal model.
  • Refactor dynconfig package to remove json.Unmarshal, improving its runtime efficiency.
  • Fix panic caused by hashring not being built.
  • Previously, most of the pieces were downloaded from the same parent. Now, different pieces are downloaded from different parents to improve download efficiency and distribute bandwidth among multiple parents.
  • If Manager's searcher can not found candidate scheduler clusters, It will return all the clusters for peers to check health. If check health is successful, the scheduler cluster can be used.
  • Support ORAS source client to pull image.
  • Add UDP ping package and GRPC protoc definition for building virtual network topology.
  • The V2 P2P protocol has been added, and both Scheduler and Manager have implemented the API of the V2 P2P protocol, in preparation for the future Rust version of Dfdaemon.
  • OSS source client supports STS access, user can set security token in header.
  • Dynconfig supports to resolve addresses with health service.
  • Add hostTTL and hostGCInterval in Scheduler to prevent information of abnormally exited Dfdaemon from becoming dirty data in the Scheduler.
  • Add CIDR to searcher to provide more precise scheduler cluster selection for Dfdaemon.
  • Refactor the metric definitions for the V1 P2P protocol and add the metric definitions for the V2 P2P protocol. Additionally, reorganize the Grafana Dashboards, refer to monitoring.

Break Change

Public Cloud Providers

Others

You can see CHANGELOG for more details.