Weekly Cronjob fetching artifacts and generating polkadot.rs file. #1352

tadeohepperle · 2024-01-09T17:54:56Z

This PR adds a github action that should run weekly on Monday.
It should run a local substrate node in the CI runner and regenerate the artifacts and the polkadot.rs file.
It then proceeds to create a PR based off the master branch that we can manually approve (running testing CI in that PR).

I tested the CI Action manually in this Subxt Fork, it seems to run as desired:
Actions + Generated PR

I made sure the integration tests ran locally for me with the generated polkadot.rs

tadeohepperle · 2024-01-10T12:12:43Z

.editorconfig

@@ -11,3 +11,6 @@ trim_trailing_whitespace = true
 insert_final_newline = true
 indent_style = space
 indent_size = 4
+
+[*.yml]
+indent_size = 2


I added this because previously I always auto-formatted the yml files in VSCode and it used the indent_size = 4 above.

.github/workflows/update-artifacts.yml

scripts/artifacts.sh

niklasad1 · 2024-01-11T13:36:17Z

scripts/artifacts/src/main.rs

@@ -0,0 +1,89 @@
+use std::{


+1 to that :)

niklasad1

nice

jsdw · 2024-01-15T12:03:52Z

scripts/artifacts.sh

 # A local polkadot node can be run via:
 # ```
 # git clone https://github.com/paritytech/polkadot.git
 # cd polkadot 
 # cargo build --release
 # ./target/release/polkadot --dev --tmp
 # ```
+#
+# Instead of this script you can also use the binary crate "scripts/artifacts",


Is there a good reason to keep both around? I reckon that if we are happy with the rsut crate that we just use that to avoid having two similar things around which may diverge in how they work :)

Good point, the bash script can be used for spinning up a local node and generating artifacts from that. But I am not sure who is using it, and if it is needed we can make it a CLI option to the binary crate as well.

We only wrote it for our own internal use, so if the rust script does what we need then we can ditch it

jsdw

Looks good to me; I guess we can verify that it works properly in CI when it merges :)

…1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script

* asset hub example and book adjustment * formatting * recursive derives * polkadot monitor example and book adjustments * formatting * adjust docs and examples, add dynamic example * james suggestions * fmt * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script --------- Co-authored-by: James Wilson <[email protected]> Co-authored-by: Pan chao <[email protected]>

…1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script

* asset hub example and book adjustment * formatting * recursive derives * polkadot monitor example and book adjustments * formatting * adjust docs and examples, add dynamic example * james suggestions * fmt * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script --------- Co-authored-by: James Wilson <[email protected]> Co-authored-by: Pan chao <[email protected]>

…ale-typegen integration (#1290) * restructure cli commands * config: Add `SkipCheckIfFeeless` signed extension (#1264) * config: Add `SkipCheckIfFeeless` signed extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Add extra extension to the default params Signed-off-by: Alexandru Vasile <[email protected]> * examples: Adjust signed extension example Signed-off-by: Alexandru Vasile <[email protected]> * config: Extend SkipCheckIfFeeless with inner signed extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Configure SkipCheck with inner signed extension params Signed-off-by: Alexandru Vasile <[email protected]> * config: Implement Deafult for SkipCheckIfFeelessParams with Option Signed-off-by: Alexandru Vasile <[email protected]> * examples: Fix example with proper extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Extend <T as Config>::AssetId with EncodeAsType and Clone Signed-off-by: Alexandru Vasile <[email protected]> * config: Add SkipCheck with AssetTx Signed-off-by: Alexandru Vasile <[email protected]> * config: Encode as type from metadata the inner signed extensions Signed-off-by: Alexandru Vasile <[email protected]> * Adjust examples Signed-off-by: Alexandru Vasile <[email protected]> * blocks: Use `SkipCheckIfFeeless` for decoding the tip of extensions Signed-off-by: Alexandru Vasile <[email protected]> * config: Decode `SkipCheckIfFeeless` with `Self` Signed-off-by: Alexandru Vasile <[email protected]> * tests: Adjust testing Signed-off-by: Alexandru Vasile <[email protected]> * config: Descriptive errors for building `SkipCheckIfFeeless` Signed-off-by: Alexandru Vasile <[email protected]> * config: Add docs for extra error types Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add extra derives to signed extensions Signed-off-by: Alexandru Vasile <[email protected]> * config: Use `Default::default` to simplify type init Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Replace removed lint (#1270) Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Add support for multi-chain usecase (#1238) * lightclient: Make `smoldot::chainID` part of the RPC requests Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Make `BackgroundTask` generic over `PlatformRef` and chain Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Construct from raw smoldot and target different chains Signed-off-by: Alexandru Vasile <[email protected]> * testing: Update cargo lock for wasm tests Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reuse `new_from_client` method and removed unused imports Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport smoldot client and RPC objects used in pub interface Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Adjust `new_from_client` interface Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Extend background to poll over multiple RPC objects Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Build light client from raw and target different chains Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Add demo chain specs Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Move artifacts to dedicated folder Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Use SelectAll to drive all streams Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Fetch initial data from the target chain Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport other smoldot objects Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Target chain with potentially different config Signed-off-by: Alexandru Vasile <[email protected]> * subxt/rpc: Log chainID for debugging Signed-off-by: Alexandru Vasile <[email protected]> * subxt/examples: Add smoldot client with parachain example Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Propagate chain ID together with rpc responses object Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Multiplex responses by request ID and chain ID Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add raw light client builder Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add cargo feature flag for parachains example Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Derive default for internal structure Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Guard reexports by std feature flag Signed-off-by: Alexandru Vasile <[email protected]> * Update subxt/src/client/light_client/mod.rs Co-authored-by: James Wilson <[email protected]> * lightclient: Update the builder pattern and chain targetting Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Fix documentation Signed-off-by: Alexandru Vasile <[email protected]> * Provide more insightful docs wrt native/wasm panics Signed-off-by: Alexandru Vasile <[email protected]> * examples: Adjust comment location Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Refactor UniqueChainId into the background task Signed-off-by: Alexandru Vasile <[email protected]> * Update lightclient/src/background.rs Co-authored-by: Niklas Adolfsson <[email protected]> * Update subxt/src/client/light_client/builder.rs Co-authored-by: James Wilson <[email protected]> * lightclient: Update docs wrt panics Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Update docs wrt to smoldot instance -> client Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Use IntoIter instead of Iterator Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Adjsut docs wrt [`Self::new_from_client`] Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Remove RawRpc from LightClient in favor of chainID Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport everything under smoldot module Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Use stateRootHash instead of genesis.raw Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: James Wilson <[email protected]> Co-authored-by: Niklas Adolfsson <[email protected]> * Bump futures from 0.3.28 to 0.3.29 (#1272) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.28 to 0.3.29. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](rust-lang/futures-rs@0.3.28...0.3.29) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump zeroize from 1.6.0 to 1.7.0 (#1274) Bumps [zeroize](https://github.com/RustCrypto/utils) from 1.6.0 to 1.7.0. - [Commits](https://github.com/RustCrypto/utils/commits) --- updated-dependencies: - dependency-name: zeroize dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump tracing-subscriber from 0.3.17 to 0.3.18 (#1275) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.17 to 0.3.18. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](tokio-rs/tracing@tracing-subscriber-0.3.17...tracing-subscriber-0.3.18) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump tracing-subscriber from 0.3.17 to 0.3.18 (#1275) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.17 to 0.3.18. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](tokio-rs/tracing@tracing-subscriber-0.3.17...tracing-subscriber-0.3.18) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump getrandom from 0.2.10 to 0.2.11 (#1273) Bumps [getrandom](https://github.com/rust-random/getrandom) from 0.2.10 to 0.2.11. - [Changelog](https://github.com/rust-random/getrandom/blob/master/CHANGELOG.md) - [Commits](rust-random/getrandom@v0.2.10...v0.2.11) --- updated-dependencies: - dependency-name: getrandom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * impl RpcClientT for Arc<T> and Box<T> (#1277) * impl RpcClientT for Arc<WsClient> * fix grumbles: impl for Box<T> and Arc<T> * grumbles: move RpcClientT impls * first iteration of using scale_typegen * introduce indoc for formatting * calls, constants and home are cleaner now * added event subcommand * show runtime apis working * add better code formatting * fix style * adjust tests, use owo_colorize to not add extra dependency * fmt * adjust docs * move scale-typegen-description dependency to workspace * improve `substrate-compat` (#1265) * improve `substrate-compat` * From => Into --------- Co-authored-by: James Wilson <[email protected]> * Bump proc-macro2 from 1.0.69 to 1.0.70 (#1292) Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2) from 1.0.69 to 1.0.70. - [Release notes](https://github.com/dtolnay/proc-macro2/releases) - [Commits](dtolnay/proc-macro2@1.0.69...1.0.70) --- updated-dependencies: - dependency-name: proc-macro2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump serde from 1.0.192 to 1.0.193 (#1291) Bumps [serde](https://github.com/serde-rs/serde) from 1.0.192 to 1.0.193. - [Release notes](https://github.com/serde-rs/serde/releases) - [Commits](serde-rs/serde@v1.0.192...v1.0.193) --- updated-dependencies: - dependency-name: serde dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * lightclient: Fix wasm socket closure called after being dropped (#1289) * lightclient: Close wasm socket while dropping from connecting state Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Construct one time only closures Signed-off-by: Alexandru Vasile <[email protected]> * testing: Enable console logs for lightclient WASM testing Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Separate wakes and check connectivity on poll_read Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket depending on internal state Signed-off-by: Alexandru Vasile <[email protected]> * Revert "lightclient: Separate wakes and check connectivity on poll_read" This reverts commit 8660940. * lightclient: Return pending if socket is opening from poll_read Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket on `poll_close` Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reset closures on Drop to avoid recursive invokation Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket if not already closing Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * workflows: Install rustup component for building substrate (#1295) Signed-off-by: Alexandru Vasile <[email protected]> * cli: Command to fetch chainSpec and optimise its size (#1278) * cli: Add chainSpec command Signed-off-by: Alexandru Vasile <[email protected]> * cli/chainSpec: Move to dedicated module Signed-off-by: Alexandru Vasile <[email protected]> * cli: Compute the state root hash Signed-off-by: Alexandru Vasile <[email protected]> * cli: Remove code substitutes Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Update polkadot.json Signed-off-by: Alexandru Vasile <[email protected]> * scripts: Generate the chain spec Signed-off-by: Alexandru Vasile <[email protected]> * cli: Remove testing artifacts Signed-off-by: Alexandru Vasile <[email protected]> * cli: Fix clippy Signed-off-by: Alexandru Vasile <[email protected]> * cli: Apply rustfmt Signed-off-by: Alexandru Vasile <[email protected]> * cli: Introduce feature flag for smoldot dependency Signed-off-by: Alexandru Vasile <[email protected]> * cli: Rename chain-spec to chain-spec-pruning Signed-off-by: Alexandru Vasile <[email protected]> * scripts: Update chain-spec command Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * update to new scale-typegen interfaces * use released version of scale-typegen * Merge branch 'master' into tadeohepperle/cli-support-runtime-apis * remove unused debug file * resolve merge errors * adjustments * constants file adjustment * method renaming * fix issue with encoding runtime api params * Add logging to submit_transaction and unstable driver, and ensure unpin evs complete * panic if None returned from subscription too, also with stats * change panic to Err just to be on the safe side * clippy * make long tests run only after clippy + fmt pass * megre in light client test change pr * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script * lightclient(fix): Ensure lightclient chainSpec is at least one block old (#1372) * testing(fix): Ensure lightclient chainSpec is at least one block old Signed-off-by: Alexandru Vasile <[email protected]> * Revert "testing(fix): Ensure lightclient chainSpec is at least one block old" This reverts commit 0eafcb2. * lightclient(fix): Ensure lightclient chainSpec is at least one block old Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Link smoldot issue Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Use tokio under lightclient feature flag Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Do not sleep on errors to fetch the chainSpec Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Remove test file Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Subscribe to two finalized blocks Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Revert cargo toml Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * ci: Reduce the light client timeout to 15 minutes (#1373) * ci: Reduce the light client timpeut to 15 seconds Signed-off-by: Alexandru Vasile <[email protected]> * ci: Use ubuntu-latest for light-client tests Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * actually only wait for machete+fmt, clippy can be much slower * update CI file from Alex PR * resolve clippy err * Try a few RPC nodes in case one of them is not working * fix submit_transaction debug logging of message * Improve Signed Extension and Block Decoding Examples/Book (#1357) * asset hub example and book adjustment * formatting * recursive derives * polkadot monitor example and book adjustments * formatting * adjust docs and examples, add dynamic example * james suggestions * fmt * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script --------- Co-authored-by: James Wilson <[email protected]> Co-authored-by: Pan chao <[email protected]> * fix formatting of returned sections * make storage use execute flag as well --------- Signed-off-by: Alexandru Vasile <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: Alexandru Vasile <[email protected]> Co-authored-by: James Wilson <[email protected]> Co-authored-by: Niklas Adolfsson <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: yjh <[email protected]> Co-authored-by: Pan chao <[email protected]>

* restructure cli commands * config: Add `SkipCheckIfFeeless` signed extension (#1264) * config: Add `SkipCheckIfFeeless` signed extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Add extra extension to the default params Signed-off-by: Alexandru Vasile <[email protected]> * examples: Adjust signed extension example Signed-off-by: Alexandru Vasile <[email protected]> * config: Extend SkipCheckIfFeeless with inner signed extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Configure SkipCheck with inner signed extension params Signed-off-by: Alexandru Vasile <[email protected]> * config: Implement Deafult for SkipCheckIfFeelessParams with Option Signed-off-by: Alexandru Vasile <[email protected]> * examples: Fix example with proper extension Signed-off-by: Alexandru Vasile <[email protected]> * config: Extend <T as Config>::AssetId with EncodeAsType and Clone Signed-off-by: Alexandru Vasile <[email protected]> * config: Add SkipCheck with AssetTx Signed-off-by: Alexandru Vasile <[email protected]> * config: Encode as type from metadata the inner signed extensions Signed-off-by: Alexandru Vasile <[email protected]> * Adjust examples Signed-off-by: Alexandru Vasile <[email protected]> * blocks: Use `SkipCheckIfFeeless` for decoding the tip of extensions Signed-off-by: Alexandru Vasile <[email protected]> * config: Decode `SkipCheckIfFeeless` with `Self` Signed-off-by: Alexandru Vasile <[email protected]> * tests: Adjust testing Signed-off-by: Alexandru Vasile <[email protected]> * config: Descriptive errors for building `SkipCheckIfFeeless` Signed-off-by: Alexandru Vasile <[email protected]> * config: Add docs for extra error types Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add extra derives to signed extensions Signed-off-by: Alexandru Vasile <[email protected]> * config: Use `Default::default` to simplify type init Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Replace removed lint (#1270) Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Add support for multi-chain usecase (#1238) * lightclient: Make `smoldot::chainID` part of the RPC requests Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Make `BackgroundTask` generic over `PlatformRef` and chain Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Construct from raw smoldot and target different chains Signed-off-by: Alexandru Vasile <[email protected]> * testing: Update cargo lock for wasm tests Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reuse `new_from_client` method and removed unused imports Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport smoldot client and RPC objects used in pub interface Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Adjust `new_from_client` interface Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Extend background to poll over multiple RPC objects Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Build light client from raw and target different chains Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Add demo chain specs Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Move artifacts to dedicated folder Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Use SelectAll to drive all streams Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Fetch initial data from the target chain Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport other smoldot objects Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Target chain with potentially different config Signed-off-by: Alexandru Vasile <[email protected]> * subxt/rpc: Log chainID for debugging Signed-off-by: Alexandru Vasile <[email protected]> * subxt/examples: Add smoldot client with parachain example Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Propagate chain ID together with rpc responses object Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Multiplex responses by request ID and chain ID Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add raw light client builder Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Add cargo feature flag for parachains example Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Derive default for internal structure Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Guard reexports by std feature flag Signed-off-by: Alexandru Vasile <[email protected]> * Update subxt/src/client/light_client/mod.rs Co-authored-by: James Wilson <[email protected]> * lightclient: Update the builder pattern and chain targetting Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Fix documentation Signed-off-by: Alexandru Vasile <[email protected]> * Provide more insightful docs wrt native/wasm panics Signed-off-by: Alexandru Vasile <[email protected]> * examples: Adjust comment location Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Refactor UniqueChainId into the background task Signed-off-by: Alexandru Vasile <[email protected]> * Update lightclient/src/background.rs Co-authored-by: Niklas Adolfsson <[email protected]> * Update subxt/src/client/light_client/builder.rs Co-authored-by: James Wilson <[email protected]> * lightclient: Update docs wrt panics Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Update docs wrt to smoldot instance -> client Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Use IntoIter instead of Iterator Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Adjsut docs wrt [`Self::new_from_client`] Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Remove RawRpc from LightClient in favor of chainID Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reexport everything under smoldot module Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Use stateRootHash instead of genesis.raw Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> Co-authored-by: James Wilson <[email protected]> Co-authored-by: Niklas Adolfsson <[email protected]> * Bump futures from 0.3.28 to 0.3.29 (#1272) Bumps [futures](https://github.com/rust-lang/futures-rs) from 0.3.28 to 0.3.29. - [Release notes](https://github.com/rust-lang/futures-rs/releases) - [Changelog](https://github.com/rust-lang/futures-rs/blob/master/CHANGELOG.md) - [Commits](rust-lang/futures-rs@0.3.28...0.3.29) --- updated-dependencies: - dependency-name: futures dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump zeroize from 1.6.0 to 1.7.0 (#1274) Bumps [zeroize](https://github.com/RustCrypto/utils) from 1.6.0 to 1.7.0. - [Commits](https://github.com/RustCrypto/utils/commits) --- updated-dependencies: - dependency-name: zeroize dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump tracing-subscriber from 0.3.17 to 0.3.18 (#1275) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.17 to 0.3.18. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](tokio-rs/tracing@tracing-subscriber-0.3.17...tracing-subscriber-0.3.18) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump tracing-subscriber from 0.3.17 to 0.3.18 (#1275) Bumps [tracing-subscriber](https://github.com/tokio-rs/tracing) from 0.3.17 to 0.3.18. - [Release notes](https://github.com/tokio-rs/tracing/releases) - [Commits](tokio-rs/tracing@tracing-subscriber-0.3.17...tracing-subscriber-0.3.18) --- updated-dependencies: - dependency-name: tracing-subscriber dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump getrandom from 0.2.10 to 0.2.11 (#1273) Bumps [getrandom](https://github.com/rust-random/getrandom) from 0.2.10 to 0.2.11. - [Changelog](https://github.com/rust-random/getrandom/blob/master/CHANGELOG.md) - [Commits](rust-random/getrandom@v0.2.10...v0.2.11) --- updated-dependencies: - dependency-name: getrandom dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * impl RpcClientT for Arc<T> and Box<T> (#1277) * impl RpcClientT for Arc<WsClient> * fix grumbles: impl for Box<T> and Arc<T> * grumbles: move RpcClientT impls * first iteration of using scale_typegen * introduce indoc for formatting * calls, constants and home are cleaner now * added event subcommand * show runtime apis working * add better code formatting * fix style * adjust tests, use owo_colorize to not add extra dependency * fmt * adjust docs * move scale-typegen-description dependency to workspace * improve `substrate-compat` (#1265) * improve `substrate-compat` * From => Into --------- Co-authored-by: James Wilson <[email protected]> * Bump proc-macro2 from 1.0.69 to 1.0.70 (#1292) Bumps [proc-macro2](https://github.com/dtolnay/proc-macro2) from 1.0.69 to 1.0.70. - [Release notes](https://github.com/dtolnay/proc-macro2/releases) - [Commits](dtolnay/proc-macro2@1.0.69...1.0.70) --- updated-dependencies: - dependency-name: proc-macro2 dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Bump serde from 1.0.192 to 1.0.193 (#1291) Bumps [serde](https://github.com/serde-rs/serde) from 1.0.192 to 1.0.193. - [Release notes](https://github.com/serde-rs/serde/releases) - [Commits](serde-rs/serde@v1.0.192...v1.0.193) --- updated-dependencies: - dependency-name: serde dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * lightclient: Fix wasm socket closure called after being dropped (#1289) * lightclient: Close wasm socket while dropping from connecting state Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Construct one time only closures Signed-off-by: Alexandru Vasile <[email protected]> * testing: Enable console logs for lightclient WASM testing Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Separate wakes and check connectivity on poll_read Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket depending on internal state Signed-off-by: Alexandru Vasile <[email protected]> * Revert "lightclient: Separate wakes and check connectivity on poll_read" This reverts commit 8660940. * lightclient: Return pending if socket is opening from poll_read Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket on `poll_close` Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Reset closures on Drop to avoid recursive invokation Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Close the socket if not already closing Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * workflows: Install rustup component for building substrate (#1295) Signed-off-by: Alexandru Vasile <[email protected]> * cli: Command to fetch chainSpec and optimise its size (#1278) * cli: Add chainSpec command Signed-off-by: Alexandru Vasile <[email protected]> * cli/chainSpec: Move to dedicated module Signed-off-by: Alexandru Vasile <[email protected]> * cli: Compute the state root hash Signed-off-by: Alexandru Vasile <[email protected]> * cli: Remove code substitutes Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Update polkadot.json Signed-off-by: Alexandru Vasile <[email protected]> * scripts: Generate the chain spec Signed-off-by: Alexandru Vasile <[email protected]> * cli: Remove testing artifacts Signed-off-by: Alexandru Vasile <[email protected]> * cli: Fix clippy Signed-off-by: Alexandru Vasile <[email protected]> * cli: Apply rustfmt Signed-off-by: Alexandru Vasile <[email protected]> * cli: Introduce feature flag for smoldot dependency Signed-off-by: Alexandru Vasile <[email protected]> * cli: Rename chain-spec to chain-spec-pruning Signed-off-by: Alexandru Vasile <[email protected]> * scripts: Update chain-spec command Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * update to new scale-typegen interfaces * use released version of scale-typegen * Merge branch 'master' into tadeohepperle/cli-support-runtime-apis * remove unused debug file * resolve merge errors * adjustments * constants file adjustment * method renaming * fix issue with encoding runtime api params * Add logging to submit_transaction and unstable driver, and ensure unpin evs complete * panic if None returned from subscription too, also with stats * change panic to Err just to be on the safe side * clippy * make long tests run only after clippy + fmt pass * megre in light client test change pr * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script * lightclient(fix): Ensure lightclient chainSpec is at least one block old (#1372) * testing(fix): Ensure lightclient chainSpec is at least one block old Signed-off-by: Alexandru Vasile <[email protected]> * Revert "testing(fix): Ensure lightclient chainSpec is at least one block old" This reverts commit 0eafcb2. * lightclient(fix): Ensure lightclient chainSpec is at least one block old Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Link smoldot issue Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Use tokio under lightclient feature flag Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Do not sleep on errors to fetch the chainSpec Signed-off-by: Alexandru Vasile <[email protected]> * artifacts: Remove test file Signed-off-by: Alexandru Vasile <[email protected]> * lightclient: Subscribe to two finalized blocks Signed-off-by: Alexandru Vasile <[email protected]> * subxt: Revert cargo toml Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * ci: Reduce the light client timeout to 15 minutes (#1373) * ci: Reduce the light client timpeut to 15 seconds Signed-off-by: Alexandru Vasile <[email protected]> * ci: Use ubuntu-latest for light-client tests Signed-off-by: Alexandru Vasile <[email protected]> --------- Signed-off-by: Alexandru Vasile <[email protected]> * actually only wait for machete+fmt, clippy can be much slower * update CI file from Alex PR * resolve clippy err * Try a few RPC nodes in case one of them is not working * fix submit_transaction debug logging of message * Improve Signed Extension and Block Decoding Examples/Book (#1357) * asset hub example and book adjustment * formatting * recursive derives * polkadot monitor example and book adjustments * formatting * adjust docs and examples, add dynamic example * james suggestions * fmt * chore(subxt/src): typo fix (#1370) * rpcmethods * followstr * mod and else * Weekly Cronjob fetching artifacts and generating polkadot.rs file. (#1352) * github CI action cronjob * add commit message * fix the CI yml files * binary crate for CI script with substrate-runner * update the CI script * correct the artifacts script * remove bash script --------- Co-authored-by: James Wilson <[email protected]> Co-authored-by: Pan chao <[email protected]> * fix formatting of returned sections * add recursive derive and attribute options in the cli * format tuples uncaught * add tests and rename type map parser * make parsing more strict --------- Signed-off-by: Alexandru Vasile <[email protected]> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: Alexandru Vasile <[email protected]> Co-authored-by: James Wilson <[email protected]> Co-authored-by: Niklas Adolfsson <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: yjh <[email protected]> Co-authored-by: Pan chao <[email protected]>

tadeohepperle added 4 commits January 9, 2024 18:48

github CI action cronjob

3147c4e

add commit message

f5814e9

Merge branch 'master' into tadeohepperle/weekly-ci-script

96c705b

fix the CI yml files

36f1494

tadeohepperle marked this pull request as ready for review January 10, 2024 12:09

tadeohepperle requested review from a team as code owners January 10, 2024 12:09

tadeohepperle commented Jan 10, 2024

View reviewed changes

niklasad1 reviewed Jan 10, 2024

View reviewed changes

.github/workflows/update-artifacts.yml Outdated Show resolved Hide resolved

niklasad1 reviewed Jan 10, 2024

View reviewed changes

.github/workflows/update-artifacts.yml Outdated Show resolved Hide resolved

tadeohepperle added 2 commits January 11, 2024 14:22

binary crate for CI script with substrate-runner

1d730ed

update the CI script

0fe8158

niklasad1 reviewed Jan 11, 2024

View reviewed changes

scripts/artifacts.sh Outdated Show resolved Hide resolved

niklasad1 reviewed Jan 11, 2024

View reviewed changes

scripts/artifacts.sh Outdated Show resolved Hide resolved

niklasad1 reviewed Jan 11, 2024

View reviewed changes

niklasad1 approved these changes Jan 11, 2024

View reviewed changes

correct the artifacts script

a3c7899

jsdw reviewed Jan 15, 2024

View reviewed changes

remove bash script

2bccb27

sergejparity approved these changes Jan 16, 2024

View reviewed changes

tadeohepperle added 2 commits January 16, 2024 18:57

Merge branch 'master' into tadeohepperle/weekly-ci-script

0c79d6c

Merge branch 'master' into tadeohepperle/weekly-ci-script

46e34ff

jsdw approved these changes Jan 17, 2024

View reviewed changes

tadeohepperle merged commit ab6b6ae into master Jan 17, 2024
10 checks passed

tadeohepperle deleted the tadeohepperle/weekly-ci-script branch January 17, 2024 11:28

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Weekly Cronjob fetching artifacts and generating polkadot.rs file. #1352

Weekly Cronjob fetching artifacts and generating polkadot.rs file. #1352

tadeohepperle commented Jan 9, 2024 •

edited

Loading

tadeohepperle Jan 10, 2024

niklasad1 Jan 11, 2024

jsdw Jan 15, 2024

niklasad1 left a comment

jsdw Jan 15, 2024

tadeohepperle Jan 15, 2024

jsdw Jan 16, 2024

jsdw left a comment

Weekly Cronjob fetching artifacts and generating polkadot.rs file. #1352

Weekly Cronjob fetching artifacts and generating polkadot.rs file. #1352

Conversation

tadeohepperle commented Jan 9, 2024 • edited Loading

tadeohepperle Jan 10, 2024

Choose a reason for hiding this comment

niklasad1 Jan 11, 2024

Choose a reason for hiding this comment

jsdw Jan 15, 2024

Choose a reason for hiding this comment

niklasad1 left a comment

Choose a reason for hiding this comment

jsdw Jan 15, 2024

Choose a reason for hiding this comment

tadeohepperle Jan 15, 2024

Choose a reason for hiding this comment

jsdw Jan 16, 2024

Choose a reason for hiding this comment

jsdw left a comment

Choose a reason for hiding this comment

tadeohepperle commented Jan 9, 2024 •

edited

Loading