compile error 0.4.0

[sopaco]

Minimum reproducible example

compile error
depend on mistralrs = { git = "https://github.com/EricLBuehler/mistral.rs.git", features = ["metal", "accelerate"], tag = "v0.4.0" }

Error

Compiling mistralrs-core v0.4.0 (https://github.com/EricLBuehler/mistral.rs.git?tag=v0.4.0#f1a56f60)
error[E0308]: mismatched types
--> /Users/mindstation/.cargo/git/checkouts/mistral.rs-0a2607fe9768eac5/f1a56f6/mistralrs-core/src/pipeline/llg.rs:15:67
|
15 | let bt = toktrie_hf_tokenizers::ByteTokenizer::from_tokenizer(tokenizer)
| ---------------------------------------------------- ^^^^^^^^^ expected tokenizers::tokenizer::Tokenizer, found Tokenizer
| |
| arguments to this function are incorrect
|
= note: Tokenizer and tokenizers::tokenizer::Tokenizer have similar names, but are actually distinct types
note: Tokenizer is defined in crate tokenizers
--> /Users/mindstation/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokenizers-0.21.0/src/tokenizer/mod.rs:408:1
|
408 | pub struct Tokenizer(
| ^^^^^^^^^^^^^^^^^^^^
note: tokenizers::tokenizer::Tokenizer is defined in crate tokenizers
--> /Users/mindstation/.cargo/registry/src/index.crates.io-6f17d22bba15001f/tokenizers-0.20.4/src/tokenizer/mod.rs:408:1
|
408 | pub struct Tokenizer(
| ^^^^^^^^^^^^^^^^^^^^
= note: perhaps two different versions of crate tokenizers are being used?
note: associated function defined here
--> /Users/mindstation/.cargo/git/checkouts/llguidance-fc2ad2787f3486eb/cfef3df/toktrie_hf_tokenizers/src/lib.rs:72:12
|
72 | pub fn from_tokenizer(mut hft: Tokenizer) -> Result {
| ^^^^^^^^^^^^^^

For more information about this error, try rustc --explain E0308.
error: could not compile mistralrs-core (lib) due to 1 previous error

Other information

Please specify:

• Operating system: MacOS
• GPU or accelerator information: M2 Pro

[EricLBuehler]

@sopaco I cannot reproduce this, can you please run cargo update to ensure you are using the latest versions? If that fails, can you please run cargo tree?