Update Rust crate tokenizers to v0.23.2 #11

Merged
renovate merged 1 commit from renovate/tokenizers-0.x-lockfile into main 2026-09-03 09:33:47 +00:00
Collaborator

This PR contains the following updates:

Package Type Update Change
tokenizers dependencies patch 0.23.1 → 0.23.2

Release Notes

huggingface/tokenizers (tokenizers)

v0.23.2

Compare Source


Configuration

📅 Schedule: (UTC)

  • Branch creation
    • At any time (no schedule defined)
  • Automerge
    • At any time (no schedule defined)

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR is behind base branch, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate CLI.

This PR contains the following updates: | Package | Type | Update | Change | |---|---|---|---| | [tokenizers](https://github.com/huggingface/tokenizers) | dependencies | patch | `0.23.1` → `0.23.2` | --- ### Release Notes <details> <summary>huggingface/tokenizers (tokenizers)</summary> ### [`v0.23.2`](https://github.com/huggingface/tokenizers/compare/v0.23.1...v0.23.2) [Compare Source](https://github.com/huggingface/tokenizers/compare/v0.23.1...v0.23.2) </details> --- ### Configuration 📅 **Schedule**: (UTC) - Branch creation - At any time (no schedule defined) - Automerge - At any time (no schedule defined) 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR is behind base branch, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Mend Renovate CLI](https://github.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiI0NC42MS4xIiwidXBkYXRlZEluVmVyIjoiNDQuNjEuMSIsInRhcmdldEJyYW5jaCI6Im1haW4iLCJsYWJlbHMiOltdfQ==-->
Update Rust crate tokenizers to v0.23.2
All checks were successful
ci / python-tests (pull_request) Successful in 9s
ci / rust-tests (pull_request) Successful in 43s
75f77aeb4e
renovate scheduled this pull request to auto merge when all checks succeed 2026-09-03 09:33:33 +00:00
renovate deleted branch renovate/tokenizers-0.x-lockfile 2026-09-03 09:33:49 +00:00
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
nomynous/tokencounter!11
No description provided.