jaakko eb6f720fcc Wasm tokenize_js() exportti oppaan live-tokenizeria varten
Lisätty #[wasm_bindgen] tokenize_js(text) → JSON-funktio joka lataa
tokenizerin IndexedDB:stä tai HuggingFacesta tarvittaessa.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-04-07 13:18:07 +03:00
2026-04-06 13:40:19 +03:00
Description
No description provided
146 MiB
Languages
HTML 51.2%
Astro 22.4%
Rust 11.9%
JavaScript 8.7%
CSS 2.4%
Other 3.4%