discourse-mirrors/discourse-ai
0
0
Fork 0
mirror of https://ghfast.top/https://github.com/discourse/discourse-ai.git synced 2026-07-18 11:49:33 +08:00
Code Issues Projects Releases Packages Wiki Activity Actions
discourse-ai/tokenizers/README.md
Rafael dos Santos Silva 3c9513e754
Refinements to embeddings and tokenizers (#61) 
* Refinements to embeddings and tokenizers

* lint

* Truncate with tokenizers for summary

* fix
2023-05-15 15:10:42 -03:00

117 B
Raw Permalink Blame History

bert-base-uncased.json

Licensed under Apache License

claude-v1-tokenization.json

Licensed under MIT License