Metadata-Version: 2.1
Name: mm-tokenizer
Version: 0.4.0
Summary: 
Author: hud
Author-email: hudwahab@gmail.com
Requires-Python: >=3.9,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: pytest (>=7.4.2,<8.0.0)
Requires-Dist: sentencepiece (>=0.1.99,<0.2.0)
Requires-Dist: torch (==2.0.1)
Requires-Dist: transformers (==4.33.2)
Description-Content-Type: text/markdown

# MM tokenizer plugin

MM tokenizer class module. Once enabled, it allows you to use the MM tokenizer as ImageSpec in your Flyte tasks.

To install the plugin, run the following command:

```bash
pip install mm-tokenizer
```

