Metadata-Version: 2.1
Name: mm-tokenizer
Version: 0.1.0
Summary: 
Author: hud
Author-email: hudwahab@gmail.com
Requires-Python: >=3.9,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: pytest (>=7.4.2,<8.0.0)
Requires-Dist: sentencepiece (>=0.1.99,<0.2.0)
Requires-Dist: torch (>=2.1.0,<3.0.0)
Requires-Dist: transformers (==4.6.0)
Description-Content-Type: text/markdown

# MM tokenizer plugin

MM tokenizer class module. Once enabled, it allows you to use the MM tokenizer as ImageSpec in your Flyte tasks.

To install the plugin, run the following command:

```bash
pip install flytekitplugins-athena
```

