Metadata-Version: 2.4
Name: tfmx
Version: 0.6.3
Summary: Serve Transformers in one line
Author: Hansimov
License-Expression: MIT
Project-URL: Homepage, https://github.com/Hansimov/tfmx
Project-URL: Issues, https://github.com/Hansimov/tfmx/issues
Classifier: Programming Language :: Python :: 3
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: tclogger
Requires-Dist: numpy
Requires-Dist: requests
Requires-Dist: fastapi
Requires-Dist: uvicorn
Requires-Dist: httpx
Requires-Dist: webu
Requires-Dist: orjson
Dynamic: license-file

# tfmx

![](https://img.shields.io/pypi/v/tfmx?label=tfmx&color=blue&cacheSeconds=60)

## Install

```sh
pip install tfmx --upgrade
```

## Commands

Set GPU control state:

```sh
gpu_fan -cs a:1
```

Set GPU power limit:

```sh
# M-X
gpu_pow -pm a:1 && gpu_pow -pl 0:220

# M-A GPU-1/2
# gpu_pow -pm a:1 && gpu_pow -pl a:220
gpu_pow -pm a:1 && gpu_pow -pl 0,1:160
```

Set GPU fan speed:

```sh
gpu_fan -fs a:100
```

Set GPU monitor with curve:

```sh
# gpu_mon -c "a:30-50/50-65/60-80/75-100;3,7:25-100" -s
```

Run tei compose and machine:

```sh
tei_compose up && sleep 20 && tei_machine run --perf-track
```

Run tei benchmark:

```sh
tei_benchmark -E "http://localhost:28800" -n 1000000 run
```
