Metadata-Version: 2.4
Name: vllm-inference
Version: 0.0.17
Summary: Inference locally.
Requires-Python: >=3.10
Description-Content-Type: text/markdown
Requires-Dist: fastapi>=0.116.1
Requires-Dist: transformers==4.51.3
Requires-Dist: uvicorn>=0.35.0
Requires-Dist: vllm>=0.8.5.post1
Requires-Dist: vortezwohl>=0.0.8

# LLM Inference, 开箱即用的本地 LLM 推理 SDK

## 安装

- pip

    ```
    pip install git+https://gitlab.changdu.ltd/060270/llm_inference.git@main
    ```

- uv

    ```
    uv add git+https://gitlab.changdu.ltd/060270/llm_inference.git@main
    ```

## 主要功能

1. ### Seed-X 机器翻译
    
    ```python
    from vllm_inference.translation.seed_x import translate
    ```

    ```python
    translation = translate('你好, 我叫吴子豪!', 'fr', max_tokens=2048, temperature=.0, top_p=.01)
    ```
    
