Metadata-Version: 2.1
Name: imitater
Version: 0.1.0
Home-page: https://github.com/the-seeds/imitater
Author: the-seeds
License: Apache 2.0 License
Keywords: LLM
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Education
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8.0
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: transformers
Requires-Dist: sse-starlette
Requires-Dist: vllm
Requires-Dist: pydantic>=2.0.0

# Imitater

Create a `.env` file in the root directory:

```
.
├── src
└── .env
```

```
# imitater
CHAT_MODEL=path_to_chat_model
EMBED_MODEL=path_to_bge_model
EMBED_BATCH_SIZE=16
ENABLE_ATTN_BIAS=0

# tests
OPENAI_BASE_URL=http://192.168.0.1:8000/v1
OPENAI_API_KEY=0
```

## Launch Server

```bash
python src/launch.py
```

## Test Server

```bash
python tests/test_openai.py
```
