Metadata-Version: 2.1
Name: medplexity
Version: 0.1.0
Summary: medplexity helps with evaluation of LLMs for medical use-cases.
Author: MaksymPetyak
Author-email: petyak.mi@gmail.com
Requires-Python: >=3.10,<4.0
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Requires-Dist: datasets (>=2.14.5,<3.0.0)
Requires-Dist: openai (>=0.28.0,<0.29.0)
Requires-Dist: pydantic (>=2.3.0,<3.0.0)
Description-Content-Type: text/markdown

## Medplexity

Medplexity is a python library to help with evaluation of LLMs for medical applications.
It is designed to help with the following tasks
- Evaluating performance of LLMs on existing medical datasets and benchmarks. E.g. MedQA, PubMedQA, etc.
- Compare performance of different prompts, models, and architectures.

For example, we can help answer questions like "How much better would GPT-4 perform if it also would load relevant paragraphs from research?".


## 🔧 Quick install
```bash
pip install medplexity
```

## Example
See `/noteboks/MedMCQA.ipynb` for a full example with MedMCQA dataset.


## 📜 License
Medplexity is licensed under the MIT License. See the LICENSE file for more details.

