Metadata-Version: 2.1
Name: niuload
Version: 0.1.6
Summary: A module for balanced loading of large language models
Home-page: https://github.com/rangehow/niuload
Author: rangehow
Author-email: rangehow@outlook.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.6
Description-Content-Type: text/markdown
Requires-Dist: accelerate
Requires-Dist: transformers
Requires-Dist: torch

# niuload

niuload is a Python module for balanced loading of large language models across multiple GPUs.
This package can be used during training and inference.

