Metadata-Version: 2.0
Name: llm-optimized-inference
Version: 0.1.1
Home-page: 
Author: Microsoft
Author-email: 
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.8
Requires-Python: >=3.8
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: deepspeed==0.12.5
Requires-Dist: deepspeed-mii==0.1.3
Requires-Dist: vllm==0.2.7
Requires-Dist: deepspeed-kernels==0.0.1.dev1698255861
Requires-Dist: diffusers==0.23.0
Requires-Dist: pandas~=2.1.4
Requires-Dist: transformers~=4.38.0
Requires-Dist: aiolimiter~=1.1.0
Requires-Dist: azure-ai-contentsafety==1.0.0b1
Requires-Dist: azure-ai-ml==1.12.1
Requires-Dist: azure-identity==1.15.0
Requires-Dist: azureml-ai-monitoring==0.1.0b4
Requires-Dist: azureml-inference-server-http
Requires-Dist: azureml-mlflow
Requires-Dist: cryptography~=42.0.4
Requires-Dist: certifi==2023.11.17
Requires-Dist: requests~=2.31.0
Requires-Dist: aiohttp~=3.9.1
Requires-Dist: torch~=2.1.2
Provides-Extra: dev
Requires-Dist: pytest; extra == "dev"
Requires-Dist: deepspeed (==0.12.5)
Requires-Dist: deepspeed-mii (==0.1.3)
Requires-Dist: vllm (==0.2.7)
Requires-Dist: deepspeed-kernels (==0.0.1.dev1698255861)
Requires-Dist: diffusers (==0.23.0)
Requires-Dist: pandas (~=2.1.4)
Requires-Dist: transformers (~=4.38.0)
Requires-Dist: aiolimiter (~=1.1.0)
Requires-Dist: azure-ai-contentsafety (==1.0.0b1)
Requires-Dist: azure-ai-ml (==1.12.1)
Requires-Dist: azure-identity (==1.15.0)
Requires-Dist: azureml-ai-monitoring (==0.1.0b4)
Requires-Dist: azureml-inference-server-http
Requires-Dist: azureml-mlflow
Requires-Dist: cryptography (~=42.0.4)
Requires-Dist: certifi (==2023.11.17)
Requires-Dist: requests (~=2.31.0)
Requires-Dist: aiohttp (~=3.9.1)
Requires-Dist: torch (~=2.1.2)
Provides-Extra: dev
Requires-Dist: pytest; extra == 'dev'

# Foundation Model Inferencing


### Setting up Pre-commit for this Repository

Pre-commit helps to manage and maintain code quality by running hooks that perform various checks before a commit is made.

To set up pre-commit for this repository, follow these steps:

1. Install pre-commit. If you're using pip, you can do this by running:
    ```
    pip install pre-commit
    ```

2. Navigate to the root directory of the repository where the .pre-commit-config.yaml file is located.

3. Run the following command to install the git hook scripts:
    ```
    pre-commit install
    ```

Now, pre-commit will run automatically on git commit. If you want to manually run all pre-commit hooks on a repository, run:
    ```
    pre-commit run --all-files
    ```

To run a specific pre-commit hook on all files, you can use the run command followed by the ID of the hook. Here's the general syntax:
    ```
    pre-commit run <hook_id> --all-files
    ```

For example, if you want to run the black hook on all files, you would use:
    ```
    pre-commit run black --all-files
    ```

This command will run the black hook on every file in your repository.


### Hooks Used in this Repository

This repository uses a variety of hooks to maintain code quality:

- check-added-large-files: Prevents committing large files.
- end-of-file-fixer: Ensures files end with a newline.
- trailing-whitespace: Removes trailing whitespace.
- check-ast: Checks Python AST for syntax errors.
- check-docstring-first: Ensures the first thing in a Python file is a docstring.
- isort: Sorts Python imports.
- add-trailing-comma: Adds trailing commas to Python data structures.
- black: Formats Python code to conform to the PEP 8 style guide.
- flake8: Lints Python code for errors and code style violations.
- pydocstyle: Checks Python docstring conventions.

These hooks are run automatically before each commit once pre-commit is installed.
