Metadata-Version: 2.1
Name: hydra-lsf-launcher
Version: 0.1.2
Summary: Lsf Hydra Launcher plugin
Author: Francesco Spinnato
Author-email: francesco.spinnato@di.unipi.it
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Operating System :: OS Independent
Description-Content-Type: text/markdown
Requires-Dist: hydra-core

# hydra-lsf-launcher
This is a simple launcher for launching Hydra jobs on LSF clusters. It is a simple wrapper around the `bsub` command that allows you to launch Hydra jobs with a single command.

### **WARNING: expect bugs and run at your own risk. This is not an official Hydra project.**

## Installation
Install the package with pip:
```bash
pip install hydra-lsf-launcher
```

## Usage

Here is an example using `hydra-zen` to launch a job on an LSF cluster:

```python
from hydra_zen import store, zen
import time


def main_func(sentence):
    time.sleep(120)
    print(sentence)


store(
    main_func,
    hydra_defaults=[
            "_self_",
    ]
)


if __name__ == "__main__":
    store.add_to_hydra_store()
    zen(main_func).hydra_main(
        config_name="main_func", version_base="1.1", config_path=None
    )
```

Then you can run it with:

```bash
python myscript.py hydra/launcher=lsf sentence="Hello World!" -m 
```

## Job groups

To limit the number of concurrent jobs, as for now job arrays are not supported, the user can set job groups:

```bash
bgadd /myJobGroup
bgmod -L 4 /myJobGroup  # limit to 4 concurrent jobs
```



Then you can run it with:

```bash
python myscript.py hydra/launcher=lsf hydra.launcher.bsub_args="-g /myJobGroup" sentence="Hello World!" -m 
```

Some useful commands.
To change the limit of a job group:
```bash
bgmod -L <new_limit> /myJobGroup
```

To delete a job group:
```bash
bgdel /myJobGroup
```


## More complex examples
Run 5 jobs (4 parallel), each with 2GB of memory, and 4 cores from 2 different nodes.

```bash
python myscript.py hydra/launcher=lsf hydra.launcher.verbose=False hydra.launcher.n=4 'hydra.launcher.bsub_args= -g /myJobGroup -R span\[ptile\=2\]' hydra.launcher.M="2GB" sentence="Hello World!,Hello World!,Hello World!,Hello World!,Hello World!" -m
```
