Metadata-Version: 2.1
Name: twigs
Version: 1.1.60
Summary: ThreatWorx Information Gathering Script
Home-page: https://github.com/threatworx/twigs
Author: Paresh Borkar
Author-email: opensource@threatwatch.io
License: GNU General Public License v3
Keywords: twigs
Platform: UNKNOWN
Classifier: Development Status :: 2 - Pre-Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: GNU General Public License v3 (GPLv3)
Classifier: Natural Language :: English
Classifier: Programming Language :: Python :: 2
Classifier: Programming Language :: Python :: 2.7
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.4
Classifier: Programming Language :: Python :: 3.5
Classifier: Programming Language :: Python :: 3.6
Classifier: Programming Language :: Python :: 3.7
License-File: LICENSE
License-File: AUTHORS.rst

=====
twigs
=====


.. image:: https://img.shields.io/pypi/v/twigs.svg
        :target: https://pypi.python.org/pypi/twigs

.. image:: https://readthedocs.org/projects/twigs/badge/?version=latest
        :target: https://twigs.readthedocs.io/en/latest/?badge=latest
        :alt: Documentation Status
.. image:: https://github.com/threatworx/twigs/actions/workflows/build.yml/badge.svg
        :target: https://github.com/threatworx/twigs/actions/workflows/build.yml
        :alt: twigs build

ThreatWorx Information Gathering Script

https://threatworx.io/twigs-user-guide/

* Free software: GNU General Public License v3
* Documentation: https://twigs.readthedocs.io
* User guide: https://threatworx.io/twigs-user-guide


Features
--------

twigs.py - A python script to discover various types of assets (cloud-based, Linux hosts, containers, repositories and more).

Note:
1. twigs supports python 2.7 onwards and python 3.x versions
2. It is recommended to use virtual environments to create isolated Python environments and reduce dependency conflicts. Please use the following commands to create new virtual environment and install twigs:

Python 2.7 Virtual Environment:

python -m virtualenv --python=/usr/bin/python2.7 twigs_env_2_7

cd twigs_env_2_7

source bin/activate

pip install twigs


Python 3.x Virtual Environment:

python3 -m venv twigs_env

cd twigs_env

source bin/activate

pip3 install twigs


$ twigs --help
usage: twigs [-h] [--version] [--handle HANDLE] [--token TOKEN] [--instance INSTANCE] [--run_id RUN_ID] [--location LOCATION] [--create_empty_asset] [--tag_critical] [--tag TAG] [--owner OWNER] [--no_auto_tags] [--apply_policy APPLY_POLICY] [--sbom SBOM] [--no_scan] [--email_report] [-q | -v] [--schedule SCHEDULE] [--encoding ENCODING] {login,logout,aws,azure,gcp,ecr,acr,gcr,docker,k8s,repo,ghe,azure_functions,gcloud_functions,host,vmware,nmap,sbom,servicenow,dast,ssl_audit,aws_cis,aws_audit,azure_cis,gcp_cis,oci_cis,docker_cis,k8s_cis,gke_cis,o365}

ThreatWorx Information Gathering Script (twigs) to discover assets like hosts, cloud instances, containers and opensource projects

optional arguments:
  -h, --help            show this help message and exit
  --version         show program's version number and exit
  --handle HANDLE       The ThreatWorx registered email id/handle of the
                        user. Note this can set as "TW_HANDLE" environment
                        variable
  --token TOKEN         The ThreatWorx API token of the user. Note this can
                        be set as "TW_TOKEN" environment variable
  --instance INSTANCE   The ThreatWorx instance. Note this can be set as 
                        "TW_INSTANCE" environment variable
  --run_id RUN_ID       Specify a distinct identifier for this twigs discovery
                        run
  --location LOCATION   Specify location information for discovered asset(s).
  --create_empty_asset  Create empty asset even if nothing is discovered.
                        Applicable to source code (repo) assets.
  --tag_critical        Tag the discovered asset(s) as critical
  --tag TAG             Add specified tag to discovered asset(s). You can
                        specify this option multiple times to add multiple
                        tags
  --owner OWNER         Add additional owner(s) to discovered asset(s). You
                        can specify this option multiple times to add multiple
                        owners. Note user discovering the asset is added as
                        owner by default
  --no_auto_tags        Disable auto tagging of assets with standard
                        classification tags. Only user specified tags will be
                        applied
  --apply_policy APPLY_POLICY
                        One or more policy names as a comma-separated list
  --sbom SBOM           Specify name of the SBOM file to hold the exported
                        asset information.
  --no_scan             Do not initiate a baseline assessment
  --email_report        After impact refresh is complete email scan report to
                        self
  --quiet               Disable verbose logging
  -v, --verbosity       Specify the verbosity level. Use multiple times to
                        increase verbosity level
  --schedule SCHEDULE   Run this twigs command at specified schedule (crontab format)
  --encoding ENCODING   Specify the encoding. Default is "latin-1"

modes:
  Discovery modes supported

{login,logout,aws,azure,gcp,ecr,acr,gcr,docker,k8s,repo,ghe,azure_functions,gcloud_functions,host,vmware,nmap,sbom,servicenow,dast,ssl_audit,aws_cis,aws_audit,azure_cis,gcp_cis,oci_cis,docker_cis,k8s_cis,gke_cis,o365}

    login               Login to twigs
    logout              Logout from twigs
    aws                 Discover AWS instances
    azure               Discover Azure instances
    gcp                 Discover Google Cloud Platform instances
    ecr                 Discover AWS Container Registry images
    acr                 Discover Azure Container Registry images
    gcr                 Discover Google Cloud Registry images
    docker              Discover docker instances
    k8s                 Discover Kubernetes environment
    repo                Discover source code repository as asset
    ghe                 Discover GitHub Enterprise repositories as assets
    azure_functions     Discover and scan Azure Functions soure code
    gcloud_functions    Discover and scan Google Cloud Functions soure code
    host                Discover linux host assets
    vmware              Discover VMware vCenter/ESX assets
    nmap                Discover assets using nmap
    sbom                Ingest asset inventory from SBOM (Software Bill Of Materials)
    servicenow          Ingest inventory from ServiceNow CMDB
    dast                Discover and test web application using a DAST plugin
    ssl_audit           Run SSL audit tests against your web URLs
    aws_cis             Run AWS CIS benchmarks
    aws_audit           Run AWS audit checks including PCI, GDPR, HIPAA
    azure_cis           Run Azure CIS benchmarks
    gcp_cis             Run Google Cloud Platform CIS benchmarks
    oci_cis             Run Oracle Cloud Infrastructure CIS benchmarks
    docker_cis          Run docker CIS benchmarks
    k8s_cis             Run Kubernetes CIS benchmarks
    gke_cis             Run GKE CIS benchmarks

Mode: login
usage: twigs login [-h]

optional arguments:
  -h, --help  show this help message and exit

Mode: logout
usage: twigs logout [-h]

optional arguments:
  -h, --help  show this help message and exit

Mode: aws
$ twigs aws --help
usage: twigs aws [-h] --aws_account AWS_ACCOUNT --aws_access_key AWS_ACCESS_KEY --aws_secret_key AWS_SECRET_KEY --aws_region AWS_REGION --aws_s3_bucket AWS_S3_BUCKET [--enable_tracking_tags]

optional arguments:
  -h, --help            show this help message and exit
  --aws_account AWS_ACCOUNT
                        AWS account ID
  --aws_access_key AWS_ACCESS_KEY
                        AWS access key
  --aws_secret_key AWS_SECRET_KEY
                        AWS secret key
  --aws_region AWS_REGION
                        AWS region
  --aws_s3_bucket AWS_S3_BUCKET
                        AWS S3 inventory bucket
  --enable_tracking_tags
                        Enable recording AWS specific information (like AWS
                        Account ID, etc.) as asset tags

Help video: https://youtu.be/pYzHU7izRdU

Mode: aws_cis
$ twigs aws_cis --help
usage: twigs aws_cis [-h] --aws_access_key AWS_ACCESS_KEY --aws_secret_key AWS_SECRET_KEY --assetid ASSETID [--assetname ASSETNAME] [--prowler_home PROWLER_HOME]

optional arguments:
  -h, --help            show this help message and exit
  --aws_access_key AWS_ACCESS_KEY
                        AWS access key
  --aws_secret_key AWS_SECRET_KEY
                        AWS secret key
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --prowler_home PROWLER_HOME
                        Location of cloned prowler github repo. Defaults to
                        /usr/share/prowler

Mode: aws_audit
$ twigs aws_audit --help
usage: twigs aws_audit [-h] --aws_access_key AWS_ACCESS_KEY --aws_secret_key AWS_SECRET_KEY --assetid ASSETID [--assetname ASSETNAME] [--prowler_home PROWLER_HOME]

optional arguments:
  -h, --help            show this help message and exit
  --aws_access_key AWS_ACCESS_KEY
                        AWS access key
  --aws_secret_key AWS_SECRET_KEY
                        AWS secret key
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --prowler_home PROWLER_HOME
                        Location of cloned prowler github repo. Defaults to
                        /usr/share/prowler

Mode: ecr
$ twigs ecr --help
usage: twigs ecr [-h] [--registry REGISTRY] [--image IMAGE] [--repository_type {public,private}] [--tmp_dir TMP_DIR] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help            show this help message and exit
  --registry REGISTRY   The AWS Container Registry (AWS account ID) which
                        needs to be inspected for all repositories.
  --image IMAGE         The fully qualified image name (repositoryUri with
                        optional tag) to be inspected. If tag is not given,
                        latest will be determined for all images under this
                        repository
  --repository_type REPOSITORY_TYPE
                        Specify repository type (public/private). Defaults to
                        private repositories if not specified
  --tmp_dir TMP_DIR     Temporary directory. Defaults to /tmp
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Mode: azure
$ twigs azure --help
usage: twigs azure [-h]  --azure_tenant_id AZURE_TENANT_ID --azure_application_id AZURE_APPLICATION_ID --azure_application_key AZURE_APPLICATION_KEY [--azure_subscription AZURE_SUBSCRIPTION] [--azure_resource_group AZURE_RESOURCE_GROUP] [--azure_workspace AZURE_WORKSPACE] [--enable_tracking_tags]

optional arguments:
  -h, --help            show this help message and exit
  --azure_tenant_id AZURE_TENANT_ID
                        Azure Tenant ID
  --azure_application_id AZURE_APPLICATION_ID
                        Azure Application ID
  --azure_application_key AZURE_APPLICATION_KEY
                        Azure Application Key
  --azure_subscription AZURE_SUBSCRIPTION
                        Azure Subscription. If not specified, then available
                        values will be displayed
  --azure_resource_group AZURE_RESOURCE_GROUP
                        Azure Resource Group. If not specified, then available
                        values will be displayed
  --azure_workspace AZURE_WORKSPACE
                        Azure Workspace. If not specified, then available
                        values will be displayed
  --enable_tracking_tags
                        Enable recording Azure specific information (like
                        Azure Tenant ID, etc.) as asset tags

Help video: https://youtu.be/DyMrxYscADw

Mode: azure_cis
$ twigs azure_cis --help
usage: twigs azure_cis [-h] --assetid ASSETID [--assetname ASSETNAME]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset

Mode: acr
$ twigs acr --help
usage: twigs acr [-h] [--registry REGISTRY] [--image IMAGE] [--tmp_dir TMP_DIR] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help           show this help message and exit
  --registry REGISTRY  The Azure Container Registry which needs to be
                       inspected.
  --image IMAGE        The fully qualified image name (with tag) which needs
                       to be inspected. If tag is not given, latest will be
                       determined and used.
  --tmp_dir TMP_DIR    Temporary directory. Defaults to /tmp
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Mode: azure_functions
$ twigs azure_functions --help
usage: twigs azure_functions [-h] [--secrets_scan] [--enable_entropy] [--regex_rules_file REGEX_RULES_FILE] [--check_common_passwords] [--common_passwords_file COMMON_PASSWORDS_FILE] [--include_patterns INCLUDE_PATTERNS] [--include_patterns_file INCLUDE_PATTERNS_FILE] [--exclude_patterns EXCLUDE_PATTERNS] [--exclude_patterns_file EXCLUDE_PATTERNS_FILE] [--mask_secret] [--no_code] [--sast] [--iac_checks]

optional arguments:
  -h, --help            show this help message and exit
  --secrets_scan        Perform a scan to look for secrets in the code
  --enable_entropy      Identify entropy based secrets
  --regex_rules_file REGEX_RULES_FILE
                        Path to JSON file specifying regex rules
  --check_common_passwords
                        Look for top common passwords.
  --common_passwords_file COMMON_PASSWORDS_FILE
                        Specify your own common passwords file. One password
                        per line in file
  --include_patterns INCLUDE_PATTERNS
                        Specify patterns which indicate files to be included
                        in the secrets scan. Separate multiple patterns with
                        comma.
  --include_patterns_file INCLUDE_PATTERNS_FILE
                        Specify file containing include patterns which
                        indicate files to be included in the secrets scan. One
                        pattern per line in file.
  --exclude_patterns EXCLUDE_PATTERNS
                        Specify patterns which indicate files to be excluded
                        in the secrets scan. Separate multiple patterns with
                        comma.
  --exclude_patterns_file EXCLUDE_PATTERNS_FILE
                        Specify file containing exclude patterns which
                        indicate files to be excluded in the secrets scan. One
                        pattern per line in file.
  --mask_secret         Mask identified secret before storing for reference in
                        ThreatWorx.
  --no_code             Disable storing code for reference in ThreatWorx.
  --sast                Perform static code analysis on your source code
  --iac_checks          Perform security checks on IaC templates

Mode: gcp
$ twigs gcp --help
usage: twigs gcp [-h] [--enable_tracking_tags]

optional arguments:
  -h, --help            show this help message and exit
  --enable_tracking_tags
                        Enable recording GCP specific information (like
                        Project ID, etc.) as asset tags

Help video: https://youtu.be/tGgKZcGFfZ4

Mode: gcp_cis
$ twigs gcp_cis --help
usage: twigs gcp_cis [-h] --assetid ASSETID [--assetname ASSETNAME] [--projects PROJECTS] [--expanded] [--custom_ratings CUSTOM_RATINGS]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --projects PROJECTS   A comma separated list of GCP project IDs to run the
                        checks against
  --expanded            Create separate issue for each violation
  --custom_ratings CUSTOM_RATINGS
                        Specify JSON file which provides custom ratings for
                        GCP CIS benchmark tests

Mode: gcr
$ twigs gcr --help
usage: twigs gcr [-h] [--repository REPOSITORY] [--image IMAGE] [--tmp_dir TMP_DIR] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help            show this help message and exit
  --repository REPOSITORY
                        The GCR image respository url which needs to be
                        inspected.
  --image IMAGE         The fully qualified image name (with tag / digest)
                        which needs to be inspected. If tag / digest is not
                        given, latest will be determined and used.
  --tmp_dir TMP_DIR     Temporary directory. Defaults to /tmp
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Mode: gcloud_functions
$ twigs gcloud_functions --help
usage: twigs gcloud_functions [-h] --projects PROJECTS [--secrets_scan] [--enable_entropy] [--regex_rules_file REGEX_RULES_FILE] [--check_common_passwords] [--common_passwords_file COMMON_PASSWORDS_FILE] [--include_patterns INCLUDE_PATTERNS] [--include_patterns_file INCLUDE_PATTERNS_FILE] [--exclude_patterns EXCLUDE_PATTERNS] [--exclude_patterns_file EXCLUDE_PATTERNS_FILE] [--mask_secret] [--no_code] [--sast] [--iac_checks]

optional arguments:
  -h, --help            show this help message and exit
  --projects PROJECTS   A comma separated list of GCP project IDs
  --secrets_scan        Perform a scan to look for secrets in the code
  --enable_entropy      Identify entropy based secrets
  --regex_rules_file REGEX_RULES_FILE
                        Path to JSON file specifying regex rules
  --check_common_passwords
                        Look for top common passwords.
  --common_passwords_file COMMON_PASSWORDS_FILE
                        Specify your own common passwords file. One password
                        per line in file
  --include_patterns INCLUDE_PATTERNS
                        Specify patterns which indicate files to be included
                        in the secrets scan. Separate multiple patterns with
                        comma.
  --include_patterns_file INCLUDE_PATTERNS_FILE
                        Specify file containing include patterns which
                        indicate files to be included in the secrets scan. One
                        pattern per line in file.
  --exclude_patterns EXCLUDE_PATTERNS
                        Specify patterns which indicate files to be excluded
                        in the secrets scan. Separate multiple patterns with
                        comma.
  --exclude_patterns_file EXCLUDE_PATTERNS_FILE
                        Specify file containing exclude patterns which
                        indicate files to be excluded in the secrets scan. One
                        pattern per line in file.
  --mask_secret         Mask identified secret before storing for reference in
                        ThreatWorx.
  --no_code             Disable storing code for reference in ThreatWorx.
  --sast                Perform static code analysis on your source code
  --iac_checks          Perform security checks on IaC templates

Mode: oci_cis
$ twigs oci_cis --help
usage: twigs oci_cis [-h] --assetid ASSETID [--assetname ASSETNAME] [--no_obp]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --no_obp              Do not run Oracle Best Practice checks

Mode: docker
$ twigs docker --help
usage: twigs docker [-h] [--image IMAGE] [--containerid CONTAINERID] [--assetid ASSETID] [--assetname ASSETNAME] [--tmp_dir TMP_DIR] [--start_instance] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help            show this help message and exit
  --image IMAGE         The docker image (repo:tag) which needs to be
                        inspected. If tag is not given, "latest" will be
                        assumed.
  --containerid CONTAINERID
                        The container ID of a running docker container which
                        needs to be inspected.
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --tmp_dir TMP_DIR     Temporary directory to discover container
  --start_instance      If image inventory fails, try starting a container
                        instance to inventory contents. Use with caution
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Mode: docker_cis
$ twigs docker_cis --help
usage: twigs docker_cis [-h] [--assetid ASSETID] [--assetname ASSETNAME] [--docker_bench_home DOCKER_BENCH_HOME]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --docker_bench_home DOCKER_BENCH_HOME
                        Location of docker bench CLI. Defaults to /usr/share
                        /docker-bench-security

Mode: k8s
usage: twigs k8s [-h] (--deployment_yaml DEPLOYMENT_YAML | --helm_chart HELM_CHART) [--tmp_dir TMP_DIR] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help            show this help message and exit
  --deployment_yaml DEPLOYMENT_YAML
                        Path to Kubernetes deployment manifest definition YAML
                        file.
  --helm_chart HELM_CHART
                        Specify the helm chart (folder, repo/chartname).
  --tmp_dir TMP_DIR     Temporary directory. Defaults to /tmp
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Mode: repo
$ twigs repo --help
usage: twigs repo [-h] (--repo REPO | --gh_user GH_USER) [--branch BRANCH] [--type {pip,ruby,yarn,nuget,npm,maven,gradle,dll,jar,cargo,go}] [--level {shallow,deep}] [--include_unused_dependencies] [--assetid ASSETID] [--assetname ASSETNAME] [--secrets_scan] [--enable_entropy] [--regex_rules_file REGEX_RULES_FILE] [--check_common_passwords] [--common_passwords_file COMMON_PASSWORDS_FILE] [--include_patterns INCLUDE_PATTERNS] [--include_patterns_file INCLUDE_PATTERNS_FILE] [--exclude_patterns EXCLUDE_PATTERNS] [--exclude_patterns_file EXCLUDE_PATTERNS_FILE] [--mask_secret] [--no_code] [--sast] [--iac_checks]

optional arguments:
  -h, --help            show this help message and exit
  --repo REPO           Local path or git repo url for project
  --gh_user GH_USER     Discover all repositories for specified GitHub User.
  --branch BRANCH       Optional branch of remote git repo
  --type TYPE           Type of open source component to scan for {pip,ruby,yarn,nuget,npm,maven,gradle,dll,jar,cargo,go}. Defaults to all supported types if not specified
  --level LEVEL         Possible values {shallow, deep}. Shallow restricts discovery to 1st level dependencies only. Deep discovers dependencies at all levels. Defaults to shallow discovery if not specified
  --include_unused_dependencies
                        Include unused dependencies in the repository asset (applies to certain types of open source components only, may introduce false positives if used)
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --secrets_scan        Perform a scan to look for secrets in the code
  --enable_entropy      Identify entropy based secrets
  --regex_rules_file REGEX_RULES_FILE
                        Path to JSON file specifying regex rules
  --check_common_passwords
                        Look for top common passwords.
  --common_passwords_file COMMON_PASSWORDS_FILE
                        Specify your own common passwords file. One password per line in file
  --include_patterns INCLUDE_PATTERNS
                        Specify patterns which indicate files to be included in the secrets scan. Separate multiple patterns with comma.
  --include_patterns_file INCLUDE_PATTERNS_FILE
                        Specify file containing include patterns which indicate files to be included in the secrets scan. One pattern per line in file.
  --exclude_patterns EXCLUDE_PATTERNS
                        Specify patterns which indicate files to be excluded in the secrets scan. Separate multiple patterns with comma.
  --exclude_patterns_file EXCLUDE_PATTERNS_FILE
                        Specify file containing exclude patterns which indicate files to be excluded in the secrets scan. One pattern per line in file.
  --mask_secret         Mask identified secret before storing for reference in ThreatWorx.
  --no_code             Disable storing code for reference in ThreatWorx.
  --sast                Perform static code analysis on your source code
  --iac_checks          Perform security checks on IaC templates

Mode: ghe
$ twigs ghe --help
usage: twigs repo [-h] --gh_user GH_USER [--type {pip,ruby,yarn,nuget,npm,maven,gradle,dll,jar,cargo,go}] [--level {shallow,deep}] [--include_unused_dependencies] [--assetid ASSETID] [--assetname ASSETNAME] [--secrets_scan] [--enable_entropy] [--regex_rules_file REGEX_RULES_FILE] [--check_common_passwords] [--common_passwords_file COMMON_PASSWORDS_FILE] [--include_patterns INCLUDE_PATTERNS] [--include_patterns_file INCLUDE_PATTERNS_FILE] [--exclude_patterns EXCLUDE_PATTERNS] [--exclude_patterns_file EXCLUDE_PATTERNS_FILE] [--mask_secret] [--no_code] [--sast] [--iac_checks]

optional arguments:
  -h, --help            show this help message and exit
  --gh_org GH_ORG       Discover all repositories for specified GitHub
                        Enterprise Organization.
  --type TYPE           Type of open source component to scan for {pip,ruby,yarn,nuget,npm,maven,gradle,dll,jar,cargo,go}. Defaults to all supported types if not specified
  --level LEVEL         Possible values {shallow, deep}. Shallow restricts discovery to 1st level dependencies only. Deep discovers dependencies at all levels. Defaults to shallow discovery if not specified
  --include_unused_dependencies
                        Include unused dependencies in the repository asset (applies to certain types of open source components only, may introduce false positives if used)
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --secrets_scan        Perform a scan to look for secrets in the code
  --enable_entropy      Identify entropy based secrets
  --regex_rules_file REGEX_RULES_FILE
                        Path to JSON file specifying regex rules
  --check_common_passwords
                        Look for top common passwords.
  --common_passwords_file COMMON_PASSWORDS_FILE
                        Specify your own common passwords file. One password per line in file
  --include_patterns INCLUDE_PATTERNS
                        Specify patterns which indicate files to be included in the secrets scan. Separate multiple patterns with comma.
  --include_patterns_file INCLUDE_PATTERNS_FILE
                        Specify file containing include patterns which indicate files to be included in the secrets scan. One pattern per line in file.
  --exclude_patterns EXCLUDE_PATTERNS
                        Specify patterns which indicate files to be excluded in the secrets scan. Separate multiple patterns with comma.
  --exclude_patterns_file EXCLUDE_PATTERNS_FILE
                        Specify file containing exclude patterns which indicate files to be excluded in the secrets scan. One pattern per line in file.
  --mask_secret         Mask identified secret before storing for reference in ThreatWorx.
  --no_code             Disable storing code for reference in ThreatWorx.
  --sast                Perform static code analysis on your source code
  --iac_checks          Perform security checks on IaC templates

Mode: host
$ twigs host --help
usage: twigs host [-h] [--remote_hosts_csv REMOTE_HOSTS_CSV] [--host_list HOST_LIST] [--secure] [--password PASSWORD] [--assetid ASSETID] [--assetname ASSETNAME] [--no_ssh_audit] [--no_host_benchmark] [--check_vuln CHECK_VULN] [--check_all_vulns]

optional arguments:
  -h, --help            show this help message and exit
  --remote_hosts_csv REMOTE_HOSTS_CSV
                        CSV file containing details of remote hosts. CSV file
                        column header [1st row] should be: hostname,userlogin,
                        userpwd,privatekey,assetid,assetname. Note "hostname"
                        column can contain hostname, IP address, CIDR range.
  --host_list HOST_LIST
                        Same as the option: remote_hosts_csv. A file
                        (currently in CSV format) containing details of remote
                        hosts. CSV file column header [1st row] should be: hos
                        tname,userlogin,userpwd,privatekey,assetid,assetname.
                        Note "hostname" column can contain hostname, IP
                        address, CIDR range.
  --secure              Use this option to encrypt clear text passwords in the
                        host list file
  --password PASSWORD   A password use to encrypt / decrypt login information
                        from the host list file
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --no_ssh_audit        Skip ssh audit
  --no_host_benchmark   Skip host benchmark audit
  --check_vuln CHECK_VULN
                        Run plugin to detect impact of specified
                        vulnerabilities. You can use this option multiple
                        times to specify multiple vulnerabilities
  --check_all_vulns     Run plugins to detect impact of all vulnerabilities

Help video: https://youtu.be/OKJ-DxXwanA

Mode: vmware
$twigs vmware --help
usage: twigs vmware [-h] --host HOST --user USER [--password PASSWORD]

optional arguments:
  -h, --help           show this help message and exit
  --host HOST          A vCenter host name or IP
  --user USER          A vCenter user name
  --password PASSWORD  Password for the vCenter user. Note this can be set as
                       "VCENTER_PASSWD" environment variable

Mode: nmap
$ twigs nmap --help
usage: twigs nmap [-h] --hosts HOSTS

optional arguments:
  -h, --help     show this help message and exit
  --hosts HOSTS  A hostname, IP address or CIDR range
  --timing TIMING
                        Timing Template value (range 0 to 5) as per nmap
                        documentation. Defaults to 5 if not specified. Refer
                        https://nmap.org/book/performance-timing-templates.html
  --discovery_scan_type DISCOVERY_SCAN_TYPE
                        Specify the scan type to be used during host
                        discovery. Refer https://nmap.org/book/man-host-
                        discovery.html
  --discovery_port_list DISCOVERY_PORT_LIST
                        Specify the ports to be used in host discovery scan.
                        Not applicable for (N,E,P,M) discovery scan types
  --no_ssh_audit  Skip ssh audit

Mode: sbom
$ twigs sbom --help
usage: twigs sbom [-h] --input INPUT --standard {spdx,cyclonedx,threatworx} --format {json,tagvalue,csv} [--assetid ASSETID] [--assetname ASSETNAME]

optional arguments:
  -h, --help            show this help message and exit
  --input INPUT         Absolute path to SBOM artifact
  --standard STANDARD   Specifies SBOM standard.
  --format FORMAT       Specifies format of SBOM artifact.
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset

Mode: servicenow
$ twigs servicenow --help
usage: twigs servicenow [-h] --snow_user SNOW_USER --snow_user_pwd SNOW_USER_PWD --snow_instance SNOW_INSTANCE [--enable_tracking_tags]

optional arguments:
  -h, --help            show this help message and exit
  --snow_user SNOW_USER
                        User name of ServiceNow account
  --snow_user_pwd SNOW_USER_PWD
                        User password of ServiceNow account
  --snow_instance SNOW_INSTANCE
                        ServiceNow Instance name
  --enable_tracking_tags
                        Enable recording ServiceNow specific information (like
                        ServiceNow instance name, etc.) as asset tags

Mode: ssl_audit
$ twigs ssl_audit --help
usage: twigs ssl_audit [-h] --url URL [--args ARGS] [--info] --assetid ASSETID [--assetname ASSETNAME]

optional arguments:
  -h, --help            show this help message and exit
  --url URL             HTTPS URL
  --args ARGS           Optional extra arguments
  --info                Report LOW / INFO level issues
  --assetid ASSETID     A unique ID to be assigned to the discovered web URL
                        asset
  --assetname ASSETNAME
                        Optional name/label to be assigned to the web URL
                        asset

Mode: dast
$ twigs dast --help
usage: twigs dast [-h] --url URL [--plugin {arachni,skipfish}] [--pluginpath PLUGINPATH] [--args ARGS] --assetid ASSETID [--assetname ASSETNAME]

optional arguments:
  -h, --help            show this help message and exit
  --url URL             Web application URL
  --plugin PLUGIN       DAST plugin to be used. Default is arachni. Requires
                        the plugin to be installed separately.
  --pluginpath PLUGINPATH
                        Path where the DAST plugin is installed to be used.
                        Default is /usr/bin.
  --args ARGS           Optional extra arguments to be passed to the plugin
  --assetid ASSETID     A unique ID to be assigned to the discovered webapp
                        asset
  --assetname ASSETNAME
                        Optional name/label to be assigned to the webapp asset

Mode: k8s_cis
usage: twigs k8s_cis [-h] --assetid ASSETID [--assetname ASSETNAME] --target {master,worker} [--custom_ratings CUSTOM_RATINGS]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --target TARGET       Run test against Kubernetes master or worker nodes
  --custom_ratings CUSTOM_RATINGS
                        Specify JSON file which provides custom ratings for
                        Kubernetes CIS benchmarks

Mode: gke_cis
usage: twigs gke_cis [-h] --assetid ASSETID [--assetname ASSETNAME] --target {master,worker} [--custom_ratings CUSTOM_RATINGS]

optional arguments:
  -h, --help            show this help message and exit
  --assetid ASSETID     A unique ID to be assigned to the discovered asset
  --assetname ASSETNAME
                        A name/label to be assigned to the discovered asset
  --target TARGET       Run test against GKE master or worker nodes
  --custom_ratings CUSTOM_RATINGS
                        Specify JSON file which provides custom ratings for
                        Kubernetes CIS benchmarks

Note: For Windows hosts, you can use provided PowerShell script (twigs.ps1) for discovery. It requires PowerShell 3.0 or higher.

usage: .\\twigs.ps1 -?

twigs.ps1 [[-mode] <String>] [[-remote_hosts_csv] <String>] [[-host_list] <String>] [[-password] <String>] [-handle] <String> [[-token] <String>] [[-instance] <String>] [[-out] <String>] [[-assetid] <String>] [[-assetname] <String>] [[-tags] <String[]>] [-tag_critical] [-no_scan] [-email_report] [<CommonParameters>]

Credits
-------

This package was created with Cookiecutter_ and the `audreyr/cookiecutter-pypackage`_ project template.

.. _Cookiecutter: https://github.com/audreyr/cookiecutter
.. _`audreyr/cookiecutter-pypackage`: https://github.com/audreyr/cookiecutter-pypackage


=======
History
=======

0.1.0 (2019-03-18)
------------------

* First release on PyPI.

1.1.0 (2022-01-23)
------------------

* Added support for twigs plugins.


