CHANGES
=======

39.0.0
------

* Enable tempest cleanup with record\_resources in jobs
* Implement purge list for tempest cleanup
* Adds validation schema for compute
* Add servers tests with LUN direct volume
* Pin stable/2024.1 constraint in tox to release 39.0.0
* End support for stable/zed
* Stop running jobs for stable/zed
* Fix constraint usage for unmaintained/victoria|wallaby
* Fix str to str comparison in live migration test
* Enable Secure RBAC in Keystone
* Deprecate import\_image
* Deprecate os\_glance\_reserved
* [codespell] fix typos
* Remove xenapi\_apis option
* Allow tempest cleanup delete resources based on prefix
* Create releasenotes page for tempest 37.0.0, 38.0.0
* Add Tempest gate job for stable/2024.1
* Update integrated template for grenade-skip-level job
* Replace deprecated os\_adm
* Remove deprecated alias of test decorators (1/2)
* Remove deprecated object storage client interfaces
* Switch to the master constraint in tox.ini

38.0.0
------

* Use stable constraint in tox to release new tag for 2024.1
* Add releasenote to tag the Tempest for 2024.1 release
* Add scenario test: test instances with cinder volumes
* Fix branch regex for unmaintained branch model
* Make plugin sanity check job voting again
* Test create a backup when latest incremental backup is deleted
* Add ovs and ovn logs to be collected in all devstack jobs
* Fix branch regex to cover unmaintained branches
* Add wait for location import task
* Add coverage for caching image on remote node
* Drop EOL branches from job definitions
* Add set-src-dest-host role
* Add option to specify source and destination host
* Make tempest-tox-plugin-sanity-check n-v
* Change the parameter passed to the API call
* cli auth: only inject project name if provided
* Switch back the tox constraint to master

37.0.0
------

* Pin stable/2023.2 constraint in tox to release 37.0.0
* Add prefix to images created in \*ImagesNegativeTest tests
* End support for stable/yoga
* Increase timeout for tempest-all job
* General doc updates
* Use URIOpt for options taking URI/URL
* Remove deprecated [network] dns\_server options
* Clean up [identity-feature-enable] options for old releases
* Remove rdp\_console option
* Remove nova\_cert option
* Document choices using oslo.config interface
* Remove [compute-feature-enabled] vnc\_server\_header
* Remove [compute-feature-enabled] block\_migrate\_cinder\_iscsi
* Use lowercase names for swift/S3 containers
* Add delete image from specific store API
* Pass resource\_name\_prefix from tests
* Use 'tempest run --slowest' in integrated-compute
* Add '--slowest' option to 'tempest run'
* Adding tempest prefix option in tempest.conf
* Handle split kernel/ramdisk images
* Fix of wrong parsing of flavour name and disk\_over\_commit parameter
* Report original request ID on failed shelve
* Extend retry sleep after server fault
* Switch Neutron RBAC flag in testing
* Remove tap-as-a-service-tempest-plugin
* Skip test\_dhcp\_agent\_scheduler tests if there is no DHCP agent available
* Fix test\_show\_host\_detail to support installation with ironic
* Fix cleanup for object\_storage tests
* Add unit tests to increase coverage
* Make greande-skip-level job voting on current master
* Add Tempest gate job for stable/2023.2
* Create releasenotes page for tempest 35.0.0, 36.0.0
* Switch to the master constraint in tox.ini

36.0.0
------

* Use stable constraint in tox to release new tag for 2023.2
* Verify that instance can boot after volume retype with migration
* Add releasenote to tag the Tempest for 2023.2 release
* Update Tempest supported releases and python versions
* Use re2 compatible regexes in branch matchers
* Use upper constraints in pep8 test run
* Fix the unstable\_test syntax for test\_live\_migration\_with\_trunk
* Remove test duplication between tempest and n-t-p QuotasTest
* Fixed typo in override-checkout branch for stable/2023.1
* Mark "test\_live\_migration\_with\_trunk" as unstable
* Revert "Fix cleanup for volume backup tests"
* Fix clean up for test\_access\_rules tests
* Revert "Mark "test\_live\_migration\_with\_trunk" as unstable"
* Fix cleanup for volume backup tests
* Use service role also in test\_server\_external\_events
* Use service role also in test\_assisted\_volume\_snapshots
* Add python 3.11 unit test job
* Remove Glance v1 APIs tests
* Added json.loads(body) to delete\_attachment method
* Skip failing tests affected by minimum password age
* Improve rebuild tests in test\_server\_actions
* Do not retry immediately after server fault
* Setting Tempest run concurrency to 4 for a few jobs
* Skip test\_image\_tasks\_create() for bug 2030527
* Mark x/networking-fortinet tempest plugins inactive
* Remove nova-network tests
* Skip scenario tests early to avoid unnecessary setup
* Add test for assisted volume snapshot
* Skip test early to improve memory footprint and time
* Use vfat for timestamp
* Add image task client and image tests task APIs
* Skip rebuild\_volume\_backed\_server if no cinder
* tox: Remove basepython
* create default network for few more server tests
* Add ironic-tempest-bios-ipmi-direct-tinyipa job in tempest gate
* Test Nova and Glance RBAC policy old defaults
* Correct \_get\_console() to get console of correct server
* Revert "Run test\_port\_security\_macspoofing\_port slow tests serially"
* Disable dhcpcd in test\_port\_security\_macspoofing\_port
* Optimize the resource creation and status waiting in scenario tests
* Avoid duplicate server creation in rebuild test
* Overlap volume and server creation in backup
* Reorder device rescue with volume for overlap
* Reorder server and port creation for overlap
* Increase the default concurrency for tempest run
* Run test\_port\_security\_macspoofing\_port slow tests serially
* Split up ServerActionsTestJSON for better mixing
* Fix tempest-slow-py3 job for < stable/xena
* Revert "Revert "Mark "test\_live\_migration\_with\_trunk" as unstable""
* Run slow tests parallely
* Update object\_storage container creation using metadata tests to accept 204 reponses
* Revert "Mark "test\_live\_migration\_with\_trunk" as unstable"
* Fix test\_schedule\_to\_all\_node to support installation with ironic
* Manage a snapshot with an attached volume
* Avoid false positives with test\_server\_connectivity\_live\_migration
* Increase concurrency for tempest-slow jobs
* Add image admin test to list public image
* Fix cleanup of resources for object\_storage tests
* Remove setting of DEFAULT\_IMAGE\_NAME to non exit image
* Mark "test\_live\_migration\_with\_trunk" as unstable
* Add tests to list hidden images
* Add test to rebuild volume backed instance

35.0.0
------

* Switch back the tox constraint to master
* Pin stable/2023.1 constraint in tox to release 35.0.0
* End support for stable/xena
* [FIX] Floating IP already exists error
* Remove ubuntu focal job
* Default to /tmp for scenario (create|get)\_timestamp()
* Enable Nova, Glance RBAC old defaults in pre provisioned account testing
* Improve error msg of wait\_for\_server\_status waiter
* Skip test\_list\_all\_networks if no known network configured
* Fix test\_delete\_locations to be performed by admin
* Add tests to check attachments are secure
* Remove closure \_unshelve\_server not useful
* Add request id to logs if we get a timeout
* Add skip for cinder extend volume with snapshot
* Create releasenotes page for tempest 34.2.0
* Also require resources for PINGABLE
* Make volumes\_backup test wait for SSHABLE
* Switch to the master constraint in tox.ini

34.2.0
------

* Use stable constraint in tox to release Tempest new tag
* Add release notes for 2023.2 cycle intermediate release
* Allow passing validation\_resources in scenario
* Fail create if validation flags do not agree
* Allow wait\_until=SSHABLE in scenario manager
* Actually make volume extend tests validate
* Wait until SSHABLE in volumes\_extend test
* Update v3\_endpoint\_type to use public
* Simplify definition of fips jobs
* Add project reader to account-generator
* Add RBAC new defaults and scope job for stable/zed
* rm hardcoded cidr in test\_create\_server\_multi\_nic
* Update integrated gates template for grenade skip level job
* Create releasenotes page for tempest 34.0.0

34.1.0
------

* Switch to the master constraint in tox.ini
* Use stable constraint in tox to release new tag for 2023.1
* Add Tempest gate job for stable/2023.1
* Inherit tempest-extra-tests job from tempest-full-py3
* Update multiattach tests
* Update "test\_list\_migrations\_in\_flavor\_resize\_situation" to indicate the failing request on timeout
* Introduce a change that will allow more clients to make volumes
* Fix server cleanup in test\_multiple\_create test
* Revert "Fix DeprecationWarning of jsonschema"
* Revert "Update required minimum jsonschema version >= 4.16.0"
* Cinder client fails if identity API version specified
* Update required minimum jsonschema version >= 4.16.0
* Avoid wait for vol detach in live-migrate tests

34.0.0
------

* Switch to the master constraint in tox.ini
* Use stable constraint in tox to release new tag for 2023.1
* Add releasenote to tag the Tempest for 2023.1 release
* Fix DeprecationWarning of jsonschema
* Add doc for multinode attribute
* Avoid long wait for volume detach in some tests
* Change order of server/volume in snapshot test
* Use project\_reader in server test
* Fix creation of requested creds within the same project
* Log console on failure to delete attachment
* Fix tempest-full-py3 for stable/ussuri to wallaby
* Allow capital letters in mac address regex
* Allow float value when overriding downtime
* Add periodic job to experimental queue
* Use MYSQL\_REDUCE\_MEMORY in some periodic jobs
* Add retries to more glance location tests
* Use assertLessEqual for downtime validation
* Enable bridge flows and tcpdump in tempest multinode
* Revert "Mark tempest-multinode-full-py3 as n-v"
* Separate the extra tests to run in a separate job
* Minimize the tests footprint in multinode job
* Prepare tempest-slow-parallel job and run periodically
* Move a few jobs to periodic
* Fix retry\_bad\_request() context manager
* Mark tempest-multinode-full-py3 as n-v
* Retry glance add/update locations on BadRequest
* Do not run openstacksdk-functional-devstack on victoria
* Mark test\_minimum\_basic\_instance\_hard\_reboot\_after\_vol\_snap\_deletion as slow test
* Allow SSH connection callers to not permit agent usage
* Do not run openstacksdk-functional-devstack on wallaby
* Fix escaping of regular expressions in tox.ini
* Fix default values for variables in run-tempest role
* Move test\_dhcp\_port\_status\_active from neutron-tempest-plugin
* Use UPPER\_CONSTRAINTS\_FILE for stable/wallaby testing
* Chunked GET request support
* tempest cleanup - don't initialize admin id's
* Remove leftover todo related to the dhcpcd support
* Restore IP addresses configuration after spoofing MAC address
* Add support for dhcpcd in the renew\_lease method
* Skip test\_attach\_scsi\_disk\_with\_config\_drive
* Introduce @serial test execution decorator
* Add release notes page for version 33.0.0
* Fix tox4 error
* Enable placement scope and new defaults in rbac test job

33.0.0
------

* Switch back the tox constraint to master
* Pin stable/zed constraint in tox to release 33.0.0
* End support for stable/wallaby
* Add placement service in 'enforce\_scope' config
* zuul: Increase timeout for c9s-fips job
* Added functionality to wait for port creation
* Fix Compute Live Migration tests with Ironic
* Fix python classifier for py39
* Cleanup tox.ini
* Set back to use Bionic for Ussuri, Train and Stein
* Add new tempest job enable the rbac scope checks and new defaults
* Add test for compute server external event API
* Migrate tempest jobs to Ubuntu Jammy (22.04)
* Remove python-devel package for rpm based distributions from bindep
* Fix error KeyError: 'addresses' for two tests
* Add replace location test
* Add tests for image location manipulation
* Fix server id reference in \_rebuild\_server\_and\_check()
* Clarify the enforce\_scope config option help message
* [Doc] Fix python version in unit tests document
* Fix image import tests for read-only stores
* Updated document for the correct stable branches support
* Fix security vulnerabilities using Bandit
* Remove references to 'all-plugin' tox environment
* Add a boot-snapshot-boot test
* All image clients must use image build timeout
* Add Tempest gate job for stable/zed
* Add release notes page for version 32.0.0
* Update server details before getting fixed IP
* Switch to the master constraint in tox.ini

32.0.0
------

* Add releasenote to tag the Tempest for Zed release
* Use stable constraint in tox to release new tag for Zed
* Remove transfer-encoding headers from test
* Add tempest-multinode-full-py3 job in gate pipeline
* Add nova-multi-cell job in experimental pipeline
* Fix creds cleanup for system scope
* Update volume and volume transfer schema
* Add testing for glance-download import method
* Tempest test for checking unshelve to host
* Allow free-form image import parameters
* Fix test\_server\_actions run validation
* Wait for SSHABLE in volume tests
* Add waiter for object creation
* Clean up scenario floating IP waiting
* Add tempest coverage for new cache API
* Wait for floating IP assocation in test\_minimum\_basic test
* Allow multiple instances on create\_test\_server
* move tempest-integrated-compute-centos-9-stream to periodic
* Add config option for algo to use in temp\_url tests
* Skip test\_container\_synchronization
* Remove unstable\_test decorator
* Remove unstable\_test decorator
* Fix create\_server\_snapshot for microversion
* Fix backward compatibility of compare volume stats
* Add release notes page for version 31.1.0
* Add image cache client
* Add LUKS v2 tests

31.1.0
------

* Verify top key in \_parse\_body
* Switch the tox contraints back to master
* Use yoga stable contraint in tox to release 31.1.0
* Make nova-live-migration voting
* Test fips job on centos-9
* compute: Move volume attached live migration tests to use SSHABLE
* Create default net in ImagesNegativeTestJSON
* Add py310 job in gate
* compute: Move volume attached live migration tests to use SSHABLE
* Add release notes page for version 31.0.0
* Stop running openstacksdk-functional-devstack job on ussuri
* Fix supported releases and py versions in the doc

31.0.0
------

* Decorate volume.base functions - fix cleanup
* Switch back the tox constraint to master
* Use yoga stable constraint in tox to release 31.0.0
* Drop py3.6 and py3.7 from Tempest
* Create router and dhcp when create\_default\_network set
* Wait for guest to boot before attach a volume
* Use UPPER\_CONSTRAINTS\_FILE for stable/victoria testing
* Use UPPER\_CONSTRAINTS\_FILE for stable/ussuri testing
* End support for stable/victoria
* Add verification when restoring backups
* Remove orchestration\_client from tempest tree
* Make tempest plugin sanity job voting again
* tempurl: Deprecate sha1 signatures
* Unblock gate to temporary remove the py3.6|7 job
* Fix compare volume stats for storage\_protocols
* Make test\_server\_actions.resource\_setup() wait for SSHABLE
* Validate network downtime during live migration
* Wait for guest after resize
* Pass the global request ID as logging context
* Remove compute api\_extensions config option
* Make recreate\_server() wait until SSHABLE
* Add tempest-slow stable branch jobs on Tempest master gate
* Fix the integrated-gate-compute job template
* Drop centos 8 stream testing
* Fix remote\_client param description
* Switch to ecdsa ssh key type by default
* Fix: change values to items as keys and values are all used
* Remove reference of openstack-health
* End support for stable/ussuri
* Allows to skip wait for volume create
* Fix test\_basic\_metadata\_definition\_namespaces

30.1.0
------

* Allow rulesets modification in secgroups
* Make test\_tagged\_attachment wait for SSHABLE
* Use server hostname when creating secure websocket
* Use wrap\_socket from ssl.SSLContext instead of ssl
* Add Tempest gate job for stable/yoga
* Move ServerStableDeviceRescueTest to wait for SSH-able server
* Make rescue, volume attachment compute tests to use SSH-able server
* Move ssh|ping-able server logic into separate method
* Fix compute\_unified decoration
* Add release notes page for version 30.0.0
* Add release notes pages for 29.1.0 and 29.2.0
* Switch to the master constraint in tox.ini

30.0.0
------

* Add releasenote to tag the Tempest for Yoga release
* Use stable constraint in tox to release new tag for Yoga
* Add compute response schema for microversion 2.75
* Add schema for compute 2.45 microversion
* Tests for nova unified quotas
* Add tempest-full-centos-9-stream non voting job
* add image schemas for image
* API for list group types by parameter sort/public
* compute: Move device tagging tests to use wait\_until=SSHABLE
* compute: Move volume attach tests to use wait\_until=SSHABLE
* Introduce PINGABLE and SSHABLE waiters and wait\_until state support
* Add grenade-skip-level jobs to integrated-gate
* Fix floating ip timeout issues with uwsgi enabled
* Make stable/ussuri job voting
* Add logging to metadata parsing
* Fix inconsistent type of default value
* Fix TypeError in QoSBandwidthAndPacketRateTests
* Append random int to new flavor name in QoSBandwidthAndPacketRateTests
* Add configuration for compute unified limits feature
* Update volume schema for microversion
* Fix test\_rebuild\_server test by waiting for floating ip
* Fix stable/train testing with tempest 26.1.0
* Remove usage of unittest2
* Patch paramiko
* Make broken tempest-full-py3-opensuse15 job only until stable/xena
* Revert "Revert "Make centos8 stream job non voting for bug#1957941""
* Use LOG.warning instead of deprecated LOG.warn
* Add support for ecdsa keys
* Revert "Make centos8 stream job non voting for bug#1957941"
* Update aggregate tests for bug#1907775
* Make centos8 stream job non voting for bug#1957941
* Add test coverage for bug 1943724
* Set default value of --concurrency to 2
* wait\_for\_server\_status(): report original request ID if failure
* Clean up wait\_for\_resource\_deletion message
* Move get\_server\_ip into tempest.common.compute
* Revert "Check VM's console log before trying to SSH to it."
* Fix: Schema validation of volume list detail
* Add --libpath argv option to fix unittest failure
* Fix compute quota classes schema for v2.50 and v2.57
* Fix server group schema for compute microversion 2.64
* Add fields in hypervisor schema for 2.33 and 2.53
* Remove stable/train jobs from master gate
* Add flavor extra spec validation tests
* Modify the response example in test\_subnetpools\_client
* add the test of router test client
* Add  another scenario testcase  test\_minimum\_basic
* Moving API microversion fixture in resource\_setup
* Deprecate the old API microversion fixture
* Don't override images client in compute admin tests
* Replace deprecated assertDictContainsSubset
* Revert "Skip 3.19 test\_reset\_group\_snapshot\_status"
* Test Network QoS minimum packet rate scenarios
* Add openstacksdk-functional-devstack in integrated gates
* This patch creates the network v2.0 floating-ips-port-forwarding client
* Take domain\_id from config in some tests
* Change extra\_size from hardcoded 1 to CONF.volume.volume\_size\_extend
* add delete group type testcase
* delete all items of the group type spec

29.2.0
------

* zuul: Limit tempest-integrated-compute-centos-8-stream to >= stable/wallaby
* Update Interop doc
* Remove race from wait\_for\_interface\_detach waiter
* Add microversion schemas for os-instance-actions
* Add QoS minimum packet rate rule client
* zuul: Add a CentOS 8 stream job to integrated-gate-compute
* Test all supported python version for stable branch
* Refactor existing QoS min bw tests
* Consolidate client usage in MinBwAllocationPlacementTest

29.1.0
------

* Prepare MinBwAllocationPlacementTest for new neutron API ext
* Adding Bandwidth Limit QoS rule client to Manager
* Use lib.commom.api\_microversion\_fixture to set volume, compute API microversion in volume API testing
* hacking: Ignore H405
* Add floating IP waiter
* Get rid of jsonschema.compat usage
* Improve cleanup after Swift testing
* Mark unstable test\_create\_object\_with\_transfer\_encoding
* Fix IPv6 localhost replacement in Swift container sync test
* Add Tempest gate job for stable/xena
* Test delete security group will clear its associated rules
* Revert "Skip test\_qos\_min\_bw\_allocation\_basic when not supported"
* Skip snaphost tests unless snapshot feature is enabled
* Fix test\_fix\_argument\_yes

29.0.0
------

* [OVN] Remove OVN metadata ports from network port list
* object\_storage: retry object creation on Conflict
* Add release notes page for version 29.0.0, 28.1.0, 28.0.0
* Use the master constraint in tox.ini again
* Add releasenote to tag the Tempest for Xena release
* Use stable constraint in tox to release new tag for Xena
* Fix tempest plugins sanity jobs by exclude failing plugins
* Fix unused parameters in \_create\_subnet method
* create volume type with repeated name

28.1.0
------

* Expected success status for "QoS rule update APIs" is "200 OK"
* Add experimental job to run test with 'latest' microversion
* test update volume type extra specs for non existent volume type
* Fix for QoS APIs: "Update" and "List" URLs
* Add missing tempest client for "QoS Limit Bandwidth" APIs + testing
* create volume type encryption nonexistent type id
* Avoid running tempest-ipv6-only for unrelated tools files
* Blacklist failing x/vmware-nsx-tempest-plugin
* Add reboot\_server() helper
* Fix cleanup of default security group when preprov creds are used
* Fix test\_fix\_argument\_yes by closing temp files
* Updating NON\_ACTIVE\_LIST
* Add loggable resource client
* Always enable project tags Identity tests
* Always enable application credentials Identity tests
* Fixes test\_user\_update\_own\_password test cleanup problem (New password cannnot be identical to a previous password)
* compute: Rework attach\_volume waiters and cleanup
* Changes to ensure delete\_containers is done at class level tear down
* Adds exception.Conflict handler to is\_resource\_delete function
* Fix run-tempest-26 role for stable/stein
* Add test to verify FQDN hostname sanitization
* Wait couple of seconds for dns servers to be set in the guest
* Replace deprecated import of ABCs from collections
* Switch back the tox constraint to master
* Improve dynamic cred log to include scope

28.0.0
------

* Use wallaby stable constraint in tox to release 28.0.0
* Add releasenote to tag the end of support for Train
* Add tests for glance unified quotas
* Add keystone unified limits client
* Use older run-tempest for stable branches
* Fix tempest-slow-py3: use the correct inheritance chain
* Make explicit the network backend used in the CI jobs
* Fix test\_network\_quota\_exceeding test
* Add log resource client
* Remove non existing puppet-openstack-integration from check pipeline
* Add volume\_size\_extend opt for volume tests
* Skip network creation for system and domain scoped token
* Remove skip for test\_fix\_argument\_yes unit test
* Reactivate image before deletion
* Use volume\_type option in tempest.conf in compute api test
* Remove "active" attribute from the allowed\_address\_pairs
* Enable swift in tempest-slow-py3 job
* Move verify-ipv6-only-deployments
* Move stable job definition to stable-jobs.yaml
* Fix up the tempest-full-py3 job configurations
* Update IRC network to OFTC
* Add tests for "new" Transfers API (mv 3.55)
* Remove old deprecated Token clients
* Stop testing volume v2 APIs
* Deprecate image v1 service clients
* Remove volume v1 service clients
* Update encryption-type-create
* Add list resource provider usage
* Add wait to check the import task status
* Fix hacking check for service client
* Bump the openstack-python3 jobs to xena
* Add stestr master job
* Add waiter for test\_live\_migration\_with\_trunk
* Remove usage of six
* Remove usage of six
* Remove usage of six
* Add live migration with trunk test
* Fix TEMPEST\_VENV\_UPPER\_CONSTRAINTS default value comparision
* Add Tempest gate job for stable/wallaby
* Skip ide and ephmoral storage on aarch64
* Cleans up volume backups after test run
* Remove unicode from code
* Add release notes page for version 27.0.0
* Fix unstability in test\_subnet\_details

27.0.0
------

* Add releasenote to tag the Tempest for Wallaby release
* Add 26.1.0 releasenote page
* Use the master constraint in tox.ini again
* Use stable constraint in tox to release new tag for Wallaby
* Add a reno for scenario manager effort
* Add tempest.scenario.manager as stable interface for plugins
* Add delete\_on\_termination for compute API v2.79 - os-volume\_attachments
* Move flavor client in cls.setup\_compute\_client()
* Rename create\_networks to correct name as per its functionality
* Move floating IP operation from nova-network to neutron
* Remove nova-network from scenario tests
* Add client for assisted volume snapshots API
* Update oslo.utils minimal version
* setup.cfg: Replace dashes with underscores
* Uncap PrettyTable
* Add documentation on the usage of keystone's scope & roles
* Make image metadef tests admin-only
* Skip failing test test\_fix\_argument\_yes
* Fix test\_verify\_tempest\_config unit tests
* Add image task validation
* Create tmd dir with specific prefix in check-uuid unit tests
* compute: Add [compute-feature-enabled]ide\_bus flag
* Negative test for web-download import

26.1.0
------

* Add release notes for an Wallaby intermediate release
* Support scope in dynamic cred for specific roles
* Pass region to the alternate image client
* Update dynamic creds to properly handle types during creation
* Make \_get\_router() non-private
* Make \_create\_empty\_security\_group() non-private
* Test glance distributed import
* Add bandwidth inventory to the subnodes in tempest-multinode-full-py3
* Update subunit\_describe\_calls about new ports
* Make \_get\_server\_port\_id\_and\_ip4() non-private
* Implementation of create\_subnet() varies in manila-tempest-plugin
* Make \_create\_security\_group() non-private
* Add alt project persona in dynamic credential
* Replace md5 with oslo version
* Make \_get\_network\_by\_name() non-private
* [part1] Remove six
* Finally remove the old data-utils
* Remove usage of six
* Use configured upper-constraints for non-master Tempest run
* Make \_create\_network() non-private
* Remove usage of six
* Remove usage of six
* Add log for all assigned roles for dynamic cred users
* Remove usage of six
* Make \_cleanup\_volume\_type non-private
* Add option to support volume\_type in volume creation
* change ipv6 public network cidr on tempest-slow job
* Enable swift in tempest-full-py3
* Allow kwargs in create\_volume\_snapshot
* Switch to new rolevar for run-temepst role
* Fix run-tempest black/exclude var setting
* Modify the port fake data according to api reference
* add unittest for trust client operation interface in identity part
* Optimize the check pipeline runtime
* Enable devstack parallel installation in tempest-full-parallel job
* Implemetation of tempest client for keystone v3 OS\_FEDERATION API
* Fix race condition for image test
* Fix --exlude typo in tox.ini
* Add release note and fix some TODO from system scope support
* Disable file injection tests until bug/1882421
* Create default network for server advance scenario tests
* Make import wait check for store status
* Add wait\_for\_resource\_deletion for swift api clients
* Refactor skip\_because decorator
* Make \_create\_security\_group\_rule non-private
* Make \_create\_loginable\_secgroup\_rule non-private
* Make \_log\_console\_output non-private
* Allow use custom uppper constraints in stable/stein
* Change Review merge policy from two +2 to single +2 requirement
* Add config option for enforce\_scope
* test\_live\_migration: Rename test\_iscsi\_volume
* Fix system & domain scoped admin dynamic credential
* Test for changing QoS policy with min bw of bound port
* Remove deprecated scenario img\_dir option
* Make create\_user domain-aware for V3CredsClient
* test\_encrypted\_cinder\_volumes: Do not create an image for this test
* Move horizon test from tempest-horizon to tempest
* Fix project/domain scope in dynamic\_creds
* Remove tempest/manager.py after 4 year deprecation
* Inclusive jargon
* Drop base grenade job for nova
* Test glance reserved properties
* 1912117: Fix the IP URL for metadata service in fixed network scenario
* Make random\_bytes() enforce sane size limits
* Fix memory explosion in multi-store image tests
* Delete wrong argument from creating HTTP connection
* Use CONF.identity.disable\_ssl\_certificate\_validation in object\_client
* Add release note for new role client methods
* Add default RBAC personas to pre-provisioned creds
* Add default RBAC personas to dynamic credentials
* Add client methods and tests for system grants
* Add system scope for admin auth
* Remove the unused \_api\_version variable from volume tests
* Remove deprecated test.idempotent\_id decorator
* Remove deprecated config options for volume API selection
* Update microversion doc for compute microversion 2.3
* Pass custom args to create\_port through create\_server
* Remove stable/stein testing jobs
* scenario: Use wait\_for\_volume\_attachment\_remove\_from\_server in nova\_volume\_detach
* Add release notes page for version 26.0.0
* Use proper kwargs in rebuild\_server
* add unitest for api of resource providers inventories
* Revert "Use victoria stable constraint in tox to release 26.0.0"
* edit check result and make sure the query result correct

26.0.0
------

* Use victoria stable constraint in tox to release 26.0.0
* Add releasenote to tag the end of support for Stein
* Also calculate external subnets when check cidr whether in use
* Allow kwargs in create/restore\_backup
* Remove unused LOG var in test\_stamp\_pattern.py
* Remove slow tag from test\_minbw test
* Remove race due to 1907084
* New minimum guaranteed bandwidth tests
* Fix indentation for the example code in documentation
* Need to add kwargs for the api
* Allow kwargs in create\_server\_snapshot
* Allow kwargs in get\_timestamp
* Allow additional port\_vnic\_type
* compute: Skip AttachVolumeShelveTestJSON when cross\_az\_attach unavailable
* Cleanup server before image at test level
* Need to have stable implementation of apis
* Added apis to scenario manager
* Allow kwargs in create\_volume\_from\_image
* compute: Cleanup server before image in AttachSCSIVolumeTestJSON
* Allow kwargs in image\_create
* Decentralize the zuul jobs into zuul.d
* Fix TypeError when there exists image with size None
* Skip test\_create\_object\_with\_transfer\_encoding
* Change help string to use openstack instead of neutron
* [Trivial]Remove unused variables
* Fix "TypeError: format requires a mapping" in waiters
* Add related test to Bug #1732428
* Add tag in compute interfaces schema for microversion 2.70
* [Trivial]Remove unused variables and methods
* [Trivial]Do not use cls in instance method
* Skip test\_server\_rescue with volumes when there is no Cinder
* Check VM's console log before trying to SSH to it
* Allow kwargs in create\_timestamp
* Allow kwargs in nova\_volume\_attach
* Allow kwargs in create\_floating\_ip
* Remove six.PY3/six.PY2
* Add glance multistore job (nv) in tempest gate
* Remove 'gabbi\_tempest\_path' from devstack-tempest job
* Clarify tempest-full job description
* Allow kwargs in get\_server\_ip
* Allow kwargs in \_get\_server\_port\_id\_and\_ip4
* Set image\_alt\_ssh\_user during stack
* Allow kwargs in create\_volume
* Allow kwargs in boot\_instance\_from\_resource
* Replace assertItemsEqual with assertEqual
* Improve tempest-cleanup ansible role
* Allow kwargs in create\_floating\_ip
* Allow kwargs in \_get\_router
* New list config option to list network features without API extension
* Stabilize \_create\_loginable\_secgroup\_rule
* Unskip Device detach compute tests on Focal
* Allow kwargs in \_log\_console\_output
* Add glance image import copy-image tests
* Fix incorrect compute api microversion history links
* Fix url link for get\_remote\_console interface
* Test attach scsi disk with config drive enabled
* Make neutron-tempest-dvr job non-voting
* Allow kwargs in create\_volume\_type
* Replace display\_name by name in scenario manager
* Allow kwargs in create\_keypair
* Skip adding host to aggregate with az if host already in other zone
* Fix error that instance could not be found
* Delete test\_reboot\_server\_soft
* Add Tempest gate job for stable/victoria
* zuul: Move tempest-integrated-compute to Focal
* Retry on ServerFault in call\_and\_ignore\_notfound\_exc()
* add unittest for endpoints operation interface in identity part
* Skip additional test if 'xenapi\_apis' flag is False
* Check port allocation for VM with resource request
* Add placement API methods for testing routed provider nets
* Fix victoria releasenote to align yaml format
* Add glance multistore tests
* Add keystone v3 EC2 credential tests and client
* Remove install unnecessary packages
* Add missing keystone clients

25.0.1
------

* Migrate tempest jobs to focal
* Revert "Use stable constraint in tox to release new tag for Victoria"

25.0.0
------

* Add releasenote to tag the Tempest for Victoria release
* Use stable constraint in tox to release new tag for Victoria
* Adding description for testcases - compute part11
* Updating the paramiko version to 2.7.0 or greater
* Add 'xenapi\_apis' compute feature flag
* compute: Wait until server is ACTIVE before deleting during resource\_setup
* Add missing replication\_status in group schema
* Use the correct attachment id for multiattach
* Use assert\_has\_calls() correctly
* Fix test\_allowed\_address\_pair test case cleanup
* Volume backup response schemas are incorrect
* Add volume services schema for microversion 3.7
* Use os.path.join as possible
* Need to have stable implementation of nova\_volume\_detach() and add missing docstrings
* Need to have stable tempest scenario manager
* Add response schema validation for volume manage
* Fix import line location
* Create documentation for tests
* Skip test\_qos\_min\_bw\_allocation\_basic when not supported
* Wait until dependent resource is deleted
* Use of single interface for creating image
* Use the networking-l2gw project new location
* Adding description for testcases - swift part2
* Fix flavor NotFound in test\_resize\_server\_revert\_deleted\_flavor
* Improve unit tests for subunit\_describe\_calls
* Adding description for testcases - swift part3
* Adding description for testcases - swift part1
* Fix and unskip test\_list\_servers\_filtered\_by\_ip\_regex
* Adding description for testcases - volume part5
* Adding description for testcases - volume part4
* Adding description for testcases - volume part3
* Adding description for testcases - compute part12
* Adding description for testcases - compute part10
* Adding description for testcases - compute part9
* Adding description for testcases - compute part8
* Adding description for testcases - compute part7
* Adding description for testcases - compute part6
* Set max\_microversion 2.56 for ServerPersonalityTestJSON
* Adding description for testcases - identity part2
* Adding description for testcases - identity part5
* Adding description for testcases - compute part5
* Adding description for testcases - compute part4
* Add default headers to the volume show\_version request
* Add glance image import web-download tests
* Add new tests for check-uuid tool
* Adding description for testcases - identity part3
* Adding description for testcases - volume part2
* Adding description for testcases - network part1
* Adding description for testcases - network part3
* Tempest tests for glance import workflow
* Fix KeyError exc in volumes\_client
* Stop to use the \_\_future\_\_ module
* remote\_client: Use blkid -L to find config drive by filesystem label
* Fix tempest plugin cookicutter repo path
* zuul: clean up some legacy jobs
* Add response schema validation for volume backups
* Add skip flags for block level live migration
* Replace mock by unittest.mock in 2 forgotten cases
* Remove checking of Accept-Range header
* Document the process to pin the constraint in tox.ini
* Remove deprecated scenario image options
* Fix pdf-doc build by skiping the sample file
* object storage: fix and cleanup header checks
* Move process-stackviz role from Tempest to Devstack
* Add unit tests for check\_uuid.py
* Add check\_service\_availability test
* Fix pygments style
* Unstable test\_container\_synchronization
* Unstable test\_server\_connectivity\_cold\_migration\_revert
* Use python3 venv instead of virtualenv
* Fix request body for compute unshelve action API
* Fix test\_get\_service\_by\_invalid\_params for microversion 2.75
* Add missing attachments schema in servers.py
* Fix the argument check for account-generator
* Change 'Member' role reference to 'member'
* Fix 404 when deleteing volume group
* Fix flavor swap default value for compute microversion 2.75
* Add response schema validation for volumes
* Fix test\_list\_flavors for compute microversion 2.55
* [compute] Blacklist test\_create\_second\_image due to race
* Fix negative tests of update\_volume for volume microversion 3.59
* Remove any reference to "tenant\_id" in network
* Modify the fake data according to api reference
* Allow snapshot name with null
* Adding description for testcases - compute part3
* Add response schema validation for show\_default\_group\_type
* Add response schema validation for volume groups
* Add response schema validation for volume group snapshots
* Cap jsonschema 3.2.0 as the minimal version
* Sort roles in keystone token
* Add image "version" metadata in test\_snapshot\_pattern
* Adding description for testcases - network part2
* Add response schema validation for volume snapshots
* Add response schema validation for volume pools
* [Trivial]Do not use self in class method
* Add response schema validation for volume group types
* Add response schema validation for encryption types
* Switch to newer openstackdocstheme and reno versions
* Use unittest.mock instead of third party mock
* compute: Fix boot from volume stable rescue tests
* Add explicit external network for test\_create\_router\_set\_gateway\_with\_fixed\_ip
* Add migration uuid API schema validation for 2.59
* Fix check\_floating\_ip\_status utility's output
* Prevent raising exception if IP address is set in \_hotplug\_server
* Bump hacking min version to 3.0.1
* test\_server\_rescue.py should use CONF.volume.volume\_size
* Improve logging in tempest cleanup
* Fix redirect for doc section
* Don't use deprecated configparser.readfp
* Switch testing to Victoria testing runtime
* Add tempest-cleanup ansible role
* Use ensure-pip for stackviz pip install
* Add index page for plugins documents
* Add document for stable branch testing for tempest plugins
* Update supported version doc tempest
* Move ceph job to voting
* Make image\_ssh\_password a secret so it does not show in console
* Adding description for testcases - identity part4
* Move the grenade-py3 job to new zuulv3 grenade job name
* Add Tempest gate job for stable/ussuri
* compute: Add stable device rescue tests with BFV instances
* Add release notes page for version 24.0.0
* Fix typo in contributor guide
* Remove the stable rocky from supported branch in Tempest master

24.0.0
------

* Set TOX\_CONSTRAINTS\_FILE
* Use new encryption provider constants (reprise)
* Create default network for compute rescue tests
* Use the master constraint again in tox.ini
* Use stable constraint in tox to release new tag for Ussuri
* Adding description for testcases - image part2
* Adding description for testcases - image part1
* Add releasenote to tag the Tempest for Ussuri release
* [ussuri][goal] Update contributor documentation
* Integrated gate storage/swift: blacklist more tests
* Document the policy for Tempest & its plugins release
* run-tempest: save the result of tempest execution
* volume: Introduce extend attached encrypted volume tests
* Adding description for testcases - identity part1
* Adding description for testcases - volume part1
* Add logs for plugins data
* Catch json.loads exceptions in verify\_device\_metadata
* Adding description for testcases - compute part2
* Explicitly handle baremetal ports when checking if they are active
* [Trivial]Do not use self in class method
* [Trivial]Add space between words in log message
* Adding description for testcases - compute part1
* Add show types API to v3 types client library
* Add glare and taas to blacklist
* compute: Add stable device rescue tests
* compute: Add missing 2.73 response schema validation
* Fix noVNC failed TCs
* Keystone - List user groups 'membership\_expires\_at' attribute
* compute: Add negative volume update multiattach test
* Pass clients to compute base's create\_test\_server
* Remove universal wheel building
* Update hacking for Python3
* Check no specific group present in group list
* Blacklist x/kingbird project from sanity-check
* Add --worker-file option in tempest
* Replace old requires-python with python-requires
* Fixes race condition in test\_add\_remove\_fixed\_ip
* Fix deletion of network quotas
* add unittest for create and list resource types association
* Create default network for compute volume and negative metadata tests
* Fixed test related to tag-ext
* Define default OS\_TEST\_TIMEOUT for every tempest tox env
* Add subnet\_id option
* Make tempest-multinode-full py2 job on py2
* Cleanup images properly
* add unittest for delete resource types association
* Ensure bootable volume is gone in scenario test before tearDown
* services: Introduce a cinder v3 attachments client
* Remove the deprecated tempest-account-generator CLI
* Remove devstack-plugin-ceph-tempest py2 job
* modify status code according to the latest API documentation
* Do not force live migration outside of Availability zone
* Modify the fake data for test\_networksks\_client for v3
* Modify the fake data
* Change bytes to str in servers\_client for python3
* Added fix to 'test\_delete\_saving\_image' testcase
* add unit test for delete\_group\_user method
* Do not specify a host for live-migration for non homogeneous nodes
* Set 3h timeout for tempest-ipv6-only job
* Deprecate spice\_console and rdp\_console config items
* Delete network quotas
* Add validation\_resources in test\_resize\_volume\_backed\_server\_confirm
* Re-enable the stable rocky job
* compute: Use wait\_for\_volume\_attachment\_remove when detaching multiattach volumes
* compute: Use valid extra specs to test 'os-extra\_specs' API
* Prevent SSH client proxy loops
* [ussuri][goal] Drop python 2.7 support and testing
* Update README for run-tempest role
* compute: Add volume and placement microversion support to BaseV2ComputeTest
* Disable stable/rocky temporarily on Tempest master
* Use stable constraint in run-tempest for stable branch testing
* Add missing waiter to test\_tagged\_attachment
* tox: Use python3 within tempestenv
* Drop python 3.5 support from Tempest
* Modify the incorrect fake data
* Change default region for placement to empty string
* Improve response data of test\_routers\_client
* compute: Deprecate [compute-feature-enabled]/block\_migrate\_cinder\_iscsi
* waiters: Add wait\_for\_volume\_attachment\_remove
* Removal of deprecated argument[os-tenant-name]
* Accept custom registered endpoints
* Remove indentation for bullet list
* Fix test\_stamp\_pattern to remove dependency of user supplied volume name
* Define python3 as basepython for Tempest tox env
* Add ConsistencyGroup Exceptions in tempest
* Create default network for more compute tests
* Add doc for supported OpenStack release & py version
* Add release notes page for version 23.0.0
* Remove the Queens stable branch jobs from master gate

23.0.0
------

* Support force-deletion of servers
* Add release notes page for version 22.1.0
* Add releasenote to tag the end of support for Queens
* Refactor methods to be used by other tests
* Create default network for more compute tests
* add schemas members for image
* Create default network for several compute tests
* Blacklist compute.volumes and compute.images API tests
* waiters: Rearrange image and volume waiter tests
* compute: Fix a typo within the v2\_71 servers response schema
* Add Access Rules tests
* Added stestr for running test using pdb flag
* Remove the deprecated verify-tempest-config CLI
* Fix app cred client unit test name
* Tempest cleanup: improve iterating over projects
* Extend cleanup CLI to delete regions
* add unittest for agent operation interface in network part
* Remove xvpvnc console type tests
* add unittest for list namespaces interface
* Remove test\_agent\_management tests
* Add a default network when creating a server
* Remove the security\_group\_default\_rules tests
* Add host validation after live migration
* Replaced testr with stestr
* add unittest for delete tag definition interface
* Complete missing interface test for test\_groups\_client in v3
* add unittest for list image members interface
* Fix test\_attach\_detach\_volume test case to not rely on user/libvirt supplied disk name
* Added tempest subcommand for subunit\_describe\_calls
* Close ssh client after executing a command
* Use python 3 on all nodes in multinode jobs
* Modify the response in test\_snapshots\_client
* Fix api-link for interface force\_detach\_volume
* Modify the wrong response example for test\_types\_client in v3
* Drop old neutron-grenade job
* Remove unused opensuse150 job definition
* Update test\_port\_list\_filter\_by\_ip pass conditions
* Modify the error fake date
* tempest-plugin-sanity: respect upper-constraints
* Disable c-bak service in tempest-full\* jobs
* Relax volume compare in test\_minimum\_basic\_scenario

22.1.0
------

* Fix reno typo
* Add workaround to handle the testtool skip exception in CLI test
* Modify the fake date
* Modify the application credentials fake data
* Add release notes page for version 22.0.0
* Add Tempest gate job for stable/train

22.0.0
------

* Add release note for log\_req\_body kwarg
* tempest cleanup - use admin\_mgr only
* Fix the logging of request body credentials
* Call tearDownClass when handling skip exception on setUpClass
* Remove timer and \_log\_request() calling
* Add releasenote to tag the Tempest for Train release
* Enable xindy for PDF build
* Modify the comment for backups\_client in v1
* Move logging from \_request() to raw\_request()
* Set irrelevant-files for bashate job
* Remove barbican-tempest-plugin from blacklist
* Address bug 1839794 on the Volume show version client
* Add assertNotEmpty to avoid IndexError
* Modify the create user fake data
* Use the IPv6 documentation prefix as the default cidr
* Added instructions about general IDE's in gitignore
* add unit test for list\_user\_projects method
* switch to the newly created opensuse-15 nodeset
* Modify the list project date
* Add irrelevant files to .zuul.yaml
* Move upload/download image action to right place
* Bump the openstackdocstheme extension to 1.20
* Add workaround to handle the testtool skip exception issue
* Add PDF building
* Add response schema validation for volume transfer
* Add a CONTRIBUTING file
* Fix volume host schema: host name may not contain '@'
* Remove required projects for sanity job
* Fix use of get\_server\_ip with fixed networks
* Allow overridding OS\_TEST\_TIMEOUT via the role variables
* "test\_project\_get\_equals\_list" allows extra fields
* Add group-based-policy to blacklist
* Add the api reference for roles\_client in v3
* Validation of openstack keystone version status
* Add response schema validation for volume quota\_set
* Modify the list group date
* Use create\_image\_from\_server to create image for server
* mke2fs: do not use full path
* Fix test\_novnc to adequately validate websocket upgrade
* Remove unused project\_ids in test\_list\_projects
* Add api reference for extensions\_client
* Add response schema validation for volume types
* Add rand\_name to create port incase of leaks
* Add response schema validation for snapshot manage
* Add api-ref link for some interfaces
* Fix the skipException message to follow a pattern similar to other messages
* Remove references to locking test accounts config doc
* Change ListProjectsStaticTestJSON to not fail with many domains
* Fix Tempest Plugin Registry page for plugins url
* Add assert statements for Volume Pagination test to get passed
* compute: fix missing img\_signature\_uuid property
* Add API reference for metering\_label\_rules\_client
* Add api reference in quotas\_client
* Modify the group types date
* Retry http requests to generate plugins list
* tempest cleanup fix return code
* Remove python shebangs from python modules
* add show detail for volume Api V3
* Fix Upstream test cases to be case insensitive
* Skip some tests in "network.admin.test\_ports" if nova is not enabled
* Do not delete server when task state is image\_snapshot
* Modify the API reference
* Modify the fake date to the correct value
* Make bashate E005,E042 error and ignore E006
* Remove x/ranger-tempest-plugin from BLACKLIST
* Revert "Use memcached based cache in nova in all devstack-tempest jobs"
* Fix remaining api-ref references
* Introduce bashate
* Setup framework for IPv6-only deployment verification
* Fix indentation in releasenotes
* Add release notes page for version 21.0.0
* Skip tests in UsersV3TestJSON with an immutable user source
* Use memcached based cache in nova in all devstack-tempest jobs
* Add segments client
* Update api-ref location
* Fix unittest of encryption\_types\_client
* Remove duplicated irrelevant-files for sanity check

21.0.0
------

* Add releasenote to tag the end of support for Pike
* Use skip\_checks in ServersTestMultiNic
* Add ranger-tempest-plugin to blacklist
* Add Python 3 Train unit tests
* Fix invalid original\_name key in flavor check
* Add 'single core approve' policy for plugins sanity jobs failure
* Define the Integrated-gate-object-storage gate template
* Define the Integrated-gate-compute gate template
* Define the Integrated-gate-placement gate template
* Skip tests in TrustsV3TestJSON with immutable user source
* Skip test\_server\_connectivity\_cold\_migration\_revert until fixed
* add show default group type details and unit test
* tempest cleanup should use keystone v3 client
* Remove the Pike stable branch jobs from master gate
* add unittest for volume encryption types
* Define the Integrated-gate-storage gate template
* Define the Integrated-gate-networking gate template
* Fix tempest run doc indentation
* Filter out floating IPs from server IPs list
* Remove nova-lxd plugin from blacklist
* Remove networking-ansible from tempest plugins list
* Remove cyborg-tempest-plugin from BLACKLIST
* Fix invalid assertIsNone state
* compute: Correctly pass certified\_image\_ref as image\_id
* Use assert\_flavor\_equal to check flavor before and after microversion 2.46
* Revert "Skip test\_server\_connectivity\_cold\_migration\_revert until fixed"
* Raise non 404 Error in generate-tempest-plugin-list.py
* Add project prefix to blacklist
* Stop checking the error message in test\_boot\_with\_low\_ram
* compute: Make image certificate validation a configurable feature
* Specify AZ for non-scenario tests
* Fix cleanup NotImplemented error
* Remove RetryFilter from defaults
* fup: fix docsting in manager.py
* Pass more accurate error message to DeleteErrorException
* Publish BLACKLIST on Tempest plugin registry page
* Publish non-openstack namespace tempest plugins
* Specify availability zone to create instances and volumes
* Minimum bandwidth allocation with placement
* Remove some deprecated auth and identity options
* Immutable user source: Non-admin V2 and V3 tests
* Move tox execution to current docs section
* Add QoS policies and minimum bandwidth rule client
* Add microversion support in scenario tests
* Break wait\_for\_volume\_resource\_status when error\_extending
* Fix invalid parameter passed to create\_volume
* Fix region leaks after testing endpoints
* Remove some deprecated identity options
* Print passed and failed plugins at the end
* Remove vitrage-tempest-plugin from blacklist
* Remove nova-cells-v1 job from experimental queue
* Change IPv6 ICMP security group rule check
* Replace git.openstack.org URLs with opendev.org URLs
* Add compute API response schema validation for 2.71
* Set default value for tox tasks
* Fix mismatch error due to map in python3
* Make plugin-sanity-check job as voting
* Add cyborg-tempest-plugin to required-projects and remove octavia
* Remove airship-tempest-plugin from blacklist
* Make dns\_servers option deprecated
* Remove legacy-periodic-tempest-dsvm-neutron-full-ocata
* Make test\_hotplug\_nic test first check the IP
* Revert "Refactor random naming"
* Improve ipv6 configuration
* Fix resource leaks in EndPointGroupsTest
* Enable volume backup tests
* [Trivial]Remove unused variable assignments
* Fix the bug of deleting security group after testing changing password
* Handle properly 404 responses from Neutron
* Add support for compute API v2.70 - os-volume\_attachments
* Handle 'path' query parameter for test\_novnc
* Introduce an attached volume migration test
* Use show\_quota\_class\_set after update\_quota\_class\_set
* Add assertions to attached volume retype test
* OpenDev Migration Patch
* Add the api type check when check the param of api\_microversion
* Fix invalid filter passed to list\_volumes
* Add APIMicroversionFixture to library interface
* Add unstable\_test decorator
* Skip test\_volume\_backup\_create\_get\_detailed\_list\_restore\_delete
* update identity role tests to work w/ pre-prov
* Ensure all image cache volumes are removed before removing the volume type
* Run integration jobs for requirements.txt changes
* Uncap jsonschema
* Fix test\_volume\_swap\_with\_multiattach
* Improve router deletion logging in tempest cleanup
* Improve logging in tempest cleanup
* Init placement client in tempest Manager object
* Mention autopep8 in Hacking.rst
* Unskip test\_stamp\_pattern
* Add Tempest gate job for stable/stein
* Add release notes page for version 20.0.0
* Add missing validation for the compute/positive
* Replace openstack.org git:// URLs with https://
* Remove the Ocata stable branch jobs from master gate

20.0.0
------

* Add releasenote to tag the Tempest for Stein release
* Default gabbi\_tempest\_path to empty string
* Checking config file actually exist or not in tempest run
* Fix potential issue with adding a fixed ip
* Update v3 identity inherits tests to work w/ pre-prov
* Use nova zuulv3 job for nova v2 API
* immutable user source: v3 test\_roles
* Immutable user source: v3 test\_inherits
* Use credentials domain instead of creating new one
* Set ENABLE\_VOLUME\_MULTIATTACH=true on tempest-slow subnode localrc
* Make type decorator compatible with unicode strings
* Remove LOG in misc.py
* allow create\_server with vnic\_type and port\_profile from kwargs
* Add autopep8 to tox.ini
* Add py37 tox env
* Remove unused and duplicate nodeset defined in Tempest
* Move tempest-tox-plugin-sanity-check to Bionic
* Fix openstack-dev ML ref in test removal process
* Remove admin test\_l3\_agent\_scheduler API test module
* Update json module to jsonutils
* Set concurrency default value
* no force\_tenant\_isolation in DefaultDomainTestJSON
* stestr expects --concurrency to be an int
* doc: fix compute API microversion list format
* Update neutron quota\_driver path
* Make tempest-slow run on stable branch also
* Make tempest-multinode-full job for stable branch
* Use rand\_password() for password when creating user
* Improved tempest plugin sanity check script
* Fix typo
* Add NetworkSubnetPools to tempest cleanup
* add python 3.7 unit test job
* Add unit tests for tempest cleanup
* Fix tempest cleanup
* Add profiler support into Tempest
* Update v3 identity group tests to work w/ pre-prov
* Conditionally mark test\_attach\_detach\_volume as slow
* Allow decorators.attr to be conditional
* Mark test\_server\_connectivity\_reboot as slow
* Mark test\_volume\_boot\_pattern as slow
* Remove deprecated services from cleanup
* Normalize endpoint path in oauth client
* Update v3 project tests to work w/ pre-prov
* Immutable user source: v3 test\_groups
* Update regions tests to work w/ pre-prov
* Fix tempest cleanup for python3
* Enable volume multiattach tests in tempest-full/slow jobs
* Make interop check job as voting
* Fix tempest cleanup AttributeError
* Current naming convention is uninformative
* Add tempest-slow-py3 job definition
* Add tempest-multinode-full-py3 job definition
* Convert result of hosts.values() to list always
* Raise renew\_delay in TestNetworkBasicOps:test\_subnet\_details
* Skip test\_subnet\_details slow test until bug 1813198 is fixed
* Fix E117 for pycodestyle (pep8) 2.5.0
* Remove warnings.simplefilter to suppress ResourceWarning
* Adding missing tests for regex and black-regex in tempest run
* Add black-list based tests for tempest run command
* Fix invalid exception module usage
* Add whitelist based tests for tempest run command
* Update v3 identity project tag test to work w/ pre-prov
* Log the result of command in get\_nic\_name\_by\_ip
* Add placement client for basic GET operations
* Ensure volume is deleted after build error
* Fix verify-config KeyError
* Immutable user source: v3 test\_projects
* Update v3 identity domain configuration tests to work w/ pre-prov
* Update v3 identity domain negative tests to work w/ pre-prov
* Update v3 oauth consumers tests to work w/ pre-prov
* Add unittest for types\_client
* [Trivial fix]Remove unnecessary slash
* Remove unnecessary setUp
* Move v3 project negative tests to work w/ pre-prov
* Move v3 identity endpoint group tests to work w/ pre-prov
* update spelling error
* Add missing ws seperator between words part 2
* fix port\_profile
* Use renamed template 'integrated-gate-py3'
* Remove unnecessary line of code
* Immutable user source: test\_default\_project\_id
* Add irrelevant-files for grenade-py3 job
* Transfer respository  to repository
* Move nova-cells-v1 job to the experimental queue
* Add device\_owner to gateway port search criteria
* Change openstack-dev to openstack-discuss
* Fixing ignored value of --config parameter in tempest account-generator
* Adding debugger in tox.ini
* Move test test\_list\_agents\_non\_admin to non-admin dir
* Check network connectivity of the instance before and after live migration
* Adding missing test cases of tempest workspace
* docs: Fix incorrect docstrings in reStructuredText format
* Support immutable user source
* Migrate tempest provided base jobs to bionic
* Use base.delete\_server in test\_servers.py
* Handling invalid path of workspace register and move
* Add missing ws seperator between words
* Add a blank space between "eui\_ip" and "when"
* addCleanup should be immediately after the creating statement
* [Negative] Extend volume over quota limit
* Improve the user lock config options help message
* Refactor cleanups for test\_trusts
* fix typos
* change http links to https links
* Add api ref link for import\_backup
* Fix required projects for sanity plugin check job
* Wait for IP add/remove in test\_add\_remove\_fixed\_ip
* interfaces\_by\_fixed\_ip no extra port
* docs: Fix plugin registry generation failures
* Pass tox\_extra\_args to Run tempest task
* docs: Include information about the list of supported projects
* Add response schema validation for volume messages
* trivial: Don't run integration tests on tools/.\* updates
* Deprecate available filters in favor of enabled
* Replace deprecated "decodestring"
* Mark network slow test as slow
* [Trivial Fix] modify spelling error of "resource"
* Add response schema validation for volume hosts
* Update REVIEWING docs with fast-track approval process
* Adding missing test cases in "test\_run.py"
* Add ipv6 tempest jobs
* GABBI\_TEMPEST\_PATH in tox passenv and devstack playbook
* Add response schema validation for volume services
* Adding missing test case of account generator resources
* Do not check account unlock if lockout config is 0
* Fix assert logic in test\_list\_security\_groups\_list\_all\_tenants\_filter
* Set max microversion 2.35 for nova floatingip and securitygroup
* Fix help message of user\_unique\_last\_password\_count
* Make connectivity test less backend dependent
* Remove duplicate legacy-tempest-dsvm-multinode-full job
* Make tempest-full-py3 not run for unit tests change
* Remove deprecated find\_test\_caller function
* Import periodic-tempest-dsvm-oslo-latest-full-master job
* Change way how second NIC in guest OS is configured
* Convert job legacy-periodic-tempest-dsvm-all-master
* Add response schema validation for volume limits
* Use remote\_client from tempest.lib.common instead of tempest.common
* Convert legacy-tempest-dsvm-neutron-pg-full to Zuul v3
* Fix Zuul usage of tempest-full
* Allow to create a rest\_client not following redirects
* Replace openSUSE experimental check with newer version
* Run static account tests based on tempest-full-py3
* Add response schema validation for volume quota classes
* Remove legacy-tempest-dsvm-cinder-v1
* Add response schema validation for volume extensions
* Add interop-tempest-consistency job in Tempest gate
* Fix test\_get\_config\_file to always work
* Handling invalid name of workspace register and rename
* Adding missing test cases of "test\_verify\_tempest\_config"
* Deprecate all-plugin
* Optimize and enhance the code of "test\_routers.py"
* Removing redundant spec value in account\_generator.py
* Use show\_volume\_type to check the result of update\_volume\_type
* Add response schema validation for volume capabilities
* Interface tests: wait for server to become SSHable
* Add test coverage CMD cleanup\_service
* Add delete\_agent to AgentsClient
* refactor v3 cred tests to work with pre-prov
* Add response schema validation for volume qos-specs
* swift: container ACL - use ID's for tenant and user
* Cleanup irrelevant-files list in .zuul.yaml
* Add missing test for "Show API v2 details" action
* fix: Re-clarify unit test REVIEWING documentation
* Removing redundant "if test\_resource.network" from account\_generator.py
* Optimize test\_volume\_swap\_with\_multiattach for server status wait
* Mark some slow tests as slow so they move out of the main job
* Fixed test\_compare\_volume\_stats\_values false failures
* Rename TestQuotasClient to TestHostsClient
* Make some test\_list\_projects tests work w/ pre-prov
* fix tox python3 overrides
* Adding unit test of setting config path for "tempest run"
* Fix docstring example in HACKING
* Default enable run\_validation
* Removing duplicate variable "parsed\_args.config\_file"
* Skip test\_server\_connectivity\_cold\_migration\_revert until fixed
* Skip 3.19 test\_reset\_group\_snapshot\_status
* Fix QuotasNegativeTest to use non dynamic credentials
* Fix an assert sequence in test\_image\_share\_accept
* Follow devstack-plugin-ceph job rename
* Fix deprecated\_name in the help message in config.py
* Run tempest-full(-py3) in stable/rocky
* Do not pass device when calling compute.base.attach\_volume
* Use openstack-tox-cover template
* switch documentation job to new PTI
* import zuul job settings from project-config
* Set CONF.image\_feature\_enabled.api\_v1 default to False
* Remove unnecessary response check in InstanceUsageAuditLogTestJSON
* Update .mailmap for ghanshyam emails
* Add check for hypervisor state before getting uptime
* trivial: Correct class name for BaseVolumeQuotasAdminTestJSON
* Remove unused config.CONF
* Remove unnecessary class variables
* Bump up python version of unit test
* Removing unnecessary else
* Add test for list snapshots with offset param
* Cleaning up a duplicated code
* Update .mailmap email addresses
* Do not set microversion for server diagnostics negative test
* Modify comment of scheduler\_available\_filters
* Fix nits and log from I996d257e089f0676e316f2b14207c343063ccf8e
* Prevent verify-config from IndexError
* Add Tempest gate job for stable/rocky
* Remove unnecessary class variable in v3 snapshots\_client
* Migration tests in v2.6 should not repeat all migration tests
* Use base.get\_host\_for\_server to get server host
* Remove unused compute.base.clear\_resources
* Add server schema for microversion 2.8
* Fix comments in rest\_client
* add python 3.6 unit test job
* Add release notes page for version 19.0.0
* Change schema hypervisor.cpu\_info from string to object in 2.28
* Fix typos in vnc-hardcoded-server-name-removed releasenotes

19.0.0
------

* Fix python pkg format issue
* Fix 'ref' format errors in README file
* Add releasenote to tag the Tempest for Rocky release
* Deprecate volume api selection config option
* Fix disabled\_reason's type in services schema
* Set max microversion 2.43 for add\_fixed\_ip
* Add server schema for microversion 2.63
* Add server schema for microversion 2.57
* Add server schema for microversion 2.54
* Fill servers schema gap in microversion 2.47/2.48
* Remove deprecated option volume\_feature\_enabled.api\_v1
* trivial: Fix some compute api\_schema formatting nits
* Remove base class complex and confusing variable
* Fill quota schema for microversion 2.36/2.57
* Fill aggregate schema for microversion 2.41
* Fixing test "test\_verify\_glance\_version\_no\_v2\_with\_v1\_1"
* Remove api\_version setting from volume v3/v2 service client
* Delete snapshot in test\_image\_defined\_boot\_from\_volume
* Add comment for schema change in microversion 2.13
* Fill schema gap in flavors.py
* Added tempest\_black\_regex to skip tempest tests
* Add comment for schema change in microversion 2.19
* Make volume client alias with \_latest suffix
* Adding links to git reference in docs
* Pass "access\_point" server to get\_remote\_client
* Convert tempest-scenario-all job to tempest-slow
* Fix typo xpvnc in get\_remote\_console schema
* use fqdn for zuul projects
* Add test for create volume from snap without size
* Use --os-endpoint-type for Cinder CLI
* Check API extension 'filter-validation'
* Add server schema for microversion 2.26
* Dynamic width count for plugin registry table column
* Add more information for InvalidCredentials exception
* Add server schema for microversion 2.19
* Add server schema for microversion 2.16
* Log server console output during create/get timestamp
* Fill server schema for microversion 2.9
* Modify limits fields according to microversion
* Hacking checks for negative test cases
* Add server schema for microversion 2.6
* Fix to enable \`--config-file\` option
* Set max\_microversion 2.35 for nova image tests
* Add etc/\*.conf files to .gitignore
* Fill servers schema for microversion 2.3
* Fix broken image api ref url
* Move server groups schema into its own file
* Move all volume v2 service client unit tests to v3 dir
* Skip verifying empty devices in test\_tagged\_attachment until bug is fixed
* Avoid server\_check\_teardown exception breaking tearDown
* Removing unused attributes from test\_run.py
* refactor: Prepare test\_list\_projects for pre-prov
* Use a smaller number for checking console log length
* Move creating server group from resource\_setup to setUp
* Make instance\_action\_events.traceback a non-required field
* Add server tags schema in servers.py
* Move volume v2 service client unit tests to v3 dir
* Remove unused class variables
* Replace volume size with configured value
* Remove unnecessary body assignment
* Skip list FIP test for neutron new behaviour
* Add irrelevant-files to nova-multiattach job in .zuul.yaml
* Bump hacking to 1.1.0
* Do not check flavor.id after Microversion 2.46
* trivial: Fix typos in the documentation page
* Correct the usage on listing neutron ports
* Set max\_microversion 2.43 for virtual\_interfaces tests
* Omit X-Subject-Token from log
* Cap additional nova-network tests at Queens
* Add additional log of meta\_data devices content
* Create port with port\_vnic\_type and port\_profile from config
* Switch to stestr in README.rst and the method name
* docs: Add information on test removal/interop to REVIEWING
* Added storyboard integration to tempest.lib decorators
* Use the same timeout as in the legacy job
* Remove deprecated allow\_tenant\_isolation option
* Port tempest-scenario-all to zuul v3
* remove skip for test\_connectivity\_between\_vms\_on\_different\_networks
* trivial: Fix typos in the test\_removal documentation page
* Add update\_service to compute services\_client library
* docs: Add HACKING information about test attributes
* Rename scenario job and make it voting
* Move live migration tests out of scenario job
* Add api refs for volume snapshots client and network agents client
* Move unset\_flavor\_extra\_specs to extra specs file
* Add compute microversion 2.61 schema in flavors\_client
* Add extra\_msg and server parameter to check\_vm\_connectivity
* trivial: fix some incorrect compute microversion references
* Move test\_tokens test to static
* Mark raw strings as such
* tox: Silence warnings from stdlib libraries
* Adding additional assertions for retype test
* refactor: Combine nearly duplicate group tests together
* refactor: Add setup\_test\_group to identity admin base test class
* no force\_tenant\_isolation in endpoint tests
* Add related bug info for resize test
* Adding test case for migration policy 'never'
* Update image creation error msg to mention the correct image type
* Run nova-live-migration job in check as n-v
* Improve Tempest workspace manager unit test coverage
* Cleanup v18.0.0 release notes' prelude
* Cleanup networks resources at test level
* Fix some typos on the types and encryption types client
* Move Stable branch Policy Doc outside of coding guide
* Add api ref links for snapshots and volume types clients
* Add extra apis to volume v3 services client
* Fix volume backup test
* Add status check for creating volume backup
* Fix TestInterfaceWaiters
* Add new schema for Nova microversion 2.63
* Filter out implied roles
* Move nova cell v1 job to check pipeline
* Revert "Add server name check for multiple creations"
* Fix typos replace seperate with separate
* Delete a cg-snapshot following updated volumes
* Move skip condition under skip\_checks method
* Cap nova-network tests at Queens
* Remove volume v2 service client warning
* Fix race condition in device tag testing
* Adding a note for test case test\_volume\_boot\_pattern()
* Fix tests for call\_until\_true function
* trivial: Fix reno typos
* Replace Chinese quotes with English quotes
* Write tempest-multinode-full as zuulv3 native
* Add api ref links for network agents\_client
* Remove force\_tenant\_isolation from Cinder tests
* Fix test\_http test case
* To cleanup the awaiting-state volume
* Document branch support policy for extended maint branches
* Remove python 2.6 docref
* Use inline literal markup for options in releasenotes
* Switch to use primary credential in volume backup tests
* Modify quota set fields according to microversion
* Add cinder v2 experimental job
* Fix indentation in README.rst
* Refactor random naming
* Add compute microversion 2.57 schema in servers\_client
* Assert volume deletion in test\_image\_defined\_boot\_from\_volume
* Integration tests for tagged attach
* Improve use of RemoteClient in device tagging test
* Add wait\_for\_interface\_detach method
* Add tests for wait\_for\_interface\_status
* Add test to shelve the paused server: bug# 1745529
* Add server name check for multiple creations
* Add compute microversion 2.54 schema in servers\_client
* Remove test\_get\_service\_by\_service\_and\_host\_name
* Move volume v2 service clients to v3 dir
* Volume Service Testing: default to v3 endpoints
* Use assertTrue and assertFalse vs assertEqual
* Cleanup ignored\_list\_T110.txt
* Migrate legacy scenario job to tempest in-tree
* Check status code when downloading empty file
* Backup and restore scenario
* Add service tagging for 'test\_iscsi\_volume'
* Add nova-live-migration to experimental queue jobs
* Fill update, rebuild, list API response schema for 2.47
* Fill update, rebuild API response schema for 2.26
* Fill update, rebuild API response schema for 2.19
* Fill update, rebuild API response schema for 2.9
* Add test Migrating a volume from created snapshot
* Replacing get\_vnc\_console with get\_remote\_console after microversion 2.6
* Fix listing servers by invalid status after V2.38
* Do not pass disk\_over\_commit after Microversion 2.25
* Trivial docstring cleanup in TestServerAdvancedOps
* Modify the empty list ensure method
* Add 2.55 schema & update flavor API in flavors\_client
* Follow the new PTI for document build
* Add job to run tempest-full with Python 3.6
* Add tests for application credentials
* Fix code to pass pep8 Tox environment
* Skip puppet-\* projects for plugin search
* Add common method to check the microversion compatibility
* Trivial: Fix the comment of TempestConfigPrivate
* Improve patch and patchobject Base test case method attributes
* Fix test\_snapshot\_list\_param\_marker when using predefined user
* Use new encryption provider constants
* Cleanup and rename test\_create\_ebs\_image\_and\_check\_boot
* Add identity v3 project tags client
* VNC harcoded server name removed
* Replace list\_hypervisors with list\_services
* Removing the skip decorator as bug 1687044 was already resolved
* Fix TypeError in \_unshelve\_server
* Fix a plural mistake REVIEWING.rst
* Fix a capitalization mistake in README.rst
* Docs: Elaborate on feature flag in HACKING file
* Don't use hypervisor\_hostname as compute hostname
* Set max\_microversion 2.35 for nova floating ip bulk tests
* Set max\_microversion 2.35 for nova network tests
* Fix image\_id KeyError in test\_create\_backup
* Set max\_microversion 2.35 for nova tenant network tests
* Set max\_microversion 2.35 for nova security group tests
* Updated from global requirements
* [Trivial]Add coverage for creating snapshot from non-blank volume
* Run all scenario in parallel
* Do not fail on stackviz issues
* Replacing deprecated list\_hosts with list\_hypervisors
* Add verbose option for stdout in subunit\_describe\_call
* Fix expected response code of show\_image\_file
* Set max\_microversion 2.38 for nova image-metadata tests
* Fix typos in release notes
* Fix test\_host\_name\_is\_same\_as\_server\_name
* Add project\_tags identity feature flag
* Updated from global requirements
* Skip adding host to aggregate with az if host already in other zone
* Set max\_microversion 2.42 for hosts tests
* Updated from global requirements
* Update links in README
* Rename duplicated class name AttachVolumeMultiAttachTest
* Remove unnecessary indentations in releasenotes index
* Add release notes page for 17.1.0 & 17.2.0
* Add volume-attached resize revert server test
* Add nova-cells-v1 to experimental queue jobs
* Update port profile only if defined
* Use create\_test\_server wrapper for server creation
* [Trivial]Add coverage for extending non-blank volume
* Do not use skip\_checks in TestVolumeBootPattern
* Add release notes page for 18.0.0
* Use fetch-subunit-output role

18.0.0
------

* Add releasenotes to mark the start of Queens support, newton EOL
* Reno for tempest run CLI new arg and fix
* Update image using 'owner' parameter
* Add support for blacklist file for Zuul jobs
* Add unit test for tempest run --config-file
* allow to config port binding:profile
* update the home-page url
* Fixing the condition to run tests in tempest run
* Add test for tempest run with a whitelist file
* Add a black\_regex flag to tempest run
* Fix the -l/--list-tests argument for tempest run
* Cleanup selection list args in tempest run
* Add missing env vars from unit test job
* Remove duplicate unit test module
* Move share code to \_create\_server\_with\_group
* Remove leftover call to \_create\_stestrepository
* Enable tempest-full on stable/pike
* Fix misuse of assertTrue
* Connect to default ports if none are specified
* Refactor config drive mounting
* Remove outdated comment in .zuul.yaml
* Make queens jobs voting
* Create image using 'owner' parameter
* Add default value for CONF.auth.admin\_domain\_name
* Switch Tempest CLI commands from testrepository to stestr
* Fixes test\_device\_tagging IndexError
* Add stable/queens version of the full neutron job
* [TrivialFix] Remove unused statement in scenario/manager.py
* Add simple compute API test to create server with utf8 name
* Add show quota details to network quotas\_client library
* Fix image namespace test logging
* Add test for showing encryption specs item
* Add 'doc' tag for bug link on doc theme
* Fix a broken volume group api ref link
* Deprecate list\_servers\_on\_hypervisor and search\_hypervisor in v253
* Add a negative test about attaching a in-use volume to the different server
* Remove redundant py3 integration job
* Refresh server data after fip is assigned
* Do not run stage-output again in Tempest
* Zuul: Remove project name
* Delete identity domain must delete its contents
* Add test for IP substring filtering
* Fix the default value of stage\_dir
* Fix compute api ref links
* Do not test create\_interface\_by\_fixed\_ips if no isolated network
* Update api-ref for bug#1602400
* Use '\_live\_migrate' instead of '\_migrate\_server\_to' in test\_live\_migration.py
* Remove unnecessary alias for service clients
* Delete base module not applicable definition
* Delete meaningless and unused parameters
* Disable warnings as errors for sphinx
* Replace curly quotes with straight quotes
* Add the nova-multiattach job to the check/gate queues
* Add multi-attach swap test
* Add resize test for multiattach volumes
* Add a few tests for cinder multiattach
* Fix creating release notes using tox -e venv -- reno new <slug>
* Make tempest-full-py3 voting
* Updated from global requirements
* Add a py3 integration test
* Neutron test cases create,list,update port failed
* Fix broken compute api ref links
* Remove deprecated 'orchestration' config group options
* Remove deprecated config options 'resources\_prefix'
* Handle missing flavor.id in server response
* Restrict test\_list\_endpoints\_for\_token to tempest
* Get func.\_\_class\_\_.\_\_name\_\_ if no attribute \_\_name\_\_
* Fixed misspelling in test code
* Add test case for group type specs APIs
* Remove unnecessary setup\_clients methods
* Updated from global requirements
* Updated from global requirements
* Add show default quotas API to network quotas\_client library
* Add status='ACTIVE' when using changes-since as filter
* Add flavor check after resize server
* Follow the new PTI for document build
* Rename tox\_venvlist
* Remove 'deactivate\_image' config options
* Handle creating an image from a server with microversion > 2.35
* Decouple AttachVolumeShelveTestJSON from AttachVolumeTestJSON
* Do not select inactive l3 agent in L3AgentSchedulerTestJSON
* Default to using neutron networks\_client in get\_tenant\_network
* CLI tests: Identity v3 (project name, api version)
* Do not override stage-dir in tempest post
* Relocate branch conditional for tempest-full job
* Do not skip entire testcase if floating\_ip is not enabled
* Use tenant\_network if any in testcases after microversion v2.37
* Add same extra specs as self.flavor\_ref for created new flavor
* Add NOTE related to 'on-demand' migration
* Wait for server to be active in test\_device\_tagging
* Only run tempest-full on the master branch
* Add some missing implemented microversion in doc
* Skip testcases when shared nets are found in AutoAllocateNetworkTest
* Support only volume api\_v3 is enabled
* modify params transfer mode in test\_snapshot\_manage
* Change containers to list if string
* Revert "Use a non admin privileges for retyping a volume"
* Ignore a Cinder volume's "updated\_at" field
* Rename a method to avoid camel case
* Remove BaseV\*ImageAdminTest class
* Use wraps decorator
* Fix the mistake of code indent
* Do not use class variable for clients in ContainerSyncTest
* Document how to write multiline regex with comments
* Remove redundant tempest-full
* Fix an outdated comment referencing nova-volumes
* Add some api ref links for network service clients
* Fix broken swift ref links
* Modify log message in debug\_ssh
* Update Octavia plugin
* Fix create\_volume\_snapshot under scenario
* Use addClassResourceCleanup in test\_container\_sync
* Updated from global requirements
* Add release note about the ostestr tox job
* Remove resource\_cleanup from test\_object\_version
* Add skip checks for snapshot manage and group snapshots tests
* Add CONF.compute\_feature\_enabled.volume\_backed\_live\_migration
* Use addClassResourceCleanup in account service test
* Add negative test for attaching an attached volume to the same instance
* Add update groups types API endpoint to volumes v3 library
* Remove force\_tenant\_isolation from FloatingIPAdminTestJSON
* Use addClassResourceCleanup in test\_inherits
* Remove deprecated 'forbid\_global\_implied\_dsr' feature flag
* Set OS\_TEST\_LOCK\_PATH default value in fake\_config
* Fix a misspelled addClassResourceCleanp in tempest doc
* Remove confusing comment in common/compute.py
* Stop running plugin-sanity job for doc and req changes
* Remove find\_stack\_traces.py
* Fix a missing preposition in plugin doc
* Use addClassResourceCleanup for cleanup in identity users test
* Use addClassResourceCleanup for cleanup in test\_regions
* Revert "Update volume-status waiter for new cinder attach"
* Add addOnException of unshelve\_server when using sharing server
* Use addClassResourceCleanup for the cleanup of network resources
* Use addClassResourceCleanup for cleanup of service
* Avoid tox\_install.sh for constraints support
* Initial tempest-full job
* use addClassResourceCleanup in test\_roles
* Add IPv6 support to create\_websocket()
* Only use stestr and tempest run in tempest tox jobs
* Use addClassResourceCleanup in test\_list\_projects
* Refactor volume groups and group snapshots tests
* Remove deprecated skip\_unless\_attr decorator
* Updated from global requirements
* Move wait\_for\_interface\_status into \_check\_interface
* Fix verbose grammar
* Stop using resource\_cleanup in identity\_v3 tests
* Make shelved\_offload\_time's help message more specific
* Use addClassResourceCleanup for cleanup of volume resources
* Use service tagging 'decorators'
* Add the verify of network\_id in \_test\_create\_interface\_by\_port\_id
* Change Conflict's error message
* Remove a redundant self argument in decorators
* Add docs for running a single test
* Use addClassResourceCleanup to cleanup floatingips
* Fix a pointer to NotFound exception

17.2.0
------

* Fix docs markup consistency
* Add some verify in test\_create\_ebs\_image\_and\_check\_boot
* Keystone v3-ext/OS-ENDPOINT-POLICY endpoints implementation
* Don't check console output if not available
* Use zuul v3 for running tempest plugin sanity check
* Fix indentation in docs
* Add role to build the stackviz report
* Add compute test for ServerGroupAffinityFilter
* test\_network\_v6: log console when test fails
* Remove setting of version/release from releasenotes
* run-tempest role: new tempest\_test\_regex variable
* Adds protocol options for test\_cross\_tenant\_traffic
* Update URL from "http" to "https"
* Updated from global requirements
* Edit documentation for account-generator
* Fix volume v1 api ref links
* Fix directory tree appearance in document
* Add support of args and kwargs in call\_until\_true
* Move and update test\_resize\_volume\_backed\_server\_confirm
* Updated from global requirements
* Remove unnecessary argument in "skip\_because" decorator
* Stop using resource\_cleanup in identity\_v2 tests
* Process test results from a tempest run
* Add post step to Tempest base job
* Initial skeleton for devstack-tempest base job
* Don't use server\_id class variable in \_test\_resize\_server\_confirm
* Add a .htaccess for redirecting old paths
* Modify the help message for getting identity extensions
* Use addClassResourceCleanup to clear domains
* test\_mtu\_sized\_frames: sanity check connectivity first
* Use addClassResourceCleanup in BaseImageTest
* Fix doc issue in plugin.py
* Fix AssertionError in test\_rand\_password\_with\_len\_2
* Change description of annotation
* Ensure project get and list have match
* Remove deprecated volume apis from v2 volumes client
* Fix fixed\_ips tests to skip if ip not found
* Fix 'tempest cleanup' for volume service client
* Use addClassResourceCleanup in MeteringTestJSON
* Add unit tests to check for CONF getattr during import
* Remove v2 identity from tempest cleanup command
* Add support for "per\_volume\_gigabytes" and "backup\_gigabytes" quota
* Use addClassResourceCleanup in TagsExtTest
* List auth domains v3 identity endpoint

17.1.0
------

* Convert cleanup with addClassResourceCleanup in endpoint test
* Add release notes for an queens intermediate release
* Remove routers\_client from manager.\_create\_subnet
* Fix test case for updating volume type extra specs
* Don't read config in cred\_factory module
* Make test.py and clients.py as stable for plugins
* Add proxy\_url to get\_credentials in auth
* Cap compute floating IPs tests
* Don't read config in Manager class definition
* Disable testing of the v2.0 identity API
* Remove \_create\_router in scenario.manager
* Rename scenario.manager.\_create\_port to create\_port
* Fix "import xx as xx" grammer
* Move the object client to tempest.lib
* Add config options to set proxy\_url
* Remove scenario.manager.rebuild\_server
* Updated from global requirements
* Do not set alias user\_client for specific client
* Remove \_check\_remote\_connectivity in scenario.manager
* Remove specific project checking in test
* Allow to specify user and project domains in CLIclient
* Only attempt to detach an in-use volume during cleanup
* Rename base.rebuild\_server to base.recreate\_server
* Refactor of \_check\_tenant\_network\_connectivity
* Setup networking for live migration tests
* Remove method get\_ipv6\_addr\_by\_EUI64
* Update README to use stestr instead of testr for unit tests
* Fix object\_client methods to accept headers and query param
* Remove wrapper methods from object\_client
* Expose bug: Delete identity domain with contents
* Fix senario test: test\_swift\_acl\_anonymous\_download
* Move object storage container\_client to lib interface
* Add release note for --load-list
* Fix create container method
* Add compare header version to test images oneserver
* Remove \_project\_network\_cidr in security group tests
* Remove unnecessary global variables
* Fill microversion doc for implemented volume tests
* Use get\_tenant\_network in get\_server\_ip
* Remove unnecessary client alias in AvailabilityZoneTestJson
* Add test case for reset group snapshot status
* Fix volume group test
* Remove unnecessary assertIn
* Remove redundant volume check in nova\_volume\_detach
* Add compare header version to create\_image\_from\_server helper
* Remove internal helper \_default\_security\_group
* Add missing addCleanup of \_delete\_group\_snapshot
* Delete a volume by Non-admin privileges
* Fix create, update or delete container metadata method
* Make list methods consistent for container client
* Move internal helpers to the class that uses them
* Remove deprecated APIs from volume v2 volumes\_client
* Remove deprecated skip decorators
* Fix the 'service' decorator path in doc
* Remove unneeded resource\_cleanups in compute tests
* Compute volumes via addClassResourceCleanup
* Compute SG via addClassResourceCleanup
* Compute servers via addClassResourceCleanup
* Remove one-line helper \_delete\_volume
* Add test case for reset group status
* Fix list\_group\_snapshots API in v3 group\_snapshots\_client
* Updated from global requirements
* Fix a typo of a missing letter
* Switch to use stestr for unit tests directly
* Move identity\_utils to common.identity
* Add unit tests for not overriding setUpClass
* Add unit tests for test class fixtures
* Prepare setup\_clients and resource\_setup
* Prepare setup\_credentials as stable
* Move object storage account\_client to lib interface
* Use glance client to delete an image
* Updated from global requirements
* Compute images via addClassResourceCleanup
* Remove unused \_add\_router\_interface\_with\_subnet\_id helper
* Prepare skip\_checks as stable interface
* Make skip\_checks and setup\_creds safe
* Prepare network\_resources as a stable interface
* Make validation\_resources a stable interface
* Stop implicit validation\_resources provisioning
* Remove unnecessary executable permissions
* Make resource\_cleanup stable
* Add a validation resources fixture
* Capture logs when running unit tests
* Fix the redundant use of netaddr.IPNetwork
* Remove unnecessary class variable
* Remove unused RFCViolation
* Remove "test\_create\_with\_nonexistent\_volume\_type"
* Remove unused helper in RoutersTest
* Remove useless check in AttachInterfacesTestJSON
* Remove unnecessary back slash
* Make validation resources leak safe
* Get cidr/mask\_bits according to ip\_version in resource\_setup
* [DOC] Fix "Title level inconsistent" warning
* Only choose available compute node as migration dest
* Move data directory under doc/source
* doc migration: update the doc link address
* Fix addCleanup in AutoAllocateNetworkTest
* Add --load-list argument to tempest to accept a non-regex whitelist
* Fix addCleanup order in test\_volume\_list\_param\_tenant
* Use create\_volume wrapper for volume creation
* Add cost time printing in wait\_for\_volume\_resource\_status
* Add compare header version function to tempest.lib
* Fix for resetting snapshot status
* Fix the test case for showing host
* Avoid using v3 volume clients when v3 is disabled
* Add release notes page for v17

17.0.0
------

* Add release not to mark the start of Pike support
* Fix volume microversion link in doc
* Use skip\_checks instead of skipUnless
* Add support for IPV6 tests in tempest
* Add params to upload\_volume command
* Updated from global requirements
* check is\_admin\_available for force\_tenant\_isolation in test.py
* [TrivialFix] Add bug reference to releasenote
* Added unit tests for blacklist and whitelist
* Use networks floatingips client to associate fips
* Use skip\_checks if all testcases have same skip conditions
* Do not use self.name for volume name field
* Fix for resetting volume status
* Test shared and non-shared external networks
* Move test decorators to common
* Use a non admin privileges for retyping a volume
* TrivialFix for flake8 and docs build in tox.ini
* Fix RemoteClient having bad default ssh\_shell\_prologue
* Remove unnecessary schema check of ip address
* Test nonexistent volume type extra\_spec name instead of id
* Add detail specific fields check in list\_backups
* Fix identity tests when domain specific drivers are enabled
* [TrivialFix]Remove unnecessary value taking
* [TrivialFix] Remove unused statements in compute tests
* Add comments for test module of tempest.test.idempotent\_id
* Updated from global requirements
* Fix unit test that break isolation
* Remove unused variable assignment
* Remove unused assignment
* Add compute test for ServerGroupAntiAffinityFilter
* Resolve TODO in test: 'test\_available\_volume\_retype\_with\_migration'
* Stop passing around dicts in validation resources
* Add docstring for validation resources
* Fix client usage in validation resources
* Drop validation resources dependency from CONF
* Update and replace http with https for doc links in tempest
* [Trivialfix]Fix typos in tempest
* Remove unnecessary class Inheritance
* Remove unnecessary resource\_setup in DvrRoutersNegativeTest
* Do not run test\_create\_server\_with\_scheduler\_hint\_group twice
* add detaches to attachment test
* Volume and group on same backend in update\_group
* Do not create server in test\_list\_servers\_filter\_by\_exist\_host
* Remove unused global variable
* Do not print empty list in assertNotEmpty
* Py3: Finish the python3 port
* Refactor test\_user\_update
* Mark credentials\_factory stable for plugins
* Remove dependency to identity v2
* Make sure test use the latest volume clients
* Add Tests for Groups Volume APIs - Part 4
* Move schedule filter check to compute module
* Remove usage of credentials\_factory.AdminManager
* Increase unit test coverage for v2 images client
* Fix microversion doc for implemented microversion tests
* Add Tests for Groups Volume APIs - Part 3
* Fix verify config API version checks
* Add unit test for volume availability zone client
* Remove redundant comments in credentials\_factory.py
* Add release notes for client registration changes
* TrivialFix: Remove the unused import code
* Add test for showing volume image metadata
* Moved releasenotes from tempest package to proper location
* Do not call another testcase in one testcase
* Remove unnecessary assertIsNotNone check
* Add network internal connectivity check to VMs
* Remove unnecessary checks already coverd in schema
* Remove \_list\_assertions from test\_roles.py
* Remove unnecessary asserting for 'id' in body
* Fix broken api links in lib/services
* Judge skip conditions in skip\_checks instead of in resource\_setup
* Fix disable\_ssl\_certificate\_validation values if ca\_certificates file is defined
* Remove unnecessary usage of instance variable
* TrivialFix: Remove the unused import code
* Unsupported 'message' Exception attribute in PY3
* Updated firewalls deafult port reference to Newton
* Make verify\_tempest\_config workspace aware
* Fixed the broken links for api microversion
* TrivialFix: Correct reST field lists in docstrings
* Updated from global requirements
* Try to register all service clients
* Remove support for py34
* Fix some nits in object storage clients release notes
* Import data\_utils from tempest.lib.common.utils
* Add Tests for Groups Volume APIs - Part 2
* Revert "Remove tempest.common data\_utils"
* Move object storage capabilities\_client to lib interface
* Remove deprecated test.related\_bug decorator
* Move object storage bulk\_middleware\_client to lib interface
* Complete credentials\_factory docstrings
* Add unit test for volume limits client
* Add unit test for volume extensions client
* Fix object storage capabilities client return value
* Updated from global requirements
* Add Tests for Create/Delete/Show/List Group Types
* Add better docs on credential providers
* Migrate the preprov creds module to tempest lib
* Migrate the dynamic creds module to tempest lib
* Ensure test for Neutron GET / uses right URL
* [DOC BLD FIX] Correct reST field lists in docstrings
* Fix object storage bulk middleware client return value
* Remove creds providers dependency from clients
* Added return statement to retype\_volume in v2 volumes\_client
* Add volume backed instance coverage to API tests
* Fix account generator unit tests
* Make credentials\_factory a bit nicer
* Update the documention for doc migration
* Unix style line ending
* test\_boot\_server\_from\_encrypted\_volume\_luks skip condition
* Add unit tests for volume and snapshot manage clients
* Updated from global requirements
* Cleanup the orchestration client init and attr
* Remove unused clients from testcases
* Move multi-nic tests to dedicated module
* create test to verify catalog standardization
* Generic method for creating a volume snapshot
* Handle volume API version enablement
* Test size extend for an attached volume
* Fix instance\_action\_events response schema for finish\_time and result
* Using fixtures instead of deprecated mockpatch module
* Refactor volume clone tests
* Remove unused tenant\_cidr from test\_routers.py
* Use cls instead of self in classmethod
* Remove unused LOG from clients.py
* Add flag to generate tempest plugin list
* Doc: fix markups, capitalization and add 2 REVIEWING advices
* Add a page for release 16.1 to release notes
* Added script for doing tempest plugin sanity
* Add 'params' argument to v2 list\_backups API

16.1.0
------

* Add release notes for an intermediate release
* Supplement unit tests for volume transfers client
* Extra compute services\_client API endpoints
* Updated from global requirements
* Dynamic creds does not support create subnet with ipv6
* Add Networks client unit tests
* Add test case for update volume backup
* Add test for showing snapshot metadata item
* Fix check\_service\_client\_function doc typo
* Add test for showing volume metadata item
* Move base\_client from volume.v3 to volume
* Switch from oslosphinx to openstackdocstheme
* Boot server from encrypted volume
* Fix import error "No module named six.moves" for plugin sanity job
* Update volume-status waiter for new cinder attach
* Add response assertions and remove unused variables in volume tests
* Added --rmdir flag to workspace remove
* Pause resource cleanup
* Fix image deletion checks after unshelve server
* Tidy up releasenotes
* [Doc] Remove html\_use\_smartypants config in doc
* Add token related API to Keystone v3-ext/OS-OAUTH1 client
* Fix no attribute 'urlopen' error in python3
* Add negative test for live migration
* Adds \*\*params to v3 list\_endpoints
* Enhance v3 list\_services to test filtering by service type
* Updated from global requirements
* Add Scheduler Stats client unit test
* Handle the case that RFP negotiation message arrived early
* Add api-ref url for compute list\_baremetal\_nodes
* Adding and removing bytes\_body param from unit tests
* Add network tags-ext API tests
* Tests for Nova instance diagnostics (microversion v2.48)
* Fix skip checks in volume and snapshot manage tests
* Add api-ref urls for some volume v2 APIs
* Xenapi: Fix tempest for xenserver device tagging
* Fix check\_service\_client\_function mock\_args bug
* Add Quotas client unit tests
* Fix auto allocate network cleanup
* Wait for server deletion if validation setup fails
* Enhance tempest client for keystone v3 token APIs
* Added tests for Nova microversion v2.47
* Implement tempest client for keystone v2 token APIs
* Save state of cloud before running tempest
* create a non-admin token validation test
* Add expect\_response\_code to base network client
* Add Capabilities Client unit tests
* Updated from global requirements
* Fix test\_volume\_migrate\_attached to retype as admin
* Add Floating IPs client unit tests
* Fixed project lists for retrieving tempest plugins
* Remove unused variables from api tests
* Add Metering Label Rules client unit tests
* Add Metering Labels client unit tests
* Add Extensions client unit tests
* Add Ports client unit tests
* Verify config support cinder on subpath
* Fix for unmanage and manage snapshot
* Add network tags client
* Use urllib2 instead of requests in tempest generate plugin list
* ported tools/\*.py scripts to python3
* Update "test\_unmanage\_manage\_snapshot" test to support some params
* Do not use any() to check whether a list is empty
* Replace assertGreaterEqual with assertNotEmpty
* Update "create\_server" to wait until status is 'ACTIVE'
* Fix class name for test extensions
* Update server nic handling for LXD style nic names
* Fix html\_last\_updated\_fmt for Python3
* Replace assertions with more specific ones
* Add notes for network and identity in get\_service\_list
* Remove unnecessary wait\_for\_volume\_resource\_status
* Fix 4 bytes utf8 char test comment for create images
* Use @test.services instead of skipUnless
* Test coverage for network v2 security group rules client
* Test coverage for network v2 security groups client
* Use Neutron (if available) to create floating IPs for validation
* Remove unused variables from scenario tests
* Remove TODO comment
* Fix minor header wordings
* Use assert(Not)Empty,IsNotNone instead of assert(Not)Equal,GreaterEqual(0, len(.
* Unit test for asserting correct url in list\_services
* Fix DeprecationWarning in test\_volume\_pools.py
* Add server group API schema for microversion 2.13
* Updated from global requirements
* Use create\_volume classmethod
* Fix broken api urls in TypesClient
* Add server param in manager.get\_remote\_client
* Fix url in list\_services
* Reuse v2 extension client for cinder v3
* Prevent error in \_parse\_resp when nullable list
* Fix ssh proxy regression
* Replace the usage of 'manager' with 'os\_primary'
* Remove the exception description of auth\_version in doc
* Fix for volume quota class test
* Use data\_utils in tempest.lib.common.utils
* Replace the usage of 'admin\_manager' with 'os\_admin'
* Stop warning on client\_parameters
* Replace the use of 'os\_adm' with 'os\_admin'
* cls.os is deprecated use cls.os\_primary
* Check image after unshelve
* Remove undefined variable in exception message
* Test coverage for network v2 subnetpools\_client
* Add T115 for admin test path
* Add option for whether the cloud supports floating ips
* Replace the usage of 'os' with 'os\_primary'
* Separate admin tests from test\_routers
* Add max\_microversion for compute volumes\_extensions\_client tests
* Test coverage for network v2 subnets\_client
* Create deleted server in resource\_setup
* Updated from global requirements
* Fix volume attach tests failing when using FIP as ssh method
* Replace assertEqual([], items) with assertEmpty(items)
* Deprecate default value for v3\_endpoint\_type
* Add check after unset\_flavor\_extra\_spec
* Add additional assertions for volume transfer test
* Using fixtures instead of deprecated mockpatch module
* Reduce server rescue/unrescue times
* Update document theme and section headers
* Correct invalid client in ServersNegativeTestMultiTenantJSON
* Raise exception when error\_deleting
* Remove duplicated test\_list\_servers\_by\_limits
* Add test case for show volume summary
* Using fixtures instead of deprecated mockpatch module
* Skip test\_volume\_extend\_when\_volume\_has\_snapshot until bug 1687044 is fixed
* Share a server in ServersOnMultiNodesTest
* Remove base\_routers module
* Switch BaseAdminNetworkTest on test\_routers\_dvr
* Move methods related to metering\_label
* Use a helper to create aggregate
* Separate admin test from RoutersNegativeTest
* Remove \_remove\_router\_interface\_with\_port\_id()
* Fix deprecation warnings
* Fix for implied roles test
* Move logging extensions list before assert checks
* Remove unused \_delete\_router()
* Correct skip condition for migrate\_server
* Remove the heat tests
* Change Cinder api\_v3 config True on default
* Add Tests for Groups Volume APIs - Part 1
* Revert "cinder backup force-delete when backup is error"
* Move network admin test classes under admin path
* Fix recent releasenotes typo
* Use min\_count to create servers in ListServersNegativeTestJSON
* Create a server in resource\_setup in ImagesOneServerTestJSON
* Updated from global requirements
* Remove redundant api client in volume tests
* Add test case for showing host details
* Volume snapshot backup
* Create a snapshot from a in-use volume with force=False
* test.py: stop using aliases for creds manager
* Move compute admin test classes under admin path
* Log output of lsblk cmd if test\_device\_tagging failed
* Add test for cinder volume extend when volume has snapshot
* Update 'test\_volume\_upload' test docstring
* Fix bugs about 'default' domain
* Nova: test live migration with serial console
* Keystone v3 extension os-ep-filter api testcases
* Add python3-dev(el) to bindep.txt
* Skip when force\_tenant\_isolation=true and no admin credentials
* [Negative] Create a volume from deactivated image
* Add test case for force detach volume
* Update help text for block\_migrate\_cinder\_iscsi option
* Use image native api in volume tests
* Replace oslo\_utils.timeutils.isotime
* Replace deprecated function
* Add api\_v2\_admin flag
* Add docstring example for get\_opt\_lists
* Remove deprecated TYPE in rest\_client
* Use base.create\_domain to create domain in testcases
* Update .mailmap
* Add test about associate floating\_ip to VM
* Identity V3 - Endpoint Groups Client
* test\_l3\_agent\_scheduler: remove workaround code for Liberty
* Identity V3: create\_domain() must return a description field
* Deprecate the forbid\_global\_implied\_dsr cfg option
* [Negative] Create volume from image with decreasing size
* Always provision accounts with auth\_version
* Fix the position of the dots in write\_tests.rst
* Move 'test\_admin\_deactivate\_reactivate\_image' test under non-admin directory
* Remove unused compute networks client in volume tests
* Remove duplication of skip\_tracker
* Fix create, update or delete account metadata method
* Make delete\_volume in volumes\_client.py use \*\*params
* Use base.setup\_test\_project to create project
* Use base.setup\_test\_tenant to create test tenant
* Rename 16.0.0 release notes
* Add support to list volume transfers with detail
* Identity v3 Domain Configuration Client
* Remove some debug print statements
* Remove usage of deprecated get\_ipv6\_addr\_by\_EUI64 function
* Move InvalidServiceTag
* Add a page for release 16 to release notes
* Improvement in API Microversion testing doc
* Tag test\_create\_server\_invalid\_bdm\_in\_2nd\_dict as needing cinder
* Enhancement of tempest cleanup documentation
* Add write tests docs for using client managers and credentials
* Use sequence directly instead of using len()
* Move the \`attr\` decorator from test.py to tempest/lib
* Deprecate Heat/Orchestration configuration options
* Improve docstring examples

16.0.0
------

* Move the \`related\_bug\` decorator from test.py to tempest/lib
* Remove leading underscore in \_create\_test\_user
* Cleanup services decorator
* Stop using self.parameters for compute clients
* Fix and improve ServiceClients docstring examples
* Prepare release notes for release 16.0.0
* Add test cases for volume quota class
* Fix invalid values when setting config options' default value
* Fix test\_volume\_list\_with\_detail\_param\_marker
* Deprecate client\_parameters from ServiceClients
* Remove skip condition when resize is enable
* Updated from global requirements
* Use cliff.lister for tempest workspace command
* cinder backup force-delete when backup is error
* Make bash shebangs through /usr/bin/env
* Refactor resource cleanup methods in compute.base
* Remove test\_baremetal\_nodes from tempest
* Add Apache License content in .py files
* Add judgie condition after live-migration with volume
* Add name param in setup\_test\_role
* Support testing nova-novncproxy on SSL
* Fix api ref link in TransfersClient
* Format multi-line release notes properly
* Beautify assertEmpty and assertNotEmpty
* Fix broken api link and put api link in one line
* Fix heading levels in write\_tests doc
* Remove non-existent config options of oslo modules
* Remove oslo.i18n entry from config-generator
* Add test of remove all security groups in test\_server\_actions.py
* Skip arbitrary container tests for Ceph
* Remove duplicated testcase test\_get\_private\_image
* [DOC] Fix details of tox
* Remove tempest.common data\_utils
* Remove 'allow\_port\_security\_disabled' option
* Add size assert for creating volume snapshot
* Delete volume with associated snapshots
* Separate volume v2 transfers service clients
* Add Nova version log
* Remove 'dvr\_extra\_resources' option
* Remove 'reseller' config option
* TestSecurityGroupsBasicOps: log console from access point instance
* Set default value of 'dvr\_extra\_resources' option to False
* Use min\_count to create multi servers
* Fix no module unit test for Python3.6
* Fix flavor info in server response schema
* Add additional roles method to v3 roles client
* Move cinder tests into unversioned path - part2
* Rename test-removal.rst
* Move Cinder non-admin tests into unversioned path
* Add volume backup container parameter
* Fix tox coverage section
* Move test\_volume\_manage to unversioned path
* Add tempest test writing guide
* Rename server arg in wait\_for\_interface\_status method
* Remove a redundant client variable
* Correct the module path for decorators
* Reduce the time waiting for server ACTIVE
* Updated from global requirements
* Add random name in volume.base.create\_backup
* Fix API reference links in volume/snapshot/type client
* Move Cinder admin tests into unversioned path
* Rename Cinder V2 API tests
* Remove deprecated compute config options for validation-2
* Glance supports vhdx disk\_format
* Removing py34 from tox
* Fix API reference links in volume client
* Correct invalid param in create\_volume
* Remove unused CONF and LOG
* Remove unnecessary usuage of instance variable
* Volume force-delete when volume in maintenance state
* Remove set\_mac\_address from old remote\_client
* Remove remaining usage of cinder v1 API call from Tempest
* Volume reset to maintenance mode
* Remove unnecessary Cinder v1 code
* Nova: Move \_Websocket class to a common place
* Remove cinder clients api version 1
* Remove name checking for api version 1
* Should be more clear for device name opt
* Raise exception when get\_disks() cannot get 'TYPE' column
* Skip flaky test\_create\_router\_set\_gateway\_with\_fixed\_ip
* Adding server evacuate client
* Add skip method for volume test with the glance service
* Add note on get\_disks about unsupported guests
* Fix race in test\_attach\_detach\_volume
* Fix multiple create for multiple networks
* Unskip test\_snapshot\_list\_param\_limit\_equals\_zero
* Separate object-storage bulk operation service clients
* Identity V3-ext Oauth1 Consumers Client
* Use Sphinx 1.5 warning-is-error
* Remove special\_fields definition
* Ensure compute features enabled in test\_images
* Add "list Cinder API versions"
* Remove explicit install of setuptools
* doc: Remove config for unused builders
* Add test case for volume unmanage and manage
* Change API-WG guideline link to specs.o.o
* Add test case for update volume encryption type
* Fix for test\_volume\_swap
* Add reno for removing Cinder v1 API tests
* Deprecate the \`\`deactivate\_image\`\` configuration switch
* Add user key data debug script to instance user data
* Remove assign\_static\_ip from old remote\_client
* Remove set\_nic\_state from old remote\_client
* Deprecate Cinder v1 API option
* Remove Cinder v1 tests
* Improve server tag schema
* Deprecate the dvr\_extra\_resources config switch
* Improve multiple create server tests
* Fix typo in README.rst
* Updated from global requirements
* Make novnc test compatible with RFB3.3
* Make remote\_client reno readable
* Add "list Glance API versions" test
* Remove unnecessary show\_floatingip
* Revert "Docs: Add the remote tag to the badge image"
* Use base.create\_image\_from\_server to create server snapshot
* Add test case for Keystone API "GET /v3/auth/projects"
* Add test\_router\_set\_gateway\_used\_ip\_returns\_409
* Add test\_create\_router\_set\_gateway\_with\_fixed\_ip
* Cleanup ignored\_list for T110 and T111
* Add new detail kwarg to show\_quota\_set to QuotasClient
* Network scenarios: remove some instance variables
* Add plugin group names to CONF
* Use tempest.lib data\_utils - volume
* Use tempest.lib data\_utils - orchestration
* Use tempest.lib data\_utils - object\_storage
* Use tempest.lib data\_utils - network
* Removing sahara from the service available group
* Add Cinder microversion test info in doc
* Use tempest.lib data\_utils - image
* Use tempest.lib data\_utils - identity
* Use tempest.lib data\_utils - compute
* Use tempest.lib data\_utils - scenario
* Add RemoteClient under tempest.lib
* Add "list versions" test for Keystone
* Move plugin client registration to proxy
* Add a bit more debugging to the client registry
* Remove send\_signal, get\_pids, mount and umount
* Updated from global requirements
* Add api tests for create-image
* Add a  negative test for security\_group api
* Correct API reference link in compute client(3)
* Correct API reference link in compute client(2)
* Correct API reference link in compute client(1)
* Correct API reference link in identity client
* Deprecate glance APIs version config options
* Correct API reference link in volume client
* Correct API reference link in image client
* Correct API reference link in servers\_client
* Remove get\_ip\_list()
* Add network\_mask\_bits argument to assign\_static\_ip()
* Add dhcp\_client argument to renew\_lease()
* Move CONF values into \_\_init\_\_ in RemoteClient
* Fix keypair GET response schema
* Remove get\_ram\_size\_in\_mb, get\_number\_of\_vcpus, etc
* Drop allowing old test.idempotent\_id
* Add call\_and\_ignore\_notfound\_exc to Keystone base
* Add a new scenario tox env
* Fix typo of setUpClass
* Change default of auth\_version to v3
* Move test\_extension and use base for non-admin
* make -e full run tempest scenarios serially
* Add --combine option to tempest run
* Extend compute API admin test for swap volume
* Update README section on Python3 support
* Improve error info in assertEmpty and assertNotEmpty
* Deprecate resources\_prefix and change rand\_name()
* Add smoke tag to compute version tests
* test\_neutron\_resources.py exception handler
* [Fix gate]Update test requirement
* Correct test\_list\_servers\_filtered\_by\_ip for bug 1668828"
* Improve test\_implied\_domain\_roles
* Change rebuild tests to use image\_ref
* Close connection after each failed connect attempt
* Remove unused variable
* Remove unused variable and unnecessary instance variable
* Remove unused client in setup\_clients
* Updated from global requirements
* Fix remote connectivity checks
* Removed unused PING\_IPV4\_COMMAND etc
* Do not use skip\_checks in TestServerAdvancedOps
* Use base.attach\_volume in test\_attach\_volume
* Revert "Add reno for Tempest v15.0.0"
* Remove testing of bdm v1 in boot from volume tests
* Fix tempest 14.0.0 release notes
* Fix tempest 15.0.0 release notes
* Add unit test to verify output method
* Fix subunit describe calls for py3
* Remove volume\_feature\_enabled.volume\_services
* Fix the removal of config.skip\_(unless|if)\_config decorators
* keystone roles are case insensitive
* Remove unnecessary wait\_for\_server\_status
* Add content-type without spaces
* Use base.create\_flavor in test\_flavors\_access
* Adds missing server tags APIs to servers client
* Remove unnessessary metadata parameter
* Use 'delete\_snapshot' method
* Update the test removal procedure
* Fix volume v2 capabilities/scheduler-stats tests to test v2 APIs
* Remove extra "?expanded=" from api link
* Skip test\_stamp\_pattern until bug 1664793 is fixed
* Remove deprecated test runner wrappers (.sh files)
* Use upper-constraints for tox envs
* Remove call\_until\_true from test module
* Use a valid project\_id flavor\_access neg tests
* Add volume snapshot metadata parameter
* Remove unnecessary show\_server in TestServerAdvancedOps
* switching to decorators.idempotent\_id
* Remove unnecessary assert and value assignment
* Add missing @test.attr(type='negative') for negative tests
* Add reno for Tempest v15.0.0
* Revert "Remove the skip\_unless\_config and skip\_if\_config decorators"
* Rename reno files of v15.0.0
* Revert "Remove wait\_for\_server from create\_image\_from\_server"
* There are some typos in releasenotes
* Remove unnecessary int casting
* Add test creating a protected image
* Deprecate the skip\_unless\_attr decorator
* Scenario manager: remove some useless \`\_list\_\*\` methods
* Fix tests for bug 1656183
* Add negative tests for snapshot pagination
* Remove unnecessary int declaration
* Add test for compute API List Security Groups By Server
* Add decorator for negative tests
* Add a generic "wait\_for\_volume\_resource\_status" function
* Add v15.0.0 releasenote

15.0.0
------

* Do not use unnecessary instance variable in compute and volume
* Change instance variable to local variable in scenario/image/volume
* Fix test\_novnc for python3
* Remove unused variable and unnecessary instance variable in network
* Remove deprecated compute config options for validation
* Remove unused variable in compute and volume
* Remove the skip\_unless\_config and skip\_if\_config decorators
* Add DeleteErrorException
* Remove unused neutron\_available
* Make test\_volume\_pools A/A compatible
* Add admin\_servers\_client in BaseV2ComputeAdminTest
* Remove unused client in setup\_clients
* Add skip if public\_network\_id is not specified
* Remove input-scenario config options
* Fix AttributeError in wait\_for\_volume\_retype
* Try boot a vm with lower than min ram
* admin/test\_flavors: some code cleanup and factorization
* Remove deprecated network config options
* Remove redundant parameters for server creation
* Use base.create\_flavor in servers test
* Verify metadata preservation after backup restore
* Remove deprecated compute microversion config options
* Add PreconditionFailed exception for HTTP 412 errors
* Check whether server is located on the requested host
* Use test\_utils.call\_until\_true in tempest tests
* Update \_create\_test\_user in identity base
* Finish switching to decorators.idempotent\_id
* Remove redundant setup\_client method
* Fix router port IP address references
* Introduce flake8-import-order
* Remove skip of test\_stamp\_pattern
* Domain specific roles API tests
* Add resources\_prefix to rand\_name when created
* Enable sphinx on servers\_client
* Test live migration back and forth
* Make wait\_until default as 'ACTIVE' in manager.create\_server
* Add create\_flavor in compute.base
* Unskip test\_reassign\_port\_between\_servers
* Add v14.0.0 releasenote
* Use correct routers\_client in \_delete\_router
* Swift list containers should test for reverse listing param
* Revert "Fix \_check\_network\_external\_connectivity in test\_network\_basic\_ops"
* Fixed wrong link in microversion\_testing.rst
* test\_create\_server\_from\_volume\_snapshot: assert dict is not empty before accessing a key
* Fix AZ List Detail schema to allow hosts as None
* Get server fault if snapshot fails
* Add unit tests for BaseV2ComputeTest.create\_image\_from\_server
* Remove wait\_for\_server from create\_image\_from\_server
* Implied roles API tests
* Fix \_check\_network\_external\_connectivity in test\_network\_basic\_ops
* Switch to decorators.idempotent\_id on scenario
* Add test.attr for negative tests
* Switch to decorators.idempotent\_id on volume
* Switch to decorators.idempotent\_id on orchestration
* Switch to decorators.idempotent\_id on object\_storage
* Switch to decorators.idempotent\_id on network
* Switch to decorators.idempotent\_id on image
* Add test\_create\_is\_domain\_project
* Implied roles methods
* Remove unused client from "\_create\_network" method
* Log server state changes when waiting for delete
* Add related\_bug for bug/1660878
* let addCleanup use the current client
* Fix map usage on py3 in v2 test\_volumes\_snapshots\_list
* Fix tests which use 'display\_name' for both V1 and V2
* ssh: Add proxy support
* Add related bug#1659811 for tenant\_id filter compute tests
* Fix date-time format checking in response schema
* Add test for compute API microversion 2.42
* Create volume from private volume type
* Snapshot v2 pagination tests
* Switch to decorators.idempotent\_id on identity
* Switch to decorators.idempotent\_id on compute.\*
* Switch to decorators.idempotent\_id on compute.servers
* Switch to decorators.idempotent\_id on compute.admin
* Remove default\_params\_with\_timeout\_values variable
* Refactor test\_roles\_client
* Use single underscore variable in loop iteration(in compute)
* Use single underscore variable in loop iteration(in identity)
* Remove a redundant 'body' variable
* Add extra elements check for 'show\_volume\_type' command
* Remove ListImagesTest from test\_images
* Don't skip Cinder backup tests based on Swift's availability
* Fix update\_host API response schema
* Using oslo\_log instead of logging
* Use single underscore variable in loop iteration
* Remove a redundant cleanup\_snapshot method
* [py35] Fixes to get more tempest tests working
* Add tempest tests for volume retype with migration
* Migrate volume while attached to an instance
* Fix test test\_rescue\_unrescue\_instance
* Modify the indentation problem for the if loop
* Boot server from snapshot
* Add namespace tags client and tests
* Correct print pattern in rest\_client
* Fix compute baremetal service client tests
* Replaces yaml.load() with yaml.safe\_load()
* Add random name in base.\_create\_keypair
* Modify comments in xxx\_name\_length\_exceeds\_256
* Add generate\_random\_security\_group\_id in BaseSecurityGroupsTest
* Use oslo.log library instead of system logging module
* Improve volume\_backed logic in create\_test\_server
* Add a test case for metadata POST
* Fix logging messages not being formatted correctly
* Shared images test create with default visibility
* Use Token Clients from the client factory
* Use invalid id with rand string instead of special char
* Add short options to tempest
* Remove unnecessary name definitions
* Define 'delete\_snapshot' method as a static method
* Feature flag: allow disabling 'manage snapshot' tests
* Use 'attach\_volume' method
* Add tempest test to test NoVNC support
* Formally deprecate the allow\_port\_security\_disabled feature flag
* Define 'delete\_volume' method as a static method
* Allow not the same sequence in container\_formats and disk\_formats
* Fix a typo in 'attach\_volume' docstring
* Unmanage and manage snapshots
* Fix variable name
* Set PYTHON env variable for python3
* Deprecate the volume\_feature\_enabled.volume\_services feature flag
* Use base.delete\_server in addCleanup
* Deprecate the identity-feature-enabled.reseller config option
* Remove an unused variable in the BaseTestCase class
* Remove the tempest/tests/negative/ directory
* Check error message returned by the system
* Removes unnecessary utf-8 encoding
* Replace six.iteritems with dict.items
* Remove 'id' from expected in SecurityGroupRulesTestJSON
* Remove \_migrate\_server\_to's return value
* Add missing IPs validation to test\_rebuild\_server
* Add related\_bug() to 1629110's test
* Remove skip for Heat-Neutron tests
* Add test namespace object functions in images
* Remove redundant assertIn('id', xxx)
* Do not use message=msg in InvalidConfiguration
* Add a test for reproducing bug/1651064
* Removes unnecessary utf-8 coding
* Correct boundary value of image id length
* Add check user access in test\_remove\_member
* Port object\_storage tests to Py3
* Add accounts.yaml to .gitignore
* Making all identity service clients as tempest available

14.0.0
------

* Use call\_and\_ignore\_notfound\_exc method
* Fix container cleanup in test\_account\_bulk
* Rename reno files for releasing 14.0.0
* Fix service clients for kwargs as None or 0
* Use lower value to create flavor for creating server
* Define v3 domains\_client as library
* Add releasenotes for baremtal tests removal
* Forcing dynamic credentials for identity admin
* Clients.py: add back the default\_params\_with\_timeout\_values class variable
* Hacking: enable H904
* Add connectivity check test for migration with revert
* Avoid volume limit usage for existing volumes
* Do not use self.volume\_origin in volume.base.attach\_volume
* Remove unused clients in setup\_clients
* Use ephemeral=0 to create flavor without ephemeral disk
* Fix flavor\_client create\_flavor interface
* test\_service\_providers: require service-type ext
* Add volume backup description parameter
* Do not create volume in resource\_setup for test\_volume\_reset\_status
* Remove unused CONF and LOG
* Remove unused client in SecurityGroupRulesNegativeTestJSON
* Use base.delete\_server in base.rebuild\_server
* Few updates for baremtal dependent tests
* Removing baremetal tests from tempest tree
* Use base.delete\_server in ServersTestJSON
* Improve volume pools tests code
* Fix a few Python 3.x issues
* PCI-DSS tests
* Separate capabilities service method from account\_client
* Add test.related\_bug() to know launchpad bug reports
* Make identity v3 domains\_client use \*\*kwargs
* Set auth in clients before they are used
* Add namespace property unittest
* Use base.create\_volume in VolumesTestJSON
* Remove unused client in setup\_clients
* Backup and restore bootable volume
* Docs: Add the remote tag to the badge image
* Network test: rework the service types/service providers tests
* Correct improper comment
* tempest/test.py: make set\_validation\_resources() more idiomatic
* Use wait\_until in create\_test\_server to wait for server ACTIVE
* Wait for server to be active before deleting
* Improve help message for scheduler\_available\_filters
* Correct tempest reraising of exception
* Add status\_code to RESTful exceptions
* Honour discoverability feature flag in swift tests
* Add extra unit tests for base\_url
* Remove the Auto Tests Generators
* Tox.ini: removed an outdated code comment
* Tox: Hacking: enable extensions H106 and H203
* Remove unused admin\_hosts\_client
* Add server\_group in default\_quota\_set
* Correct variable usage error in test\_get\_hypervisor\_uptime
* Correct fake V3 token responses
* Delete volume first before deleting snapshot
* Replace str(uuid.uuid4) with uuidutils.generate\_uuid()
* Modify incorrect import path
* Add get metadata schema test methods
* Remove unused client
* Change personality inject path to /
* Add sleep(2) when try to delete a container
* Use different file content to test max\_number\_personality\_files
* Correct boundary value test in ImagesOneServerNegativeTestJSON
* Remove prepare\_instance\_network in ImagesOneServerNegativeTestJSON
* Rename test\_delete\_image\_id\_is\_over\_35\_character\_limit
* Write a couple of test cases together
* Add a test for attaching 2 volumes to a server
* Make common->compute->shelve\_server param more clear
* Add resource clean for tests
* Add server group limits in test\_absLimits\_get
* Remove unnessary assertIsNotNone
* Fix unit-test test\_user\_messages file name
* Use TempestException from tempest.lib
* Added bindep.txt to the project
* Remove \_is\_true() from test\_volumes\_actions.py
* Specify snapshot size when creating volume
* Add possibility to pass prefix before cli command
* Remove setup\_client method
* Add 'Negative' to negative test class names
* Rename "VolumesCloneTest" class name to "VolumesV2CloneTest"
* Add test create volume from bootable volume
* Add resize\_server in compute.base
* Fix compute test\_attach\_volume
* Remove old v3 volume services library and use lib/service for v3
* Create two new clients under tempest.lib libary
* Fix typo in documentation
* Show team and repo badges on README
* Minor fix in role\_assignments\_client docstring
* Remove an obselete msg from then optimize a router test case
* Updated from global requirements
* Move role\_assignments\_client to tempest lib
* Use names containing "non-existing" as non-existing resource names
* Do not use instance variable in FloatingIPsNegativeTestJSON
* Replace directly import of logging with import oslo\_log
* Remove CONF.volume\_feature\_enabled.bootable
* Rename testcase names with 'with\_out' to 'without'
* Add namespace properties client and tests
* Add deprecated\_reason for nova\_cert
* Integration tests for device role tagging
* Check project connectivity on port admin state
* Add wait\_for\_server\_termination in test\_server\_basic\_ops
* Updated API ref link as single line which is more readable
* Add hypervisor\_type option
* Make the parameter 'device' optional
* Remove skipException for volume creation failure
* Remove negative\_rest\_client
* Make get\_partitions() work for partitioned disks
* Use names containing "invalid" or "nonexistent" as invalid name
* Make Identity v2 service clients as available  module
* Check volume and minimum disk sizes to create volume
* Cinder absolute-limits tests
* Improved Cinder snapshot tests
* Remove unused client in ServerMetadataTestJSON
* Remove meaningless assignment
* Use call\_and\_ignore\_notfound\_exc to cleanup floating-ip-bulk
* Move list\_hosts to resource\_setup in test\_hosts\_negative
* Add missing volume snapshot skip
* Do not remove server\_groups from default\_quota\_set
* Use assertIs(Not)None to check for None
* Add api ref link in TenantUsagesClient
* Fix ref link in volume v1 service clients
* Fix volume\_create to use shared function with a cleanup
* Delete duplicated dvr tests
* Bump hacking version in test-requirements.txt
* Use the correct path of InvalidConfiguration
* Typo fixing
* Move wait\_for\_interface\_status to waiters
* Wait for FIP status to get to DOWN in test\_router\_rescheduling
* Improve error message on volume tests failure
* fix bulk service name
* \_log\_console\_output missing space
* Updated from global requirements
* Fix glance create image
* Use more specific asserts in tests
* Get rid of useless tenant\_id attribiute
* \_log\_console\_output do not raise NotFound
* Move cred\_client to tempest.lib
* Update volume client class description
* Updated from global requirements
* Add connectivity check test for migration
* Validate power\_state enums in compute API response schema
* compute/images/test\_images\_oneserver: don't share resources
* Updated from global requirements
* Fix cinder message-client naming to volume\_v3\_messages\_client
* Delete TimeoutException in tempest/exceptions.py
* Require l3-ha extension for test\_centralized\_router\_update\_to\_dvr
* Add negative tests about update-volume API
* Fixing 'test\_verify\_created\_server\_ephemeral\_disk' test
* Do not have heat to connect to external service
* Use InvalidCredentials exception from correct path
* Use random name in network common function
* Remove services/volume/{v1,v2} directories
* Remove a redundant dictionary
* Fix a docstring typo in manager.py
* Remove unnecessary function \_create\_multiple\_servers
* Pop name from volume.base.create\_server
* Boot a server from a non-bootable volume
* Use assertGreater(Equal) over assertTrue
* Make the non ha router usage explicit in a dvr test
* Fix race in test\_networks.py: don't try to get a possibly-deleted network
* Correct a scheme example error from fake netutron versions client
* Use is\_scheduler\_filter\_enabled for ServerGroupAffinityFilter
* Add random name in scenario.manager.create\_server
* [TrivialFix] Replace 'assertTrue(a in b)' with 'assertIn(a, b)'
* Use random name in common function
* Use random name in volume.base.create\_snapshot
* Use base.create\_test\_server\_group to create server group
* Define image status enums for compute proxy API schema
* Pass username on v3 token issue
* Move some network tests from Neutron to Tempest
* Add missing tests for the image v2 API
* Use assertGreater(Equal) over assertTrue
* delete list\_all\_container\_objects in the container\_client
* Updated from global requirements
* Add \_error\_checker() call on versions\_client
* Remove unused arguments from \_error\_checker()
* Use assertGreater(len(x), 0) over assertTrue(len(x) > 0)
* Revert "Skip unstable v6 scenario tests"
* Repalce to "tempest account-generator"
* Don't rely on testtools.tests
* Remove the Stress framework
* Use rand name in common function in scenario tests
* Use common function create\_volume to create test volume
* Add test\_volumes\_list functions in test\_volumes\_list.py
* Use random name in network common function
* Correct image's random name
* Set random name in common function create\_server
* Remove unnecessary name definition
* Remove unnecessary function \_create\_multiple\_servers
* Fix a typo in test\_security\_groups.py
* Remove testscenarios denpendency
* Image cleanup is missing in test\_create\_delete\_image
* Remove one-line function in test\_volumes\_actions
* Fix a typo in test\_networks.py
* Move volume service clients under tempest.lib
* Skip test\_volume\_backed\_live\_migration unconditionally
* Revert an accidental error modification of config item help message
* Deprecate nova api extensions config option
* Fix wording for python3.4 section in the readme
* Stop using subprocess for testr init in tempest init
* Improve error reporting when workspace not registered
* Move InvalidConfiguration exception to tempest.lib
* Use lib version of data\_utils in dynamic creds
* Move cred\_provider abstract class to tempest lib
* Remove CONF usage from dynamic\_creds module
* Remove the NegativeAutoTest Framework
* waiters.py: raise BackupException defined in tempest/lib
* Use Cinder v2 by default in scenario tests
* Remove NetworksIPV6TestAttrs duplicate tests
* Correct 'list index out of range' in FloatingIPDetailsTestJSON
* Add test list namespace function
* Correct 'list index out of range' error in dhcp agent test
* Isolate change\_server\_password to use its own server
* Remove unnecessary name definition
* Add unit tests for volume quotas\_client
* Add port parameter to ssh Client
* Add unit tests for volume snapshots\_client
* Use common func create\_volume in test\_volumes\_actions
* Remove unused func \_detach
* Correct improper assert judgement
* Remove redundant assert judgement
* Add a generic method for backup creation
* Remove unnecessary wait-for-volume-available
* Add list the primary tenant
* Add negative tests for deleting attached volume
* Updated from global requirements
* Use a common method for is a router interface
* Rename reno files of 13.0.0
* Fix the 13.0.0 newton release note
* Remove duplicate python-subunit from test-requirements.txt
* Add v13.0.0 release note page
* Enable release notes translation

13.0.0
------

* Add release notes for start of Newton support
* Add unit tests for encryption\_types\_client
* Remove meaningless volume negative test
* Only call register\_service\_clients if there are clients
* Test case with list-instance-actions for deleted server
* Remove Sahara tests from Tempest
* Updated from global requirements
* Clarify the guideline of negative tests
* Moving scenario docstring under the relevant test method
* Remove a redundant image\_id variable
* Re-use common methods in ServerRescueNegativeTestJSON
* Re-use common methods in test\_rebuild\_server\_with\_volume\_attached
* Re-use common methods in test\_delete\_server\_while\_in\_attached\_volume
* Re-use common volume create/attach methods in test\_iscsi\_volume
* Add compute API admin test for swap volume
* Switch unit test tox jobs to use ostestr
* Fix docstrings in Tempest REST client for Ironic
* Add link for Unset keys and update some links in qos\_client
* Permission changes: Python file should be 0644 not 0775
* Migrate backups clients to tempest.lib
* Add a test for revert cold migration
* Adding a new option CONF.network.dvr\_extra\_resources
* Add 'code-block' and revise tab
* Reviewing guideline: ask for CRD when new test+feature flag
* Remove over-comment
* Add existing volumes when using pre-provisioned credentials
* Trivial: Delete a definition that is not needed
* Updated from global requirements
* Fix typo in the file
* Add inherited role assignments tests
* Fix tempest init inconsistency when it fails
* Update hotplug test description
* Docstrings should not start with a space
* Correct a misleading in docstring
* Allow for wait in \_restore\_password
* Fix a few grammatical errors in docs
* Correct several typos
* Trivial: Remove redundant variable
* Updated from global requirements
* Add a test for cold migration
* Remove redundant links to clients
* Wait for floating\_ip to detach from server after deletion
* test\_images\_oneserver - use the addCleanup mechanism
* test\_list\_servers\_by\_admin(specified\_tenant) for preexisting servers
* Add prefix "$" for command examples
* Remove misleading arguments
* Fix Release Notes index page title
* standardize release note page ordering
* Add more swift container negative tests
* Introduce a new tox target that checks requirements.txt
* Fix compute test\_agents tests
* Remove a redundent variable
* Fix LOG.warn to LOG.warning
* Change into staticmethod
* Skip some tests if security-group extension is disabled
* Move wait\_for\_qos\_operations method to common.waiters
* Move wait\_for\_backup\_status function to common.waiters
* Add test to get images by owner
* Avoid local variable referenced before assignment
* Remove sys unused
* Move test\_snapshot\_list\_\* tests to new file
* Remove invalid assertions for 304 resp
* neutron: added test case to check connectivity using MTU sized frames
* Updated from global requirements
* Fix assert for public networks with multiple subnets
* Remove residual package
* Define v2 encryption\_types\_client as library
* Remove duplicated judgement
* Migrate V1 and V2 qos service to tempest lib
* Fix missing serial option of tox full-serial target
* Rename renos of 12.1.0
* Rename renos of 10.0.0 and 11.0.0
* Trivial: group import statement in client.py
* Deprecate method get\_ipv6\_addr\_by\_EUI64
* Don't include openstack directory in exclude list for flake8
* Delete Savanna element in client list
* Container Services underscore in metadata key translate to dash
* Remove image v1 test\_delete\_image\_with\_invalid\_image\_id
* tempest-cleanup can only be invoked as tempest cleanup
* Fix subunit-trace output with tempest run
* Fix typo in data\_utils.py
* remove unused statement
* Split base snapshots\_client into v1 and v2
* Revert "Fix of verify\_glance\_api\_versions"
* Define v1 encryption\_types\_client as library
* Rename renos of 12.2.0
* Fix with using oslo\_serialization base64 module
* Use other item instead of security\_group in network-quotas test
* Fill name param in create\_test\_server
* Switch tox to use tempest run and deprecate bash runners
* Scenario: server\_basic\_ops: use regular variable (not instance var)
* Define the volume types\_client as library
* Scenario: object\_storage\_basic\_ops: move and update test description
* Scenario: test\_minimum\_basic: remove useless function
* Scenarios: remove redundant call to \`resource\_setup()\`
* Add some params docstring to create\_server
* Add config option to create networks with port\_security\_enabled
* Always wait on server delete
* Remove \_setup\_network\_and\_servers() in TestNetworkAdvancedServerOps
* Fix credential client to return raw response
* Use ConfigParser instead of SafeConfigParser
* Update skip message in overlimit testcases
* Remove unnecessary resource\_setup()
* Modify use of assertTrue(A in B)
* Rename test\_list\_servers\_filter\_by\_server\_status
* Ignore deb-\* packaging repos in the plugin list
* Fix the docstring of \_default\_security\_group
* Remove unnecessary \_\_init\_\_.py of identity v2
* Replace volume's "test" name with classname as prefix
* Update Available para link of image v1 client
* Remove tests/fake\_auth\_provider
* Use local variable for volume instead of instance one
* Add description to the help of enable\_instance\_password
* Update tempest init help message
* Remove auth\_request as no used
* Reordering tests under the approprite directories
* py3: Miscellaneous fixes
* Define v3 credentials\_client as library
* Define v3 trusts\_client as library
* Move method to v2 volumes\_client
* Update Available para link of keystone v3 client
* Use api\_extensions to decide security\_group type nova used
* Move v3 inherited\_roles\_client to library interface
* Move v3 roles\_client to library interface
* Define separate inherited\_roles\_client for inherited roles
* Validate floating IP in server['addresses'] scenario
* Use an instance method instead of class method
* Define v3 identity\_client as library
* Update Available para link of network client
* Move 3 volume methods to v2 volumes\_client
* Remove base\_types\_client for the reability
* Separate encryption\_types\_client from types\_client
* Don't create network resources for identity tests
* Define the v3 Users Client as a library
* Define v3 Groups Client as library
* Update Available params of image
* Delete duplicate if judgment
* Use testcase name as prefix of resource name
* Add skip logic for admin cred in test\_auto\_allocate\_network
* Make identity v3 roles\_client use \*\*kwargs
* Define v2 identity\_client as library
* Add deprecated code review guideline

12.2.0
------

* Remove unnecessary resource\_cleanup/setup
* Narrow assertion in attach/delete volume test
* test\_list\_servers\_by\_admin for preexisting servers
* Move wait\_for\_qos\_operations into base volume test
* Move \`call\_until\_true\` to tempest/lib
* Fix doc build if git is absent
* Count volumes vs partitions and remove hard-coded expected result
* Remove get\_attachment\_from\_volume()
* Remove the default size in volumes\_client
* Remove unused methods from volumes\_client
* Define v3 projects\_client as library
* Add omitted blank space to assert\_msg
* Update user and tenant client's Available params link
* Use quota\_set instead of default\_quota\_set
* Remove a word 'smoke' from some scenario tests
* Add volume clone flag to clone tests
* Add doc section on expectations of clean tenants
* Adding testcases for metadata def resource types
* Fix MismatchError in test\_host\_name\_is\_same\_as\_server\_name
* Define v3 services\_client as library
* Add a space between super's and setUpClass
* Use expect\_empty\_body flag
* Remove unused global variable from VolumesV1NegativeTest class
* Define v3 regions\_client as library
* Remove the update\_object() in object\_client
* Move volume-type-access methods to volume v2
* Skip admin floating IP tests if router extension is disabled
* Remove expected\_success check in images\_client
* Add a release note link on README
* Fix docstrings to match with method arguments
* Adding update backups quota
* Remove unused config.CONF
* Revert "skip get-me-a-network tests"
* Deprecate meaningless TYPE
* Clean imports in code
* Exclude gateway\_ip of subnet in get\_unused\_ip\_addresses
* Delete unuesd function arguments in rest\_client
* TrivialFix: Remove cfg import unused
* skip get-me-a-network tests
* TrivialFix: Remove logging import unused
* Fix mutliple attach/detach issue
* Add using dash options instead of underscore
* Remove thirdparty from tox.ini
* Lower the aes-xts-plain64 key\_size to 256
* Create resources using wrapper utility
* Improve test\_update\_image\_metadata testcase
* Update volume type details
* Fix OverLimit's message
* Add admin list\_servers test with invalid\_status
* Use 'OS-EXT-SRV-ATTR:host' directly
* Fix exec\_command to hang indefinitely
* Call addCleanup(delete\_server) immediately after resize server
* Fix parameter receive
* Added logic to validate storage policy info
* Remove unnecessary setUp()
* remove unnecessary call in test\_delete\_container
* Make args of types\_client same
* Fix test\_volume\_services testcase
* Revert "Move dscv and ca\_certs to config section service\_clients"
* Remove an unused function in object\_client
* Use classname as prefix of volume name
* Use cls in class method instead of self
* Scenario: remove the \`addCleanup\_with\_wait\` helper method
* Add compute API tests for 'get-me-a-network'
* test\_schedule\_to\_all\_nodes should choose available nodes
* Class Credentials not define \_\_ne\_\_() built-in function
* Update the links to api-ref of network
* Add existing volumes when using pre-provisioned credentials
* Delete no need definitions
* Use cls in classmethod instead of self
* Remove unnecessary str() from some clients
* Remove skip statement for bug 1450859 is fixed
* Fix test\_shelve\_volume\_backed\_instance
* Remove useless parenthesis
* Fixed net\_id key evaluation for net['id']
* Remove a redundent resource\_cleanup method
* Remove the test\_upload\_large\_objects negative test
* Improving test\_volumes\_get testcase
* Add missing config file read to tempest init
* Adds to verify\_cinder\_api\_versions api\_v3 check
* Remove unnecessary str() from base\_types\_client
* Fixed manager.py to support multinode test on vnic\_port
* Remove unnessary delete\_volume in test\_volumes\_list
* Define volume quotas\_client as library
* Remove base\_quotas\_client for the reability
* Fix of verify\_glance\_api\_versions
* Fallback to creds provider for fixed IP network if no network\_for\_ssh
* Fix checks for content length in object storage tests
* Fix network\_for\_ssh config option help
* Fix reference to nonexistent ssh\_connect\_method in config help
* change nova\_cert config to default False and deprecate it
* skip test\_connectivity\_between\_vms\_on\_different\_networks
* Fix manager->get\_auth\_provider interface
* Move dscv and ca\_certs to config section service\_clients
* Configure stable service clients via the registry
* Define volume services\_client as library
* Define volume hosts\_client as library
* Remove unnecessary str() which was for XML
* Don't load non json body
* Migrate service\_clients to tempest.lib
* Fix tempest and available modules
* boot into a network that has "port\_security\_enabled=False"
* Updated from global requirements
* Remove a redundant wait\_for\_backup\_deletion()
* Make identity v3 users\_client use \*\*kwargs
* Make identity v3 credentials\_client use \*\*kwargs
* Define volume availability\_zones\_client as library
* Define volume extensions\_clients as library
* Fix notes which differnt from actual parameters
* Add a TODO to remove Ironic related workaround
* Optional setting service client on factory
* Make identity v3 services\_client use \*\*kwargs
* Make identity v3 groups\_client use \*\*kwargs
* Remove deprecated Javelin CLI utilities from Tempest
* Add : to docstring of service\_clients
* Fix. Do not create port if vnic\_type defined and port is passed
* Run attach/detach volume tests even without ssh
* assertEqual can be used instead of assertListEqual
* Set timeout value in urllib3.poolmanager.PoolManager
* Updated from global requirements
* Update the links to api-ref of network
* Remove the wapper method show\_quota\_usage()
* Remove unused TYPE from base\_quotas\_client
* Remove base\_services\_client for the reability
* Remove base\_hosts\_client for the reability
* Skip test\_reassign\_port\_between\_servers until fixed
* Delete unused parameters
* Do not use $ in regex
* Modified into a more appropriate function
* Modify a spelling mistake
* Delete no meaningful definition
* Remove base\_availability\_zone\_client for the reability
* Remove base\_extensions\_client for the reability
* Minor change to comment
* Migrate image client group to client factory
* Migrate network client group to client factory
* Migrate compute client group to client factory
* Register Tempest clients via the new interface
* Service Clients registration interface for plugins
* Fix README
* Replace OpenStack LLC with OpenStack Foundation
* Add available params in compute clients' comment
* Add volume type description support
* Do not use $ in OS user password
* Use skip\_checks in test\_snapshot\_pattern
* Deprecate run\_tests.sh
* Fix typo about message of exception
* Add server\_id in exception ServerUnreachable
* Skip unstable v6 scenario tests
* Fix release notes around
* Increase size of subnet allocation pool
* Define v3 policies\_client as library
* Updated from global requirements
* Define v3 endpoints\_client as library
* Fix subunit-describe-calls name of usage
* py3: Replace map/filter with a list comprehension
* Modify comment which does not conform to code
* Introduce the ClientsFactory
* Add available params in volume clients' comment
* Reverse order of get\_unused\_ip\_addresses
* Remove unused LOG to keep code clean
* Add new live\_migration case to support block\_migration=auto
* Remove DataGenerator from the dentity base
* Remove DataGenerator from admin V3 identity tests
* Remove DataGenerator from admin V2 identity tests
* Add python 3.5 classifier and venv
* Fix typo in tempest/run help document
* cinder backup reset status
* Use skip\_checks instead of skipUnless in TestShelveInstance
* Add a test for attach/detach port on multiple servers
* Add sync to avoid the loss of pub key data
* Fix typo in Test Removal Procedure doc
* Correct reraising of exception
* Requirements.txt: remove pyOpenSSL
* Removes explicit looping over dict .keys() method
* Add available params in metering labels client's comment
* Add available params in ports client's comment
* Add available params in neutron security group client's comment
* Updated from global requirements
* Don't enable DHCP on floating IP subnet tests
* Add missing validation to test\_delete\_saving\_image
* Remove non-locking accounts from the config guide
* Add available params in network clients' comment
* Add available params in subnet pools client's comment
* Add available params in neutron security group rule client's comment
* Add available params in baremetal client's comment
* Add available params in identity v2 client's comment
* Remove unused LOG
* Add available params in neutron float ips client's comment
* Add documentation for glance api
* Factor up (most) CONF value in clients.Manager
* Check network\_data info in config drive tests
* Update docstring for create\_test\_server
* Remove the unused tenant and user option in cleanup
* Moving backup test under non admin directory
* Remove white space between print and ()
* Cinder get-capabilities tests
* Add available params in networks client's comment
* Add available params in subnets client's comment
* Tempest: Fixed a typo
* Fix minor details in README
* Update quickstart for revised temepst init setup
* Making delete\_on\_termination configurable
* Extend server schema for extended volume attribute
* Fix test\_project\_create\_with\_parent
* Updated from global requirements
* Disable file injection by default
* Add purge flag in image\_meta\_to\_headers
* Delete dynamic tenant correctly when \_cleanup\_default\_secgroup fails
* Cleanup tempest quickstart
* Remove duplicated identity v2 clients
* Fix teardown of the identity api
* Use find\_test\_caller in test\_utils instead of in misc
* Add basic tempest run instructions to the quickstart
* Add support for specifying a config file to tempest run
* Add request/response to subunit-describe-calls
* Adds clone/snapshot volume test for create volume
* Add documentation for glance api

12.1.0
------

* Add support for workspaces to tempest run
* Add whitelist and blacklist file options to tempest run
* Add plugin registry generation to sphinx build
* Fix subunit describe calls utility document warnings
* Tidy up document index page
* Define 4 identity v2 clients as libraries
* Updated from global requirements
* Prepare the Manager class for tempest.lib
* Fix resize tests
* Fix search disk name for the config\_drive in scenario test
* Remove unused service tags and client
* Member role may already exist
* Remove placeholder file from releasenotes/notes dir
* Add parent\_id to create\_project
* Remove trove tests from tempest
* Add \_\_pycache\_\_ to .gitignore
* Define v1 images\_client as library
* Move image\_meta\_to\_headers from images\_client
* Py3: don't access the \`unicode\` type directly
* Remove unnecessary \_\_init\_\_ and resource\_setup/cleanup
* Fix AttributeError with run\_validation=true
* Add available params in base\_volumes\_client's comment
* Fix assertItemsEqual usage for py3
* Add workspace subcommands help
* Fix Available params docs in service clients
* Add Available params in volume backup and snapshot clients
* Correct "Available params" link in create\_flavor
* Move properties handling to the test side
* Add guidance on negative tests in HACKING.rst
* Api specs for update\_volume\_image\_metadata
* Remove the \_try\_wrapper function from identity tests
* Cleanup projects in reverse order
* Restriction on sequence of allowed address pairs
* Fix the init command global conf dir path
* Py3: Don't use dict.keys()[0], dict.values()[0] or dict.items()[0]
* Remove testscenarios usage from test\_server\_basic\_ops
* Fixed typo in in data\_utils.py
* Remove unnecessary setUp and tearDown
* Add subunit-describe-calls
* Move oslo config generator config inside package
* Add section on release notes to reviewing doc
* Service client modules in various services  \_\_init\_\_
* Service client modules in object-storage \_\_init\_\_
* Service client modules in image \_\_init\_\_
* Service client modules in volume \_\_init\_\_
* Fix un-assignment local variable 'returncode' error
* Add test removal procedure doc
* Cinder volume type access tests
* Add available params in set metadata
* Test-requirements: Bump hacking to >=0.11
* Image metadata for volume
* Service client modules in identity \_\_init\_\_
* Volume pagination with specific tenant
* Update identity v2 users\_client methods name
* Correct some misspelt words in print messages
* Service client modules in network \_\_init\_\_
* Service client modules in compute \_\_init\_\_
* Move helper methods for object\_storage to base.py
* Generic "delete volume" method
* Remove unused LOG from images\_client
* Define v1 image\_members\_client as library
* Make \`tempest init\` working dir an abspath
* Return ResponseBody object from delete\_role
* Make identity v2 roles\_client use \*\*kwargs
* Make identity v2 tenants\_client use \*\*kwargs
* Make identity v2 user\_client use \*\*kwargs
* Make identity v2 service\_client use \*\*kwargs
* Add IPv6 rule creation to validation resources
* Add a response schema for "log" attribute
* Add tests for Cinder user messages v3 API
* Backup create using force flag
* Fixes port.id bug added with 777a307b3c9f4284facf081e6b951b5755333adf
* Change hostname\_equals\_servername to get\_hostname
* Add operator role to heat stack owner
* Cleanup exceptions in tempest
* Consider pre-existing VMs when testing server list
* Add InvalidIdentityVersion in lib.exception
* Remove neutron OO wrappers
* Rename mathods of v1 image\_members\_client
* Quota usage after volume transfer
* Add available params in identity client's comment
* Clarify "data" arg in create/update\_image()
* Move get\_image\_meta\_from\_headers from images\_client
* Remove the test path of image service
* Add image API version to the reno
* Remove unnecessary setUp()
* Define v2 endpoints\_client as libarry
* Make endpoints\_client use \*\*kwargs
* tempest: use host instead of hypervisor for aggregate test
* Make --concurrency not required in account\_generator cmd
* Add available params in attach\_volume's comment
* Define v2 images\_client as library
* Add missing tests for the identity v3 API
* Fix dsvm typo to dscv
* Use is\_valid\_ipv4 from oslo.utils
* Fix rendering of account generator utility authentication table
* Fix docs warnings of auth
* Fix the reno format of image-clients-as-library
* Disable SmartyPants for docs
* Add tempest run command
* Count partitions starting with sd prefix
* Move reno of add-tempest-workspaces
* Stop passing TestResources to Managers
* Define \_set\_network\_clients
* Define \_set\_image\_clients
* Remove unused return value from take\_action
* Define image\_members\_client of image v2 as library
* Use scope in v3 identity client
* Rename image members clients
* Define 3 image clients as libraries
* Add unit tests for glance v2 service clients
* Separate resource\_types\_client from images\_client
* Allows specifying a name for a particular endpoint
* Add unit test coverage for account generator
* Cleanup some small issues in the microversion testing doc
* Fix cinder volume nameing for admin
* Remove use\_default\_creds from preprov creds
* Fix the v2 image client variable name
* Centralized Workspaces
* Make missing global config dir not fatal in tempest init
* Separate Image v1 members client
* Separate schemas\_client from v2 images\_client
* Cleanup wording and section for remote access config doc
* Let method \_get\_ssh\_connection handle timeout error
* Separate namespaces\_client from v2 images\_client
* Separate Image v2 members client
* Fixed a Typo
* Adding/fixing docstring to \_create\_creds function
* Add vcs string to version option output
* Account generator for identity v3
* Tempest image clients use version in URL
* test\_aggregates should choose available compute node
* Remove unused \_get\_file\_size()
* Check which glance client version to use
* Define routers\_client as library interface
* Move comptue base test to common dir
* Remove tempest/tests/services/compute path
* Remove unnecessary \_\_init\_\_()
* Updated from global requirements
* Return 'DOWN' ports when Ironic enabled
* Make username and project use same random ID
* Increase test coverage on preprov creds
* Fix volume backup import test
* Change "$>" to "$" as CLI prompt
* Not to create security group when security\_group ext is disabled
* Fix Tempest testing way on the doc
* Remove integrated dashboard tests
* Add hacking rule to enfore no config in tempest.lib
* Remove delete\_extra\_routes()
* Remove update\_extra\_routes()
* Remove GET ops from update\_router()
* Updated from global requirements
* Keep py3.X compatibility for urllib
* Revert "Modify --endpoint-type to --os-endpoint-type for nova"
* Correct test\_get\_usage\_tenant's AttributeError
* Use @wraps decorator
* Introduce new helper: call\_and\_ignore\_notfound\_exc()
* Unit test: fix flaky test\_networks\_returned\_with\_creds
* Remove the \`file\_utils\` module
* Modify --endpoint-type to --os-endpoint-type for nova
* Remove the Glance HTTP client. Use the common Rest Client instead
* Use api\_extensions to decide security\_group type nova used
* Moved Cinder QOS tests to admin directory
* Finish removing legacy credentials
* Add admin role on domain for v3
* Swift object client: use urllib3 builtin support for chunked transfer
* Fix docs errors and warnings
* Use common "waiters.wait\_for\_image\_status" function everywhere
* Heat: wait condition: allow insecure HTTPS url
* Introduce scope in the auth API
* Rename get\_image\_meta method into check\_image for Glance V1 client
* Hash credentials on user, project/tenant and pwd
* Modify --endpoint-type to --os-endpoint-type for nova
* Remove kilo config flags from Tempest
* Document tempest APIs which plugins may use
* Fix update\_password tests
* Use mock instead of relying on command stderr
* Add simple test for Neutron GET /
* Remove deprecated legacy credentials provider
* Modify projects\_client to receive more attributes
* Add missing test for the object storage v1 API
* Updated from global requirements
* Cinder storage pools tests
* Docs: Fix Hacking guide bulleting
* Improve logging of credentials
* Add assertion to test\_create\_security\_group\_rule\_with\_invalid\_ports
* Update cfg option network\_for\_ssh's help msg
* Correct misspelt word in msg in test\_images.py
* Add a test case for rebuild of instances with volumes
* Revert "Skip test\_resize\_volume\_backed\_server\_confirm for now"
* Adding wait\_for\_resource\_deletion function for volume cleanup
* Skip test\_resize\_volume\_backed\_server\_confirm for now
* Addresses Expect: 100-continue client behavior
* Change scenario test 'test\_resize\_server\_confirm'
* Add separate release notes page for 12.0.0
* Improve RestClient rate limiting

12.0.0
------

* Add release notes for kilo EOL release
* Add test case for CONF skip decorators with message
* Ensure tempest tests don't assume IP address allocation strategy
* Snapshot list using 'limit' parameter
* Add cleanup in identity/test\_users\_negative.py
* Adding documentation to dynamic\_creds functions
* Editing descripition for \_create\_loginable\_secgroup\_rule
* Skip multinodes testing if no same/different scheduler filter enabled
* Correct mispell words in comments
* test\_port\_security\_macspoofing\_port: Don't assume DHCP port
* Fix the docstring of skip\_unless\_config()
* ssh before shelve to avoid ssh failures
* Pass server to RemoteClient in API tests
* Extend remote client to allow for better debugging
* Use a single venv for all tempest jobs
* trove: skip broken tests
* Added random Infiniband GUID address generator
* Update configuration docs wrt admin credentials
* Remove few refercences left to tempest-lib
* Remove negative test framework documentation
* Removed q-vpn from the list of dirty logs
* Migrate network resources into scenario path
* object\_storage/object\_client.py: kill some dead code
* Fix reference to tempest\_lib
* Verify config support keystone on subpath
* Fix tempest init to update config options
* Fix conf file open mode when "tempest init"
* Volume: remove a useless \`\_delete\_volume\_type\` alias
* Py3: \`reduce\` is not a built-in anymore, use six.moves instead
* Py3: fix an error when adding two \`dict\_items\`
* Add option to tempest init to show global conf dir
* Fix error message about credential
* Search another path for etc/tempest
* Use the same logic for selecting config path
* Remove unnecessary space in help
* Make README.rst consistent
* Add generic CONF skip decorators
* Fix base unit test class location
* Fix account generator error message
* Remove Ceilometer tempest tests
* Fix usage of rest\_client expected\_success() in tests
* Add ostestr tox jobs
* Add tests of fixed\_ips in the attach interfaces nova API
* Skip test\_volume\_list\_with\_detail\_param\_marker
* Updated from global requirements
* List only alive agents
* SSH: Do not rely on the .closed attribute
* Align multiple lines in tox
* Add pep8 check to use data\_utils.rand\_uuid()
* Fix rest\_client's expected\_success for non int status
* Add a test for reverting a resize with a deleted flavor
* Remove definitions of unused exception classes
* Remove iso8601 and anyjson from requirements.txt
* Remove old cinder multibackend configuration from tempest.conf
* "is\_resource\_deleted" fails to verify delete
* Microversion v2.20 tests: nova volume operations when shelved
* Move shelve server logic in compute utility
* Add compute 2.10 microversion tests info in doc
* Replace Mox with Mock
* Do not create network resources in verify-config
* Updated from global requirements
* Get rid of httplib2, use urllib3 instead
* Remove openstack-common.conf
* Updated Image Not Created Error Thrown
* Remove JSON from class name
* Fix version replacement when path
* Refactor extract code to function in auth.py
* Use tempest.tests.lib.base instead of tempest.tests.base
* Adding explanation comment for multi-node test
* Fix Review Checklist URL
* Enable T108 check for network api tests
* Update extra\_headers param docstring
* Updated from global requirements
* Add separate release notes page for v11.0.0
* Move multi-tenant server negative tests into subclass
* Change alarm client name and tenant name
* Change assertTrue(isinstance()) by optimal assert
* Extend T110 check for lib's service clients
* Added test for router's port update with fixed IP

11.0.0
------

* Move keypair client to lib interfaces
* Skip test\_compare\_db\_flavors\_with\_os
* deprecate use of tenant in configs
* Make ports\_client use common waiter method
* Fix volume mountpoint - read from configuration file
* Remove AuthorizationTestJSON tests
* Ignore created\_at/updated\_at in test\_show\_port
* Fix \`test\_requires\_ext\_decorator\_with\_all\_ext\_enabled\`
* Add pep8 check for tempest.lib import
* Prepare for dynamic generation of tempest plugin registry
* Remove the migrated service client
* Add T111 history to HACKING.rst
* Use common "waiters.wait\_for\_snapshot\_status" function everywhere
* Removing wrapper method for "wait\_for\_volume\_status" function
* Fix typo in variable name
* Add pypi download + version badges into README.rst
* Removing some redundant words
* Fix a few typos in microversion doc
* Add release notes for tempest release 11.0.0
* Add release notes page for v10.0.0
* glance\_http: add IPv6 support
* More info when fail to get api version
* Fix comments in microversion doc
* Removed deprecation warning from 'tempest --help'
* Correct server basic ops test case name
* Add microversion testing doc in tempest
* Move wait\_for\_resource\_status()
* Move list\_dhcp\_agents\_on\_hosting\_network()
* Remove redundant list\_router\_interfaces()
* Fix tests when having multiple floating pools
* Update the docs on ssh validation
* Add tests for compute v2.10 microversion
* include domain\_id when creating groups
* Remove unsed wrapper method
* Trivial: Fix some document comments in microversion
* Make routers\_client use \*\*kwargs
* Add support of microversion in all compute service clients
* Cinder verifies getting volume list with marker
* Fix API test for external subnet visibility
* Add note a section to lib doc about where to put plugins
* Fix cleanup CLI for router client
* Fix PendingDeprecationWarning for assert\*
* Migrated microversion testing framework to tempest/lib
* Move microversion config options to 'compute' section
* Remove tempest duplicate copy of skip\_unless\_attr
* Fix V3 credential behavior, documentation
* TrivialFix: Remove pending deprecationwarning
* Optimize "open" method with context manager
* Adding a note to 'test\_update\_user\_password' test for Keystone V2
* Update comments for keystone precision and fernet
* Unskip test\_list\_virtual\_interfaces
* Use tempest.lib's base module for network clients
* Split out Neutron routers client
* Make 'device' optional in volume attach response schema
* Test base\_url works with an unversioned endpoint
* Switch hdp to cdh in the default list of Sahara plugins
* common/compute.py: remove some useless code
* Added support to verify extra-routes deletion
* Fix typo in library doc title
* Allow get\_tenant\_network() for non-primary creds
* network: Fix subnet\_allocation extension check
* Use urlunparse to reconstruct base\_url
* Add OS-INHERIT of keystone v3 in api tempest
* Actually run \`test\_skip\_attr\_\*\` unit tests
* Making Keystone clients consistent
* Fixes LiveBlockMigrationTestJSON.test\_iscsi\_volume bad call
* Remove service\_client module
* Use tempest.lib clients for bulk ops
* Allow heat volume tests to use configured volume size
* Updated from global requirements
* Make network clients use rest\_client
* Make identity clients use rest\_client
* Make image clients use rest\_client
* Make volume clients use rest\_client
* Make database/telemetry clients use rest\_client
* Unit tests: mock some time.sleep and time.time
* Fix ambiguous method name
* Add more detail info to EndpointNotFound
* Make object/orchestration clients use rest\_client
* Implement TIMEOUT\_SCALING\_FACTOR for tempest
* Scenario/manager.py: always wait when delete a cinder vol

10.0.0
------

* Security Groups multi-node scenario
* Add LOG.info to boot from volume tests
* Fix test\_get\_service\_by\_host\_name
* Make compute keypairs\_client use rest\_client
* Make data\_processing/baremetal use rest\_client
* Add release notes for upcoming release
* Properly handle failures during resource cleanup
* Add documentation for the library interface
* Split roles\_client for keystone v3 client
* Tokens need user domain be created correctly
* Make identity service client class name consistent
* Cleanup useless aliasing in test\_container\_acl
* Updated from global requirements
* Add Identity v3 account configuration information
* Allow user to be disabled
* Instance ID was corrected
* Use isinstance instead of type
* Added processing /compute URL for getting list of versions
* Allow image name to be empty for simple list test
* remove largeops test
* Skip test\_volume\_backed\_live\_migration()
* Add reno to tempest
* Use tempest.lib code in tempest
* Deprecate Tempest stress tests
* Migrate tempest-lib code into new lib dir
* Skip Heat neutron tests
* Use new oslo.config api to generate configuration-group help
* Split trusts\_client from keystone V3 client
* Split domains\_client from keystone V3 client
* Minor test style update
* Add microversion fixture to set microversion
* Remove virtualenv management scripts from oslo-incubator
* Remove zaqar tests from tempest
* Python 3 deprecated the logger.warn method in favor of warning
* Enable logging if log\_config\_append is None
* Fix cleanup command
* Fix cleanup cmd for assigning role to user
* Remove redundant interfaces from v3 identity client
* Remove some dead code
* Remove test test\_create\_delete\_server\_group\_with\_multiple\_policies
* Get NIC name by "ip -o link"
* Use subnetpools\_client from tempest-lib
* Use quotas/security\_groups clients from tempest-lib
* Don't run testcase if interface\_attach is False
* Remove MapR 4.0.1 tempest test
* Skip the test\_get\_service\_by\_host\_name
* skip overlimit tests when default quota set is -1
* Split users\_client from keystone V3 client
* Separate projects client from identity V3 client
* Fix cleanup for networking quota
* Updated from global requirements
* Revert "Remove setup\_credentials from orchestration tests"
* Add cleanup for endpoint tests
* Remove old code for Juno compatibility
* Log more info when mke2fs fails on a guest
* Use 2 network clients from tempest-lib
* Update .mailmap
* Fix KeyError in exception message of manager
* Revert "Add new test "RebuildInstanceWithVolume""
* Add tests of port\_id in the attach interfaces nova API
* Updated from global requirements
* Updated .gitignore to work with ide
* Update the home page
* Make v3 identity\_client consistent
* Emit warning when instances have ports not ACTIVE
* Fixing typos in tempest/test.py
* Fixed bug with url building
* Add new test "RebuildInstanceWithVolume"
* Add note about ironic config options
* Make 2 functions in network\_client use \*\*kwargs
* Only run dual-NIC/dual-stack IPv6 tests in gate
* don't explicitly delete security group rules
* Remove setup\_credentials from orchestration tests
* Remove Keystone client variables that are not used anywhere
* Add new exception InvalidAPIVersionRange for microversion
* skip test\_list\_server\_filters\_by\_regex
* Remove the port list that is not used
* Separate microversion test case related unit tests
* Identity V3: missing api coverage for 'Get Endpoint' method
* Consolidate the ssh code
* Refactoring of 'DataGenerator' classes for identity V2 and V3
* Add the group and role checks API in tempest
* Fix stress tests job to use dynamic cred
* Split endpoints-client out of keystone v2 identity client
* Split out Neutron extensions client
* Updated from global requirements
* Scenarios: remove trivial wrapper methods
* Remove redundant import from scenario tests
* Replace legacy cred provider in heat api test
* Replace exit() by sys.exit()
* Revert "Cap Pip<8 due to pip bug"
* Split DataGenerator class for v2 and v3
* Updated from global requirements
* Separate base microversion client and compute client
* Updated from global requirements
* Fix logic in dump\_accounts
* Cap Pip<8 due to pip bug
* Add omit files for coverage
* create\_server: pass arguments as part of kwargs
* Split services client out of keystone v2 identity client
* Fixing test\_create\_port\_in\_allowed\_allocation\_pool when 3 (or more) controllers
* Use container/disk format settings in glance v1 test
* Wait for servers termination when cleaning up telemetry test
* Adds default domain name to dashboard login params
* add client\_manager\_class param to BaseTestCase
* Delete unnecessary internal method
* Mark amazon image file config options deprecated
* Split out Neutron security group rules client
* Raise tox min version to avoid maximum recursion issue
* Don't use non-existent method of Mock
* Migrate tempest-account-generator to new cliff cli framework
* Apply "POST/DELETE" rules to agents\_client
* Add network wrapper method checks
* Add different\_host test on multiple nodes
* Add tests for Nova microversion v2.2
* Fix to show cli subcommand help message
* Use 5 neutron clients from tempest-lib
* Fix create\_test\_server for multiple create request
* Make v1 list\_images use \*\*kwargs & doc string update
* Fix tempest\_lib import order
* Mark Javelin as deprecated
* Split users\_client from keystone client v2
* Updated from global requirements
* Migrate verify-tempest-config to new cliff cli framework
* Skip security group tests without secgroup ext
* API/compute: create all servers through the common wrappers
* Make volume snapshots\_client to use \*\*kwargs
* Updated from global requirements
* Add tempest-list-plugins
* Use floating\_ips\_client from tempest-lib
* Update global-requirement for tempest-lib
* Scenario: Skip TestServerMultinode when only 1 compute node
* Add external gateway to dvr before scheduling with dvr\_snat agent
* Redundent if Statement
* Make v1 create\_image & update\_image use \*\*kwargs
* Make volume volume\_client to use \*\*kwargs-part2
* Make volume volume\_client to use \*\*kwargs-part1
* Add support of schema versioning for microversion
* remove log\_console\_of\_servers from get\_remote\_client
* Trival: Remove unused logging import in some files
* Rename compute images\_client to compute\_images\_client
* Fix create/show/delete methods on subnetpools\_client
* Fix the password input
* Rename references to compute security group rules client
* Scenario manager: don't access glance\_client if Glance is not available
* Silences Javelin UT
* Typos and consistency in configuration.rst
* Fix grammatical mistake, Changed word from "an" to "a" in below file:
* Correct wrong message in configuration doc
* Wrong spelling of existing
* Add a note about using a full path for test accounts option
* Config: change cinder bootable flag to True
* Change LOG.warn to LOG.warning
* Misspelling in message
* Fixing the deprecated library function
* Misspelling in messages
* Change validate message for test\_exceed\_max\_template\_size\_fails
* Fix leak from tempest.conf in fake\_config fixture
* Add support override OS\_TEST\_TIMEOUT for all environments
* Wrong usage of "an"
* Wrong usage of "a"
* Fix server admin password usage
* Safe ram/disk/vcpus values for test-made flavor
* Refactoring of setting 'name' variable in tempest/common/compute.py
* Add set microversion in base compute service client
* Add logic to select the request microversion
* Make 2 base\_snapshots\_client function use \*\*kwargs
* Split out Neutron subnetpools client
* Split out Neutron agents client
* Make v3 update\_role use \*\*kwargs & doc string
* Use six.StringIO/BytesIO instead of StringIO.StringIO
* Make v2 for identity\_client functions use \*\*kwargs
* Updated from global requirements
* Keep py3.X compatibility for urllib.urlencode
* [V3] Renaming region\_client into regions\_client
* Fixing two tests when nova-net is enabled and run\_validation = True
* Stop testing rebuild for ironic
* [V3] Renaming policy\_client into policies\_client
* Split out Neutron security groups client
* Make 3 functions in network\_client use \*\*kwargs
* Add stdout logging for cleanup CLI
* Use servers\_client from tempest-lib
* Use Tempest-lib's compute server\_groups\_client
* Use Tempest-lib's compute security\_group\_rules\_client
* Use floating\_ips\_client from tempest-lib
* Update global-requirement for tempest-lib
* Fix password not strong enough for identity test\_groups
* Make v2,v3 create\_role use \*\*kwargs & doc string

9
-

* Fix tempest cleanup command
* Add description for stress in tempest cli
* [V3 identity] Renaming service\_client into services\_client
* Add stdout logging for stress
* Enable test\_list\_security\_groups\_list\_all\_tenants\_filter with neutron
* Remove the ec2 api tests from tempest
* Make volume\_qos\_client use \*\*kwargs
* Drop lock\_path section from config guide
* Set a tempest lock\_path default to a tmpdir
* Fix password not strong enough for cmd
* Get rid of unused env variable
* Update configuration options ssh-auth-strategy
* Remove pre-check for test accounts file in credential factory
* Split out roles client from keystone identity client
* Make update\_agent in network\_client use \*\*kwargs
* Fix telemetry tests to use v1 create image correctly
* Fix password not strong enough failures
* Make create\_image use \*\*kwargs
* Fix and improve server personality tests
* 'List volume type' comment has fixed
* Clean up comment about dual-stack case handling
* Fixed the comments of port security group test
* Split out Neutron quotas client
* Make server action methods[m-z] use \*\*kwargs
* [sahara] adding new plugin versions to sahara tempest tests
* Make add\_dhcp\_agent\_to\_network  use \*\*kwargs
* Make v3 update\_user\_password use \*\*kwargs
* Replace assertEqual(None, \*) with assertIsNone in tests
* Split out keystone tenant client
* Make server action methods[f-l] use \*\*kwargs
* Make server action methods[a-c] use \*\*kwargs
* Set force\_tenant\_isolation on neutron quotas tests
* Teach Tempest how to count vcpus
* Add compute client base class for microversion support
* Rename references to compute security groups client
* Make volume backups\_client to use \*\*kwargs
* Change docstring of compute client
* Make live\_migrate\_server() use common method
* Makes microversions config option clear about 'None'
* Make v3 create\_trust  use \*\*kwargs & doc string
* Make update\_extra\_routes use \*\*kwargs & doc string
* Making names of Cinder client classes consistent
* Remove unused add\_sample()
* Use Tempest-lib's compute volumes\_client
* Fix T110 violation for database client
* Remove pre-request-validation from v2 image\_client
* Make v2 create\_user\_ec2\_credentials  use \*\*kwargs
* Make add\_router\_to\_l3\_agent use \*\*kwargs
* Make volume\_types\_client use \*\*kwargs
* Add unit test for test\_servers\_client-allfunctions
* Add run\_stress to cliff-based cli framework
* Make add\_member use \*\*kwargs and doc string update
* Updated from global requirements
* Fix some Type in docstrings
* Split out Neutron metering label rules client
* Make create\_floating\_ip use \*\*kwargs
* Use the idempotent id and tooling from tempest-lib
* Switch run\_tests.sh to use subunit-trace
* Renaming Cinder admin client files
* Remove unused agents's schema
* Add script to use tempest-lib files in tempest
* Use interfaces\_client from tempest-lib
* Update global-requirement for tempest-lib
* Rename add\_image\_member to create\_image\_member
* Rename image\_client to images\_client
* Add docstring for update\_image\_member
* Make volume\_quotas\_client  use \*\*kwargs
* Add network quota exceeding negative test
* Put py34 first in the env order of tox
* Updated from global requirements
* Migrate scenario tests ssh-auth-strategy
* Changing directory structure for Cinder clients
* Fix typo in tox.ini
* Add tests to update group with few fields
* Split out Neutron metering labels client
* Remove unused json\_request()
* Rename private methods of glance\_http
* test\_port\_security\_macspoofing\_port: Fix an inversed check
* [V3] Rename get\_policy to show\_policy
* Make argument params of list methods consistent
* Add keystone v3 user negative case test authentication with disabed user
* [V3] Rename get\_region to show\_region
* [V3] Rename get\_credential to show\_credential
* Fix some Typo in docstrings
* Add the base microversions test part
* Make argument params of list methods consistent
* Remove "s" from imange clients' method
* Make image\_client use \*\*kwargs
* Change checks for test\_server test
* Fix race condition when changing passwords for admin tests
* Fix some inconsistency in docstrings
* Change multi-backend configuration to a list
* Use versions\_client, versions from tempest-lib
* Use tenant\_usages\_client from tempest-lib
* Use tenant\_networks\_client from tempest-lib
* Use snapshots\_client from tempest-lib
* Use Tempest-lib's compute services\_client
* Use Tempest-lib's compute security\_groups\_client
* Drop fixed\_network dependency from CONF
* Use V3 params when initializing Keystone V3 clients
* Use Tempest-lib's compute security\_group\_default\_rule
* Use Tempest-lib's compute quotas\_client
* Use Tempest-lib's compute quota\_classes\_client
* Fix T110 violations for image\_client
* Switch run\_tempest.sh to use subunit-trace
* Change tests to adapt alarm spliting
* Adds test for mac\_spoofing
* Split out Neutron floating IPs client
* Scenarios: cleanup class scope variable usage
* Change comments and description for minimum\_basic test

8
-

* Removing initialization of clients that are not used
* Use Tempest-lib's compute networks\_client
* Use Tempest-lib's compute migrations\_client
* Use Tempest-lib's compute limits\_client
* Remove preprov provider dependencies from CONF
* Use Tempest-lib's compute instance\_usage\_audit\_logs
* Use Tempest-lib's compute images\_client
* Add T111 hacking rule for consistent DELETE method
* [V3] Rename get\_group to show\_group
* Refactor T110 rule
* Add keystone v3 user negative cases
* Skip test that rely on creds by role
* Updated from global requirements
* Set default value for tempest log file
* Fix T110 violations for servers\_client
* [V3] Make groups\_client use \*\*kwargs
* [V3] Separating groups\_client from identity\_client
* Move identity wait until after password is updated
* Fix H404/405 violations for remaining
* Unbreak test\_created\_router\_interface (heat)
* Fix H404/405 violations for thirdparty and stress
* Fix H404/405 violations for unit tests
* Fix H404/405 violations for common code
* Fix H404/405 violations for api tests(3/3)
* Fix H404/405 violations for api tests(2/3)
* Fix H404/405 violations for api tests(1/3)
* Move get\_user\_by\_username to common part
* Move get\_tenant\_by\_name to common part
* Add negative test to test\_domains\_negative
* Fix H404/405 violations for tools
* Fix H404/405 violations for service clients
* Fix skip\_checks in live\_migration
* Move get\_server\_or\_ip method to common class
* Fix H404/405 violations for scenario tests
* Remove novaclient/neutronclient description
* Remove server\_groups\_client from ignore\_list
* [V3] Make service\_client use \*\*kwargs
* Add installation procedure of cookiecutter to doc
* Updated from global requirements
* Fix AttributeError in multinode jobs
* Rename get\_server\_group to show\_server\_group
* Add hacking rule for "GET /resources"
* Modify baremetal\_basic\_ops test
* make schedule\_to\_every\_node use real scheduler hint
* add 'create domain with name length > 64'
* [V3] Make region\_client use \*\*kwargs
* Factor up config dependent credential classes
* change some sentences to help understand
* add test to ensure cloud is using minimum number of nodes
* [V3] Make policy\_client use \*\*kwargs
* [V3] Make endpoints\_client use \*\*kwargs
* [V3] Make credentials\_client use \*\*kwargs
* Rename references to compute floating IPs client
* Remove unused config option image\_alt\_ssh\_user
* Use skip\_checks for live-migration feature in test
* Fix race condition when changing passwords
* Trivial fix of doc string
* Fix TypeError exception in test\_server\_actions setup
* Rename list\_users\_for\_tenant to list\_tenant\_users
* Apply a naming rule of GET to v2 keystone clients
* Remove unused has\_admin\_extensions()
* Modify scenario tests
* Use choices kwarg when defining string options with defined choices
* Remove BaseComputeTest and \_api\_version
* Provide better message when no IPv4 addresses found
* Split a server test into two distinct tests
* Refactor volume\_boot\_pattern test
* Add negative test: create domain with empty name
* Add cleanup to cliff-based cli framework
* Allow empty directories for tempest init
* Add assertion after domain deletion
* Updated from global requirements
* Split out Neutron ports client
* Add documentation for service catalog format
* Prepare cred\_client for migration
* Fix unit tests for migration
* Remove resource\_setup() from test\_live\_migration
* Switch to using pbr version for cli version string

7
-

* test\_snapshot\_pattern: cleanup class scope variable usage
* Remove checks for ipv6 utilities before use
* Add plugin cookiecutter in documentation
* Drop admin\_role CONF dependency from cred provider
* Remove dependency from credentials domain CONF
* Remove CredentialProvider deps to CONF
* Stop validating pre-provisioned credentials
* Removed shared instances for live-migration
* plugin.rst: Fix a typo in an example code fragment
* skip compute alt tenant tests if no project\_id in url
* Fix DEFAULT\_CONFIG\_DIR
* Remove skip decorator for volume scenario test
* Make docstring of servers consistent
* test\_network\_advanced\_server\_ops: cleanup class scope variable usage
* test\_minimum\_basic: cleanup class scope variable usage
* Pass the status 'ACTIVE' for getting a target port
* test\_shelve\_instance: cleanup class scope variable usage
* test\_stamp\_pattern: cleanup class scope variable usage
* Use Tempest-lib's compute hypervisor\_client
* Use Tempest-lib's compute hosts\_client
* Use Tempest-lib's compute floating\_ips\_bulk\_client
* Use Tempest-lib's compute floating\_ip\_pools\_client
* Use Tempest-lib's compute flavors\_client
* Fixing checking bytecode
* Use Tempest-lib's compute fixed\_ips\_client
* Remove migrated service clients from test\_service\_client
* Add compute personality feature config
* Use Tempest-lib's compute extensions\_client
* Use Tempest-lib's compute certificates\_client
* Use Tempest-lib's compute baremetal\_nodes\_client
* Use Tempest-lib's availability\_zone\_client
* Use Tempest-lib's aggregate client
* Split out Neutron subnets client
* Bump minimum tempest-lib version
* Moves an incorrectly marked negative test
* Set correct ACL for Swift staticweb tests
* Add failure ports to error message
* Make services\_client use \*\*kwargs
* Log output from ping command
* Fix value explanation in get\_creds\_by\_roles
* Add unit test for create\_server,list\_addresses
* Handle exceptions from plugins gracefully
* Rename accounts to preprovisioned accounts
* Add unit test for init.py->generate\_sample\_config()
* Fix return value of reserve\_fixed\_ip client method
* Use tempest-lib's agents\_client
* Fix fixed-ip schema for empty response body
* Updated from global requirements
* Rename isolated creds to dynamic creds
* Add json schema for disable service
* Fix tempest-account-generator command roles issue
* Add container and disk format parameters
* Added Test Cases for ImagesClient
* Added Test Case for InterfacesClient
* Add unit tests for show\_server and list\_servers
* Remove "extensions" from volumes\_extensions\_client
* Add unit tests for snapshots\_client
* Pass mount\_path through to ssh\_client.mount in scenario manager
* Remove unused \_ssh\_to\_server from test\_stamp\_pattern
* Remove "extensions" from snapshots\_extensions\_client
* Make create\_server\_group use \*\*kwargs
* Split out Neutron networks client
* Refactor tempest scenarios tests
* Check cinder api version in compute tests
* Fix gate-tempest-dsvm orchestration.stacks.test\_volumes failure
* Add test for config drive extension
* Replacing data\_processing with data-processing
* Add volume backed live migration test
* Add unit test for flavors\_client
* Fix spelling typo in warning message
* Follow up patch on missed IdentityV2 methods
* Subnet pools extension api added
* Updated from global requirements
* Fix init command
* Bring back Python 2.6 compat (don"t use dict comprehension)
* Negative test cases added in Telemetry
* Rename SwiftScenarioTest to ObjectStorageScenarioTest
* Full response for missed IdentityV2Client methods
* create\_router cannot take enable\_snat=False
* Metadata definition namespaces api added
* Add resource cleanup in volume snapshots tests
* Enhance unit test coverage: availability\_zone\_client
* Rename \`index\` test into list
* Add unit test for floating\_ips\_client
* Make create\_server use \*\*kwargs
* Rename references to compute networks client
* Create base class for Tempest Network clients
* Use tempest-lib's fake\_auth\_provider on services
* Fixing a typo in "TODO" message
* Move add/remove fixed ip action to servers\_client
* Change tenant usage tests to wait until retrive valid response
* Test case updated with alarm history api
* Add tests for getting nova api version details
* Remove \_stop\_instances hack in test\_volume\_boot\_pattern
* Add unit tests for volumes\_extensions\_client
* Add test for volume snapshot in compute api
* Fix missing value types for log message
* Add unit tests for security\_group\_rules\_client
* Remove nova v2 API comments
* Added Identity API tests for user ec2 credentials
* Fix way to create login\_url in dashboard test
* Return complete response from servers\_client
* Add a simple test for port security vs security group
* Skip test\_router\_rescheduling if l3 scheduler extension is not enabled
* Fix the condition of nova cert tests
* Switch using token\_client to the recommended
* Fix test\_port\_list\_filter\_by\_ip with test\_accounts
* Deprecate credential config options
* Enhance unit test coverage: agents\_client
* Add unit tests for security group default rules
* Remove list\_security\_group\_rules wrapper method
* Updated from global requirements
* Split the operator and reseller users in the account generator
* Add unit test for hypervisor\_client
* Add possibility to skip test\_subnet\_details if DHCP client not available
* Use proper method for nova disable service unit test
* Fix typos in scenario tests, etc
* Add unit tests for floating\_ips\_bulk\_client
* Return complete resp from volumes\_extensions\_client
* Give access to CredClient in tests
* Switch using token\_client to the latest for gate
* Only add roles for enabled services
* Add unit test for server\_groups\_client
* Use Cinder API V2 if V1 is disabled
* Add docs section on config options to reviewers guide
* Fix wrong dict reference for show\_network
* Unskip baremetal api tests
* Remove unused parameter 'tenant\_id'
* Added Test Case for HostsClient
* Added Test Case for BaremetalNodesClient

6
-

* Add unit tests for migrations\_client
* Add unit test for floating\_ip\_pools\_client
* Split snapshot test in test\_volume\_quotas\_negative
* Deduplicate cert, audit\_log and tenant\_net client
* Add unit tests for security\_groups\_client
* Remove code duplication in delete methods
* Added Test Cases for FixedIPsClient
* Ensure test\_list\_show\_tenant\_networks is isolated
* Deduplicate client unit tests
* Added test\_user\_update\_own\_password tests for Identity v2, v3
* Added test\_list\_tenants non-admin test for v2, v3 api/identity
* Cleanup API version schema
* De-duplicate test class names
* Make update\_server use \*\*kwargs
* Remove assertion checking rescoped issued\_at
* Add test for Nova list-versions API
* Remove Nova v3 version API schema
* Add hacking check for testtools.skip
* Cleanup tempest docs a bit
* Fix checks for X-Trans-Id in DLO-related storage tests
* Migrate volume tests to the ssh-auth-strategy
* remove service-type from neutron extension list
* Fix the condition of some snapshot tests
* Do not pass wait\_until to create\_server()
* Add docstring for tenant\_network
* Add unit tests for tenant\_networks\_client
* Switch remaining json import to oslo\_serialization
* test\_volume\_boot\_pattern: re-use create\_floating\_ip from base class
* Remove too\_slow\_to\_test flag
* Add "server" to action methods - part 2
* Fix identity new endpoint\_type options for old users
* Skip ebs scenario test due to bug 1489581
* Full response for VolumesClient methods
* Return complete response from remaining service client
* Encap netaddr-0.7.16
* Add mac info to test\_list\_virtual\_interfaces
* Return correct domains in cleanup service
* Remove meaningless braces
* Skip router rescheduling test
* Fix typo in baremetal\_group & AuthGroup of config.py
* Full response for database flavor client methods
* Fix response of database Limits & Versions client
* Add initial unit test for tempest plugins
* Update logic to detect DVR in rescheduling test
* add waiting for snapshot available status
* Fix the mix use of name and uuid in NetworksNegativeTestJSON
* Disable cinder backup import/export test
* Remove unused init file and directory
* Fix tests updating server by name rather than id
* Fix typo in the create\_isolated\_networks help in config.py
* Added CONF.validation entry security\_method
* Add unit tests for instance\_usage\_audit\_log\_client
* Add unit tests for certificates\_client
* Add unit test for  availability\_zone\_client
* Add unit tests for tenant\_usages\_client
* Add flag for volume clone tests
* Fix typo in tempest coding guide
* Return complete response from compute images\_client
* Return complete response from limits,migration client
* Return complete response from compute quotas client
* Properly skip nova tests if nova isn't available
* remove test\_update\_host\_with\_extra\_param
* Use the oslo.config sphinx module to generate sample
* Fixed few typos
* Add shelve/unshelve volume backed instance test
* Full response for missed Identity V3 Client
* Make volumes\_extensions\_client use \*\*kwargs
* Add plugin docs section on configuration options
* Update the Tempest README for new run workflow
* Return complete response from compute networks\_client
* Return complete resp from security\_groups\_client
* Return complete resp from sec grp default rule client
* Return complete response from tenant\_usages\_client
* Return complete response from tenant\_networks\_client
* Return complete response from services\_client
* Return complete resp from server\_groups\_client
* Return complete resp from security\_group\_rules\_client
* Return complete response from interfaces\_client
* Return complete response from instance usage client
* Return complete response from flavors\_client part-2
* Return complete response from flavors\_client part-1
* Return complete response from compute/aggregates\_client
* non-admin user only able to download Active image
* Update tox.ini for sphinx build instructions
* Fix misspelling in the "README.rst"
* Fix typo in tempest configuration guide
* Fix name "Quantum" to "Neutron" in comment
* Full response for Volume SnapshotsClient methods
* Router should be disabled to be upgraded to DVR
* Marking the login\_url option as "deprecated\_for\_removal"
* add 'boot from ebs' scenario test
* Full response for Database Limits & Version Client
* Remove some dead code
* scenario/test\_minimum\_basic: relax a MatchesDictExceptForKeys check
* Add unit tests for services\_client
* Fixed typo
* Full response for VolumeHostsClient methods
* Full response for Volume QosClient methods
* Full response for Volume BackupsClient methods
* Fix typo in tempest configuration page
* Full response for DataProcessingClient methods
* Full response for Orchestration client methods
* Return complete response from hypervisor\_client
* Return complete response from floating\_ips\_client
* Return complete response from hosts\_client
* Return complete response from floating\_ips\_bulk\_client
* Return complete response from compute certificates\_client
* Return complete response from compute extensions\_client
* Add unit tests for network\_client
* Add unit test for quotas\_client
* Make live\_migrate\_server use \*\*kwargs
* Full response from v2 ImageClient methods
* Migrate telemetry tests to the ssh-auth-strategy
* Return complete response from compute/keypairs\_client
* Return complete response from compute/agent\_client
* Adding timeout to verify\_metadata method in test\_server\_basicops
* Set validatable False by default
* Fix typo in Tempest Coding Guide
* Updated from global requirements
* Full response for Volume ExtensionsClient methods
* Full response for v3 ServiceClient methods
* Full response for VolumeServicesClient methods
* Full response for Volume AvailabilityZoneClient methods
* Full response for VolumeTypesClient methods
* Full response for v3 PolicyClient methods
* Full response for v3 RegionClient methods
* Remove redundant response schema check
* Make attach\_volume use \*\*kwargs
* Move wait\_for\_server\_termination from servers\_client
* Add docstrings for parameter translation
* Add "server" to action methods
* allow non '/' root for dashboard
* Full response for v3 IdentityClient methods
* Full response for v3 EndpointsClient methods
* Enhance IPv6 scenario - dual network testing
* Removed unnecessary commented code
* Full response for v3 CredentialsClient methods
* Bake in oslo sample config generation to sphinx build
* Add extension alias for test\_list\_show\_extensions
* Fixed single quoted docstring
* Fixed unformatted message string
* Move test\_waiters to match directory structure
* Handle 'error\_restoring' status in wait\_for\_volume\_status
* Fix constants of config sections names in verify\_\*\_api\_versions
* Cleaned up class variable scope issue
* Fixed invalid error message
* Remove unused ignore\_error
* Adds test for router rescheduling
* Full response for v2 IdentityClient methods
* Fixing tests when run\_validation is set to true
* Fix a spelling typo in tempest/thirdparty/boto/test.py
* Add unit test for quota\_classes\_client
* Add unit test for keypairs\_client
* Add unit tests for extensions\_client
* Enhance IPv6 scenario - Ping default GW
* Return complete response from floating\_ip\_pools\_client
* Full response for v1 ImageClient methods
* Fix scenario test fails when port\_vnic\_type is set
* increase failure information for ip\_regex test
* Added endpoint types for intialization of different IdentityClients
* Fix the way to get tempest.conf in README.rst
* Fixed Typos
* Add plugin interface documentation
* Discover the correct default config dir
* Stop gating on sample generation check
* Include sample configuration in dev docs
* Updated from global requirements
* Revert "Fix scenario test fails when port\_vnic\_type is set"
* Logging migrations for particular server if migration failed
* Return complete response from compute fixed\_ips\_client
* Move common functionality to base class
* Return complete response from compute baremetal client
* Return complete response from availability\_zone\_client
* Make security\_group\_rules\_client use \*\*kwargs
* Fix Typos
* Add identity v2 endpoint operations
* Fix sample config yet again
* Add plugin interface for extending sample config generation
* Ensure server unlocking after test\_lock\_unlock\_server
* Add unit test for aggregates\_client
* Make security\_groups\_client use \*\*kwargs
* Make security\_group\_default\_rules\_client use kwargs
* Make create\_image use \*\*kwargs
* Make create\_flavor use \*\*kwargs
* Make keypairs\_client use \*\*kwargs
* Make set\_flavor\_extra\_spec use \*\*kwargs
* Skip test\_check\_nova\_notification\_event\_and\_meter
* Avoid default quota limit of 10 subnets
* Remove openstack.common package
* Use relative path in data\_files in setup.cfg
* Rename service client classes which include "Ip"
* Allow v3 identity to work without the admin domain name
* Add unit test for method show\_limits
* Separate security\_group\_rules\_client
* Updated from global requirements
* Add unit test for method list\_keypairs
* Add unit tests for create/update/delete\_agent
* Add documentation to HACKING.rst describing idempotent\_id
* Fix two typos on tempest documentation
* Fix scenario test fails when port\_vnic\_type is set
* Update smaple config for new oslo.config release
* Add tempest init command to tempest cli
* Activate site-packages for tempest plugins
* Make quotas\_client use \*\*kwargs
* Make interfaces\_client use \*\*kwargs
* Fixing test\_volume\_boot\_pattern when use\_floatingip\_for\_ssh=false
* Add unit test for method list\_aggregates
* Updated from global requirements
* Fix Neutron cleanup
* Add 'allow\_duplicate\_networks' to compute-feature-enabled options
* Make fixed\_ips\_client use \*\*kwargs
* Use image minDisk as volume size when necessary
* Adds testcase for volume backup-export and import
* Avoid weird typecasting
* Remove extra space in docstring
* Reuse mocked body value between tests
* More cleanup/refactoring of neutron client
* Fix list\_migration response schema for None values
* Ensure we close the file accounts file after reading
* Updated from global requirements
* Remove redundant attach/detach volume methods from test\_minimum\_basic
* Ensure a role is assigned to created users with v3 auth
* Migrate compute tests to the ssh-auth-strategy
* Stop test execution in case of an plugin error
* Fix error in loader.discover() call
* Make aggregates\_client use \*\*kwargs
* Add unit test for agents\_client
* Switch all uses of json to oslo\_serialization
* Rename test.plugins to test\_plugins
* Fix non-admin compute quota issue
* Make argument params of list methods consistent
* Use self.client in test\_server\_actions
* Remove wait\_for\_server\_status from servers\_client
* Separate floating\_ips\_bluk\_client
* Separate floating\_ip\_pools\_client
* Updated from global requirements
* network\_client should support multi routes
* Fix mock==1.1.0 break test\_raw\_request\_chunked
* Sync venv scripts from oslo-incubator
* Make the arguments of resource id consistent
* Provide a full path top level to test discovery
* Remove wait\_for\_volume\_status from compute client
* Remove unused is\_enabled()
* Remove wait\_for\_image\_status from compute client
* Move wait\_for\_interface\_status from service client
* Create test for private image
* test\_server\_basic\_ops: Test metadata service
* Separate server\_groups\_client from servers\_client
* Add plugin interface for appending to tempest config
* Add basic external test plugin support to tempest
* Expanded assertion in test\_create\_token for keystone v2, v3
* Wait server to be terminated in VolumesV2NegativeTest
* Fixing test\_port\_list\_filter\_by\_ip in case of several DHCP agents
* Adding negative test cases for ports
* Remove unnecesarry code in PortsAdminExtendedAttrsTest
* Use the prefix-embedded rand\_name method
* Adding negative test cases for subnets
* Apply a naming rule of GET to show\_server method
* Get rid of duplicated creation of security groups in test\_volume\_boot\_pattern
* Remove "JSON" from sevice clients' names
* Add cliff based common cli entrypoint
* Fix useless usage of Linux utils
* Add ":" to docstring of CredentialProvider
* Remove str() calls from compute clients
* Apply a naming rule of GET to compute clients(v\*)
* Apply a naming rule of GET to compute clients(t\*)
* Apply a naming rule of GET to secgroup clients
* Use random password generator for IsolatedCreds
* Updated from global requirements
* update ceilometermiddleware sample target
* Removing unused functions parameters in test.py
* Removing unnecessary comments
* Unbreak the world!
* use services decorator to enable telemetry test
* add initial check for nova event in ceilometer
* Re-factor neutron client for 'list' methods
* Neutron service client should not trim API response
* Re-factor neutron client for 'delete' methods
* Re-factor neutron client for 'show' methods

5
-

* Re-factor neutron client for 'update' methods
* Re-factor neutron client for 'create' methods
* Add resource prefix string
* Modify RemoteClient to use ssh validation config parameters
* Add tests for Cinder volume list pagination
* Apply a naming rule of GET to compute clients([ik])
* Updated from global requirements
* Added comment how to get list of network extensions in tempest.conf
* Support for ipv6 in compute response JSON schema
* Fix the description in tempest.conf.sample
* Delete resources when dvr test skipped
* Updated from global requirements
* Apply a naming rule of GET to compute clients(q\*)
* Add compute\_feature\_enabled.attach\_encrypted\_volume config option
* Set the correct API version for the V2 identity client
* Block additionalProperties on Nova API tests
* Provide a config option to customize remote shell command
* Add create\_test\_server function
* Fix failed to access pip server when run behind proxy
* Fix no attribute 'is\_dvr\_router' error in test\_l3\_agent\_scheduler
* Add a rule for blocking "-" from rand\_name call
* re-enable glance notification tests
* Made a several-seconds checking&waiting for object to be deleted
* Remove key 'absolute' from limits client
* More javelin unit tests
* Apply a naming rule of GET to compute clients(n\*)
* Separate quota\_classes client from quotas client
* Remove error handling of list\_networks
* Apply a naming rule of GET to compute clients(l\*)
* Apply a naming rule of GET to compute clients(h\*)
* Remove advanced services tests
* Updated from global requirements
* Apply other "get" rule of GET to image v2 client
* Neutron: Remove get\_namespace from API extensions
* Fix spell error in configuration.rst
* More Javelin Unit tests
* Add tenant network creation to account creation script
* Fix L3AgentSchedulerTestJSON failure for dvr routers
* Fix fail test\_iscsi\_volume
* Apply a naming rule of GET to compute clients(f\*)
* Apply other "get" rule of GET to image v1 client
* Make the names of image\_member methods consistent
* Provides a sample resourcefile for Javelin
* Unskip test skipped because of closed bugs
* Fix several bugs in verify\_tempest\_config
* Added documentation to tempest-account-generator
* Fixing some tests for DHCP IPv6
* Check for NotFound exception in setUp() function
* Fix condition of Swift SLO API tests run
* Add test\_port\_list\_filter\_by\_ip test
* Add support for image deactivate and reactivate
* Check domain's enabled attribute strictly
* Deleting ports before deletion of routers in resource\_cleanup
* Raise baremetal.unprovision\_timeout default to 300 sec
* Do not consider subnets of shared public nets
* Add config option to disable network isolation
* Fix sample conf file based on new oslo.log release
* Log instance console when ssh fails in EC2 test
* Verify exact match for volume metadata update
* Check only for added/deleted metadata entries
* Remove extra return value from scenario call to show\_router
* Verbose waiting for status in neutron FWaaS
* Remove skip for bug 1439371 on test\_volume\_boot\_pattern
* Pass wait\_until arg in create\_test\_server call
* Fix Nova API misimplementation for security groups
* Replace "hardcode" in scenario tests
* Apply a list\_image\_members rule of GET to image client
* Apply a show\_image rule of GET to clients
* More Javelin Unit tests
* Fix typo in skip\_checks function of BaseTestCase class
* Apply a list\_images rule of GET to image client
* Add domains negative test
* Added test of default domain in Keystone
* Add test caller to scenario manager ssh connection failure for tracking
* Fixing broken Heat tests for Swift resources
* isolated creadentials are not cleaned up
* Remove heat-slow tox entry
* Fix typo in cleanup\_service class name
* Fixing wrong cleanup order in test "test\_rebuild\_server"
* Ensure scenario utils creds are cleaned up
* Tool for generation user accounts from spec
* Make sure filtered\_by\_ip list servers test uses correct ip filter
* Add passenv option to tox.ini
* Only create a TokenClient if api\_v2 is enabled
* Fix doc issue of lock test accounts
* Extend credentials to support roles
* Move identity\_version to class level
* Don't create network resources for scenario utils
* Add py34 to readme, pkg metadata, and envlist
* Image properties in scenario tests
* To test bootable flag in a cinder volume
* Fix last unit tests on py34
* Fix raise syntax in test.py for python3 compat
* Use six.moves.builtins to mock open in unit tests
* Introduce creds\_provider in test.py
* Extend get\_client\_manager to support roles
* Add new config option to globally trigger resource validation
* Add keystone v2.0 and v3 api discovery checks
* Adds unit test for Javelin
* Check IPv6 mupltiprefix feature
* Add cleanup after creating keypair
* Updated from global requirements
* Move remaining schema files into v2\_1 directory
* Switch use of hashing strings to unicode in accounts
* Fix tenant isolation and unit tests with py3
* Switch all uses of iteritems to use six instead
* Fix comprehension syntax error with python3
* Switch all uses of urllib and HTMLParser to import from six
* Fix verify\_tempest\_config to not leak a tenant
* Remove common/ssh.py due to migration to tempest\_lib
* Instance ID was corrected
* Remove CLI testing once and for all
* Fix server creation n test\_large\_ops
* Drop use of 'oslo' namespace package
* Define validation\_resources function for ssh validation
* Drop v2 and v3 tokens clients
* Respect configured cred provider in scenario utils
* Delete server after resize test
* Remove unused wrapper methods
* Trim object storage smoke tests to a small set
* Remove unnecessary force\_tenant\_isolation
* Remove version string from the setup.cfg
* Test live migrate on a paused instance
* add image smoke tags
* trim compute smoke tag
* Fix typo in scenario manager
* Fix logging.conf sample
* Drop auth and corresponding unit tests
* remove qos tests from volume smoke tag
* trim network smoke tests
* remove smoke tag from admin tests
* remove smoke tag from negative tests
* not all scenario tests should be in smoke

4
-

* Use addCleanup in test\_rebuild\_server
* Rework get\_network\_from\_name() function
* Remove unused methods
* Initial class creds creation in test base class
* remove gate tag (part 3)
* remove gate tag (part 2)
* remove gate tag (part 1)
* Apply a naming rule of GET to compute clients(a-e)
* Apply a naming rule of GET to telemetry client
* Cleanup some details about the accounts files
* Wait for complete deletion of volume snapshot before deleting volume
* Extend PATH and set -o pipefail in linux ssh
* Add OS\_TOP\_LEVEL to testr conf
* Switch all uses of httplib to import from six
* Switch all uses of ConfigParser to import from six
* Switch all uses of urlparse to import from six
* Switch all uses of StringIO to use it from six
* Fixing spelling errors in messages when tests are skipped
* remove swift cli tests
* Direct ssh bash output to /dev/null
* Fix non-locking test accounts doc section
* Add a paragraph on the use of tempest\_roles option
* Add section to config guide for setting up services
* Add config guide section on service feature enabled sections
* Add logging of account allocation to accounts provider
* Add configuration guide sections for more required options
* Start a tempest config guide networking section
* Fix test accounts unit test race with networks
* Revert "Test creation of server attached to created port"
* Honour ssh\_connect\_method in test\_baremetal\_server\_ops
* Cleanup fixed\_name logic in test\_list\_server\_filters
* Update linux client to support basic MTU testing
* Add version and min\_version to version API schema
* Add network support to the accounts providers
* Improve logging in fixed\_networks
* FIx Accounts with identity v3 and v2 data in yaml
* Add new multi ssh configuration options
* Refactor exception handling
* Rename an internal method to \_helper\_list()
* Apply a naming rule of GET to messaging client
* Enable tempest install to setup a config dir
* Adding port\_admin\_state\_change option to config
* Fix external connectivity check for dualstack
* Test creation of server attached to created port
* Add router to resources section of yaml output
* Make this script work with keystone v2 and v3
* Rearrange hypervisors response schemas into one file
* Embed network resoruces and credentials in TestResources
* Make L3AgentSchedulerTestJSON DVR-aware
* Prevent failures when running as non-admin
* Use network from get\_tenant\_network in scenario
* Use the catalog to discover available services instead of get\_service
* Adjust registration of ami image in boto tests
* Added cleanup for tenant quotas
* Remove EC2 test case that incompatible with Amazon
* Apply a naming rule of GET to orchestration client
* Apply a naming rule of GET to volume client
* Skip test\_volume\_boot\_pattern until bug 1439371 is fixed
* Fix fixed\_network bug 1439634
* Fix fixed\_network bug 1439634 - ipsec issue
* Rename test\_live\_block\_migration to test\_live\_migration
* L3 Agent Scheduler testcase cleanups
* Allow SSH instance with username and password in scenario cases
* Remove Sahara CLI tests (migrated)
* Limit tempest.config's use of cfg.CONF
* test\_accounts\_file can be None
* Print an error message and fail if network could not be found by name
* Allows Javelin to specify Swift role
* Only use accounts.yaml with locking provider
* Allow Javelin to create volumes without servers
* Remove hyphen from rand\_name calls in scenario tests
* Allows selection of floating IP pool in Javelin
* Skip test\_security\_groups\_basic\_ops for vnic\_type=direct of macvtap
* Use the configured version of identity in stress
* Add API tests for Neutron DVR extension
* Handle fixed\_network edge cases gracefully
* Clarify how to resolve a uuid collision
* Update description of Enable block\_migrate\_cinder\_iscsi
* Change default cirros ssh user
* Split resource\_setup for network tests
* Remove hyphen from rand\_name calls in identity tests
* Remove hyphen from rand\_name calls in compute tests
* Remove hyphen from rand\_name calls in thirdparty tests
* Start instances using fixed network when possible
* Remove hyphen from rand\_name calls in baremetal tests
* Remove hyphen from rand\_name calls in image tests
* Remove hyphen from rand\_name calls in volume tests
* Non-admin token tests for Keystone API
* Pass identity\_version into get\_credentials
* Support identity\_version in credential provider wrappers
* Refactor floatin\_ips V2.1 API response schema
* Drop any dependency from config in test\_credentials
* Refactor fixed\_ips API response schema
* Rearrange aggregates response schema into one file
* 1373513 has been fixed, remove skip
* Adding sudo to command \_renew\_lease\_dhclient in remote\_client
* Remove invalid use of kwargs from image clients
* Remove remaining CONF references in service\_client
* Use oslo concurrency api to get lock path
* Updated from global requirements
* Support v3 in credential providers and subclasses
* Remove ceilometerclient CLI tests
* Add test for the various config cases of is\_admin\_available()
* Arrange quotas response schema into one file
* Rearrange keypairs response schema into one file
* Fix interfaces response schema
* Rearrange certificates response schema into one file
* Rename compute response schema dir to v2\_1
* Respect configured credential provider everywhere
* Remove unused dependency to config module
* Fixing spelling error in the message when test is skipped
* Remove redundant calls to clear\_isolated\_creds
* Make check\_uuid executable
* Add 'instance\_uuid' in show baremetal schema
* Add 'disabled\_reason' in hypervisor schema
* Allow sress test runner to skip based on available services
* Fixes a typo and adds proper captilization
* javelin: don't destroy floating IP resource
* Remove last references to python-keystoneclient
* Add additional checks for attributes
* Adding common header attributes in image header schema
* Add 'fault' attributes in server schema
* Add 'images\_links' attribute in image list schema
* Add 'servers\_links' attribute in server list schema
* javelin: add missing network\_name in destroy\_servers loop
* javelin: fix destroy\_servers
* Restore "Add scenario 'test\_preserve\_preexisting\_port'"
* Fix NoSuchOptError when using use\_floatingip\_for\_ssh
* Distinguish between luks and cryptsetup volume types
* javelin: implement floating-ip support
* Skip test\_connectivity\_between\_vms\_on\_different\_networks for baremetal
* Deprecates 'format' in Javelin image description
* Revert "Add scenario 'test\_preserve\_preexisting\_port'"
* Remove python-ironicclient from requirements
* remove redundant negative flavor admin tests
* Remove neutron CLI tests
* Cleanup the tempest readme
* Skip boto tests when auth\_version is v3
* Testcase to create domain without description
* Create test nodes for test\_baremetal\_nodes
* Create a new project for trusts tests
* Allow full v3 authentication
* Support SSL and trace params in get\_credentials
* Add scenario 'test\_preserve\_preexisting\_port'
* fix import grouping
* Add section to the config guide on lock\_path
* Update all Oslo module use
* Decouple Sahara templates test from vanilla plugin
* Add support to the services decorator for trove
* Make is\_admin\_available not call for a token
* Stop using [orchestration] image\_ref
* Revert "disable neutron network tests that fail too much"
* Replace hardcoded volume size by created volume size
* Remove last dependency from keystone client
* Fix image/server schema for 'OS-DCF:diskConfig'
* Add extended server attributes in list detail schema
* Fix hypervisor schema for hypervisor status extension
* Keep up with changes in oslo-config-generator
* Make scenario tests requiring admin skip if no admin creds
* Split resource\_setup for compute tests
* Split resource\_setup for scenario tests
* Add check on role availability before request creds by roles
* Remove migrated utils code
* Copy the default params dict to avoid race
* Fix: don't hardcode admin role name, use config option instead
* Update auth section of the configuration guide
* Use ssl conf settings for raw verify\_tempest\_config requests
* Remove identity CLI tests
* Remove orchestration scenarios
* fix target location for ceilometermiddleware data
* Fix unpack error in test\_list\_servers\_detailed\_filter\_by\_image
* Switch swift tests to use cred\_provider with roles
* Add support for roles to credentials providers
* Remove tempest-lib exc Frobidden to Unauthorized translation
* Fix server schema for OS-EXT-IPS extension attributes
* Add server groups quota attributes in limit schema
* Add 'flavors\_links' attribute in flavor list schema
* Fix FIP bulk schema for 'fixed\_ip'
* Adding 'security\_groups' attributes in server schema
* Update test to fail instead of skip if floating pool is already allocated
* Skip CLI tests is identity v2 is not available
* Skip test\_subnet\_details for baremetal
* Replaces hardcoded volume size by configured value
* Testcase to create domain with disable status
* Remove CONF values from images clients
* Remove CONF reference from servers client
* Move identity v2 tests to their own folders
* Check Floating ip status before load balancer check
* Fix check for FloatingIP status before check connection
* Fix isolated cred cleanup for cli tests
* Allow time for ipv6 auto addresses to get assigned
* Split resource\_setup for thirdparty tests
* Fix ICMP code/type in security group rule test
* Editing comment in test "test\_trust\_expire"
* test\_neutron\_resources slow tag to gate
* Add a test for network connectivity between two tenant networks
* Log the names of the other isolated\_creds on starvation
* Fix response schema for compute aggregate API
* Add UUIDs to all tempest tests and gate check
* Add UUIDs to tests with tools and checks
* Remove python-novaclient from requirements.txt
* Prepare token clients for migration to tempest-lib
* Fix and re-enable H105
* Move to hacking 0.10
* Updated from global requirements
* Revert "Change messaging clients to return one value and update tests"
* Fix missing variable in test accounts warning log
* Set the boto ca\_certificates\_file from tempest config
* Add tempest config guide doc
* Fix AttributeError on testtools missing MismatchError
* Make tempest's python 2.6 policy clear
* Fix schema of list hypervisors API
* Add response parameters for quota\_server\_group ext
* refactor save\_state code
* add support for ceilometermiddleware data
* Simplify method deserialize\_list of network\_client
* Floating IP test enhancements
* Fix missing exception catch in is\_admin\_available()
* Remove unused NotFound raise
* Split resource\_setup for compute volumes tests
* Split resource\_setup for volume tests
* Adds IPV6 bulk ops tests for network/subnet/ports
* Fix baremetal node property keys
* Change network/interfaces clients to return one value and update tests
* Change messaging clients to return one value and update tests
* Change database clients to return one value and update tests
* Handle errors listing flavors and images in scenario utils
* Allow tenant isolation by default
* Split resource\_setup for limit tests
* Split resource\_setup for telemetry tests
* Split resource\_setup for identity tests
* Remove CONF values from Token clients
* Remove CONF values from identity clients
* Split resource\_setup for object\_storage tests
* Omitting microseconds when creating a trust
* Fix compute baremetal\_nodes API schema
* Change servers client to return one value and update tests
* Fix left-over client calls in stress test to receive one value
* Update compute base test to split up resource\_setup
* clear dict post cleanup in clear\_isolated\_creds
* Finish cleanup CONF from auth
* Skip new instance port admin state test for ironic
* Add 'type' parameter to compute image schema
* Change two-value client methods to use ResponseBodyData
* Cinder: Wait for volume to be 'available' before attaching
* Split resource\_setup for image tests
* Adds "retype" to "volume/admin/test\_volume\_types.py"
* Fix some typos in log and test
* Add the description of hacking rule T107
* Change tempest BadRequest exc to tempest-lib exc
* Remove unused password in test\_live\_block\_migration
* Use cls instead of self in classmethod
* Remove CONF reference from volume client
* Add os-baremetal-nodes tests
* Remove CONF values from data\_processing client
* Rename data\_processing client
* Remove unused CONF from limits/identity\_client
* Fix 'Number of new ports: 2' failure mode on test\_hotplug\_nic
* Updated from global requirements
* Drop the legacy and un-used \_interface
* Change basic server client methods to return one value and update tests
* Split resource\_setup for database tests
* Unskip and Add timeout method to dns check scenario
* Change project and domain parameters
* Change tempest Unauthorized exc to tempest-lib exc
* Change tempest NotFound exc to tempest-lib exc
* Change tempest Conflict exc to tempest-lib exc
* Change tempest OverLimit exc to tempest-lib exc
* Move default creds to cred\_provider
* Adding the ability to use pre-created ports in Network scenarios
* Remove novaclient CLI tests
* DHCP should be disabled on external subnet
* Change fixed/floating ip clients to return one value and update tests
* Fix super calls in ResponseBody and ResponseBodyList
* Change some small compute clients to return one value and update tests
* Change compute volume client to return one value and update tests
* Remove HTTP\_SUCCESS from tempest.test module
* Removes unused function from javelin
* Remove auth\_version config from get\_credentials
* Adding api tests for dvr routers
* Add compute feature enabled flag for the ec2 api
* Fix typos in boto decision\_maker()
* Change flavors client to return one value and update tests
* Change telemetry client to return one value and update tests
* Change data\_processing client to return one value and update tests
* Change limits/quota clients to return one value and update tests
* Volumes: strict type and value check of the 'bootable' flag
* Update test\_live\_migration for return-one-value
* Split resource\_setup for orchestration tests
* Change security-group clients to return one value and update tests
* Split resource\_setup for messaging tests
* Change keypair client to return one value and update tests
* Split resource\_setup for baremetal tests
* Split resource\_setup for data\_processing tests
* Test for id\_username instead of "Log In"
* Separate token client from identity client
* Switch to using the skip\_because decorator from tempest-lib
* Fix stress test which was not changed to receive one client value
* Updated from global requirements
* Remove CONF values from volume clients
* Fix import in nova cli tests
* Add debug info to timeout exception in \_hotplug\_server
* Change tempest InvalidContentType exc to tempest-lib exc
* Change tempest UnprocessableEntity exc to tempest-lib exc
* Remove unused exceptions
* Adds "list-groups" testcase to v3/test\_groups
* Remove UnexpectedResponseCode exception
* Remove CONF values from baremetal client
* Remove inheritance from baremetal client
* Move JSON de/serializers to base baremetal client
* Add sec-grp-rule for ipv6-icmp to enable ping6 between instances
* Order service clients setting first
* Remove CONF values from telemetry client
* Test case for database limits
* Update live migration test for return one value
* Remove data\_utils import from a service client
* Remove CONF values from messaging client
* Remove CONF values from object\_storage clients
* Do not parse Neutron error message to tolerate message changing
* Fix typos in security group scenario test
* boto: Remove skip for bug 1072318
* Add os-tenant-networks test
* Fixed a small spelling mistake
* Fix create server request in test\_network\_v6
* Add Forbidden translation
* Add \_set\_object\_storage\_clients() to client setting
* Add a tests for service clients
* Drop nova-manage CLI tests
* Turn off sitepackages
* Improves a couple of docstrings in Javelin
* Fix FIP negative tests for nova V2.1 API
* Always use an available plugin for CLI sahara test
* Updated from global requirements
* Add ironic port show by mac address
* Add a test for new-style container-sync
* Remove CONF values from database client
* Allow to specify the list of sahara enabled plugins
* Add SSL  parameters to negative tests
* Use server\_client clearly for removing server\_group
* Remove CONF values from network client
* Remove CONF values from compute clients
* Update glance\_http for SSL
* Fix \_create\_loginable\_secgroup\_rule in scenario manager
* update test\_volume\_boot\_pattern to assign one value
* Skip test\_subnet\_details
* Add ipsec-site-connections to resource map of a network client
* Use valid metadata keys for compute images
* Switch rest\_client module to tempest-lib
* Remove RestClientException inheritance
* Change orchestration client to return one value and update tests
* Remove CONF values from OrchestrationClient
* test\_update\_instance\_port\_admin\_state
* Test multiple security groups association for a vm
* Change some compute admin image client methods to return one value
* Add explicit cleanup to test\_ports
* Add compute\_quotas lock fixture to test\_absolute\_limits\_negative
* Use create\_test\_server in test\_max\_image\_meta\_exceed\_limit
* Add return one value to volume delete methods
* Adds scenario for DNS-nameserver configuration
* test\_verify\_multiple\_nics\_order failing in gate
* Remove JSON-specific code from client settings
* Change compute image client methods to return one value
* Make rest\_client module py34-compatible
* Move tempest\_roles options to auth group
* Add roles to all tempest created users
* Change volume client methods to return one value
* Move fake get\_credentials methods to test\_auth
* Remove CONF reference in test\_rest\_client
* Move ResponseBody/List classes to service\_client
* Make TestSwiftBasicOps use object\_client
*  Test port update with new security group
* Separate tests of negative\_rest\_client
* Remove imports of http module
* Add raw\_request() to RestClient
* Remove all CONF values from RestClient
* Updated from global requirements
* Adds tests create/update port with multiple attributes
* Create port in allowed allocation pools
* Restore the persistent server option in the LB tests
* Add image client build timeout config option
* Change image client methods to return one value
* printout testr tests that fail
* Add a test for filtering list servers for a specific tenant
* Change v2 identity client methods to return one value
* Floating IP Negative Tests
* Handle HTTP 415 in rest\_client
* Update sample config
* Separate NegativeRestClient from rest\_client
* Move \_get\_region() to NegativeRestClient
* Remove ObjectClientCustomizedHeader class
* Remove AccountClientCustomizedHeader class
* Remove \_get\_endpoint\_type() from RestClient
* Separate build\_interval/timeout from RestClient
* Updated from global requirements
* Delete unused schema definition console\_output
* Ensure subnet for port security group tests
* Avoid port\_state error in test\_create\_list\_show\_delete\_interfaces
* Drop ComputeAdmin configs, credentials and manager
* Remove python client related logging
* Preupgrade setuptools in tox tempestenv
* Change v3 identity client methods to return one value
* Ignore router\_interface is not found while cleanup
* Test delete of SLAAC subnet without port delete
* Floatingip as port fixed ip
* Refactor custom matchers
* Fixing typo in config.py
* Add ComputeClient for cleanup
* Skip personality max limit tests in case no limit
* Fix log message on exception in setUpClass
* Remove interface json and set skip\_test method
* EC2: do not assume order in dictionary
* Add ObjectStorageClient for cleanup
* Add VolumeClient for cleanup
* Improve error message on exception raised by get\_default
* Improves documentation formatting of cleanup.py
* Add IdentityV3Client for cleanup
* Fix dhcpv6-stateful tempest test to validate only valid use-case
* Avoid overlapping subnets in class NetworksTestJSON
* Add test case for floating\_ip response body
* Actually attach a volume to an instance before taking snapshot
* DHCP6 Tests fail to remove DVR ports
* Adds documentation for Javelin
* Fix slowest test output after test run
* Change neutron client methods to return one value and update tests
* Test wrong IP version of prefix in security rule
* Skip load balancer API test for ipv6 network
* Routers Negative API Test
* Correctly fetch the ips from server
* Add a word "Test" to metering test classes
* Remove Nova v3 API config
* Reorder setup and cleanup functions for readability
* Remove unnecessary setting from CredentialsTests
* Add Test to Create Port with no security groups
* Fix rebuild server tests for wrong input
* Add note about build\_timeout
* Remove Nova v3 API schemas
* Remove Nova v3 API clients
* Remove Nova v3 API tests
* Use isolated creds for dashboard scenario
* Fix ipv6 network scenario in multi-network environment
* Skip IPv6 scenarios for baremetal
* Remove use of 'cls.enabled = False'
* Bump working version to 4
* Remove Nova v3 API code from RestClient
* Raise a new exception NotImplemented for HTTP501
* Remove XML related code from RestClient
* Updated from global requirements
* Change rest client exceptions' inheritances
* Move safe\_body() into specific class
* Make InvalidServiceTag inherit from TempestException
* Framework for staged setup
* Use assertIn to check for subnet membership
* Do not test the metadata\_items limit when there is no limit
* Remove unused TOKEN\_CHARS\_RE
* Remove network debug
* Check that the number of fixed\_ips is at least one
* Skip test\_update\_router\_admin\_state for baremetal
* Temporarily disable service-type test
* Do not test the maxImageMeta limit when there is no limit
* Ensure extension aliases are used for nova based services
* Revert "Log the credentials used to clear networks"
* Add more verbose info for wait\_for\_...\_status methods
* Remove Volume V1 specific test base classes
* Log the credentials used to clear networks
* Ironic: Remove few misguided negative tests on ports
* Test to create bulk port
* Handle pagination keys in lister response
* Add ca\_certificates\_file option to test against SSL servers
* Make policy client methods return one value, and fix tests
* Support creating users with a default\_project\_id
* Port  API Test Enhancement
* Basic networks Scenario Test Enhancements
* Remove unnecessary secgroup attrs from scenario tests
* add cinder v2 api tests for volume\_services
* part-2 expect badRequest in server metadata test
* Use volume\_id rather than volume\_name in volume extensions timeout
* Fix print name of ResponseBody object
* Adds scenario for IPv6 addresses
* Expect badRequest in server metadata negative test
* Adapt negative testing documentation
* Use a compute service type from tempest.conf
* Respect auth.allow\_tenant\_isolation
* Remove unnecessary parameters on create\_volume API
* Fixing casual failing of nc service in LBaaS

3
-

* use built in HTMLParser instead of lxml
* Firewall as a service API Test Enhancement
* Remove not used attribute \_schema\_file
* Remove unused xml config options
* Enable cinder v2 api tests in volume quotas
* Add code to enable single-value response for http clients
* Scenario manager: catch Exception in get\_remote\_client
* Fix doc for usage of python clients in scenario tests
* Expand service validation to work for Nova cells
* remove xml\_utils and all things that depend on it
* purge xml clients from tempest.clients
* part 2 of delete xml
* delete all compute xml tests
* Skip test\_volume\_boot\_pattern until bug 1373513 is fixed
* Dashboard login page assert string fix
* rm pyc files before test runs
* Cleanup class resources for large-ops scenario
* Take InstanceType for launchconfig res creation
* Unified interface for ScenarioTest and NetworkScenarioTest
* DHCPv6 network tests
* Update documentation for clarity
* Updated from global requirements
* Fix error message when isolated tenant subnet creation fails
* Add check for too\_slow\_to\_test flag on swift notification test
* Use standard assertVolumeStatusWait for volume detachment
* Added neutron cli test case for fwaas
* Security Groups  API Tests Enhancements
* enable cinder v2 api for test\_volumes\_backup
* Add internal methods for setting identity clients
* Sync latest log module from oslo-incubator
* Add Conflict exception in test\_floating\_ips\_actions case
* Add internal methods for setting volume clients
* Moved init\_conf call and preserve tempest network objects
* Add config options for XML support in Keystone
* Ignore NotFound during network cleanup on API
* Enable cinder v2 api for volume type extra specs tests
* Enable v2 api for volume and snapshot tests
* Fix inheritance for BaseTestCase
* Move common compute clients to the setting method
* Enable cinder v2 api for volume hosts
* Adds test for deleting external network with floatingIPs
* Updated from global requirements
* Adds doc for public\_router\_id in tempest.conf
* Update README.rst for generating sample conf file
* Add internal methods for setting compute clients
* Attempt to test live\_migration by default
* skip test\_server\_cfn\_init as the failure rate is too high
* Delete console negative tests
* Add a shelve/unshelve scenario
* Make every swift clients use expected\_success
* enable cinder v2 api for volumetype test
* Fix invalid URL in AccountClientCustomizedHeader
* Add scenario test for swift-proxy ceilometer middleware
* Support for IPv6 tests for API
* Stop resource leakage for negative tests
* Use addCleanup when running swift scenario tests
* Make delete\_container use expected\_success
* Fix empty string as id in create flavor request
* Fixes grammatical errors in HACKING.rst
* Creating individual resources for vpnaas test case
* Remove a redundant KeyPairsV3ClientJSON
* javelin2: destroy functions above network resources
* javelin: add network and secgroup resources
* quota testcases use tenant\_name should use tenant\_id
* Fix tox stress invocation to not quote arguments
* Update docs for regenerating sample conf file
* Decouple resources and preconditions in secgroup scenario
* Fixes volume client in volume tests
* Revert "Skip test\_list\_server\_addresses if neutron"
* Adds "list external networks" test to regular user
* Remove ephemeral size assertion in baremetal scenario
* Add wait for async secgroup add to minimum basic scenario
* Skip some tests when cinder is not enabled
* Remove "Disabled Reason" from test\_cinder\_service\_list
* Increase default maximum safe\_body function
* Don't setup identity v3 client if v3 is disabled
* Fixed a comment on dirty logs list
* Fix service validation schema
* Increase the 'all' timeout because slow tests are included
* Change CLI tests to use auth providers
* Prevent external router IPs from being sent back
* Correct docstring indentation
* Fix the flavor ram string value
* Allow some lag for floating IP to reach a status
* Fix unit tests to detect import failures
* Adds method to verify multiple tenants are available
* Include 207 in http success status code RFC-4918
* Add list-networks test for os-networks API
* Fix missing usage of the xml neutron clients
* Use "ip" instead of "ifconfig" to get MAC address
* Remove checking of non empty resp body for 204
* Add config option for XML support in Networking
* Switch to using subunit-trace from tempest-lib
* Migrate cli test framework to tempest-lib
* Fix AttributeError when test\_function\_help fails
* Create subnet without gateway and explicit IP ver
* Adds test for list/get volume attachments V2 APIs
* Fix resource leakage in messaging.test\_queues
* Remove AltManager class from client
* Bump version string to coincide with kilo release
* Security Group ICMP validation for icmp-code
* Test to update port with CIDR value
* Added neutron cli test case for vpnaas
* Fix and re-enable test\_disassociate\_not\_associated\_floating\_ip

2
-

* Make duration in serial test approximate total run time
* Add cleanup to test\_verify\_multiple\_nics\_order
* Remove PYTHONHASHSEED=0 from tox pep8 job
* Log identifiers of resources being cleaned up
* Move tempest to oslo-config-generator
* Add list servers to large ops test
* Fix execute status of cleanup script files
* Don't double log API request
* enable cinder v2 api for test\_multi\_backend
* Fix resource\_setup order in scenarios
* Add missing space to build\_timeout description
* Verify network interfaces are in requested order
* Fix cleanup for EC2 test\_compute\_with\_volumes
* Adds TestSecurityGroupsBasicOps created VM's security\_groups check
* Move status check to client for "messaging" tests
* Make rest\_client.wait\_for\_resource\_deletion timeout error more specific
* Add exceptions.BadRequest to the test case of reserve\_fixed\_ip
* Run telemetry in javelin if resources.yaml says so
* Add a server console-log test with unlimited length
* Don't use a specific arg list for stress in tox.ini
* Remove @author tags from copyright statements
* Port  API Tests Enhancements
* Add Credentials Provider factory
* Fix duplicate ref of volume\_types\_client in vol tests
* Orchestration use stack timeout waiting for ping response
* Allow javelin to run with incomplete resources.yaml
* Add expected response checks of secgroup rules
* Fix verify\_tempest\_config with disabled services
* Fix use of kwargs instead of \*\*kwargs
* Drop unused safe\_setup decorator
* Hacking rule to forbid resource unsafe fixtures
* Log AttributeError as 'info' instead of 'exception'
* Remove OfficialClient dependency from HACKING.rst
* Adds status check for FloatingIP in network scenarios
* Remove setUpClass added after cleanup
* remove heat test\_updates tests
* Migrate cli tests to resource\_\* fixtures
* Migrate thirdparty tests to resource\_\* fixtures
* Migrate scenario tests to resource\_\* fixtures
* Migrate volume API tests to resource\_\* fixtures
* Improve IPV6 parity in Security Group testcases
* Revert "Skip telemetry\_notification\_api test due to bug 1336755"
* Fix Docstrings for test\_server\_basic\_ops.py
* Separate security group rule test for each args
* Remove Resp status code checks in stress tests
* Fix create\_user parameters for v3
* Don't parse config file if it doesn't exist
* Use shared values for test\_security\_group\_rules
* skip cfn\_init test, it is failing too much
* Revert "Add "reboot\_instance" EC2 API test"
* Remove "nova-manage flavor list" CLI test
* Removes deprecated net\_common module
* Drop client\_type for auth module
* Drop OfficialClientManager and references to it
* Drop OfficialClientManager from tenant isolation
* Add the start message for debugging net info
* javelin: fix user destruction
* disable neutron network tests that fail too much
* Fix finding router for scenario tests
* Fix schema definition admin\_flavor\_create
* Reduce complexity during import phase
* Add an internal test method for rebooting a server
* Fixes image create utf-8 multibyte test
* Add a test for deleting a suspended server
* javelin: Detach the volume before destruction
* Updated from global requirements
* Fix MismatchError for LB scenario test
* Clean up tox.ini and make tempest and unit test distinct
* Migrate scenario utils to tempest client
* Skip large\_ops\_scenario if large\_ops\_number < 1
* Migrate telemetry API tests to resource\_\* fixtures
* Migrate queuing API tests to resource\_\* fixtures
* Migrate orchestration API tests to resource\_\* fixtures
* Javelin: enable volume resources
* Fix resource cleanup in server rescue tests
* Rename NeutronScenarioTest to NetworkScenarioTest
* Drop OfficialClientTest and NetworkTest
* Cleanup leftover dependencies to official clients
* Add test caller to test\_server\_cfn\_init timeout error message
* reenable full request/response logging at DEBUG
* Fix use of code name in services decorator
* Add "reboot\_instance" EC2 API test
* Stop using intersphinx
* enable volumes v2 snapshot tests by sharing codes
* Easier to read console output
* Add bash to tox whitelist\_externals
* Remove duplicate \_ping\_ip\_address() methods
* Log deletion errors in  clean servers
* Migrate test\_load\_balancer\_basic to tempest client
* Properly preserve trace on error during wait
* Lock test\_resize\_server\_using\_overlimit\_\* tests on 'compute\_quotas'
* Replace wait with communicate to avoid potential deadlock
* Add a test documentation section to the docs
* Drop autoscaling scenario test
* Updates Tempest to match Zaqar's API name change
* Restoring dashboard tests
* Delete baremetal resources in correct order
* Add tempest post-run cleanup script
* Migrate baremetal\_basic\_ops to tempest clients
* Add missing baremetal API tests
* Typo fixes "tryies", "snaphot", "Retruns"
* Migrate object\_storage API tests to resource\_\* fixtures
* Migrate image API tests to resource\_\* fixtures
* Make cli test namespace include test files
* Migrate data\_processing API tests to resource\_\* fixtures
* Migrate database API tests to resource\_\* fixtures
* Migrate baremetal API tests to resource\_\* fixtures
* Migrate network API tests to resource\_\* fixtures
* Migrate identity API tests to resource\_\* fixtures
* Migrate computev3 API tests to resource\_\* fixtures
* Migrate computev2 API tests to resource\_\* fixtures
* Framework for resource safe class level fixtures
* Migrate TestStampPattern to tempest client
* Removes bogus negative create image compute
* Select AuthProvider type from credentials type
* Fix scenarios not passing down specific network
* Add subnet tests for extra attributes
* Add response schema for V2 sec grp default rule
* Migrate test\_server\_cfn\_init to tempest clients
* Fail tempest if 0 tests are run
* Remove PYTHONHASHSEED=0 from tox.ini
* Update Heat CLI test to pass with random hash
* Unskip test\_update\_port\_with\_second\_ip()
* Unskip test\_rescope\_token()
* Unskip test\_stack\_update\_add\_remove()
* Unskip test\_create\_and\_get\_delete\_bucket()
* Add test list\_servers\_filtered\_by\_name\_regex
* Properly print STDOUT and STDERR in test\_wrappers
* Backward compatibility to credentials in conf
* Migrate test\_large\_ops to tempest client
* large ops test should be derived from OfficialClientTest
* Skipping dashboard test to unblock gate
* Support lack of ephemeral volumes for baremetal
* Change LOG.exception to LOG.info for skipped tests
* VolumeMultiBackendTest: delete error volumes
* Add a test for deleting multiple objects by POST method
* Replace confusing member name
* Remove redundant waiter in create\_volume cleanup
* Better timeout exception in wait\_for\_resource\_deletion
* javelin: fix object destruction
* Allow new quota types
* Make SwiftScenarioTest methods public
* Have the EC2 instance test to wait for termination
* Migrate advanced server network to tempest clients
* Migrate test\_encrypted\_cinder\_volumes to tempest client
* Migrate security\_groups\_basic to tempest clients
* Fwaas API Test Enhancement
* Fix unstable assertion in test\_cinder\_endpoints
* Add baremetal API tests about console
* Move javelin2 over to use oslo logging
* Move cli tests into service subdirectories
* Move success response checking to the token client
* Move response code checking to client for v3 identity tests
* Check port's status also in show port tests
* Remove force\_tenant\_isolation=True from test that doesn't need it
* Verify network connectivity before state check
* Only log console log if nova supports consoles
* Avoid to iterate over empty list in DictMismatch
* Add a NotLockingAccounts credentials provider
* Fix use of nonexistent class variable in accounts
* Properly detect grenade in check\_logs script
* Fix TypeError in TestVolumeBootPattern
* Make output from check\_logs less verbose
* Fix V2 hypervisor server schema attribute
* Some scenario tests do not delete network resources
* Work toward Python 3.4 support and testing
* Make unit tests not depend on random hash seed
* Adds the clients and tests for CINDER QoS V1 & V2 APIs
* Fix load balancer scenario if no tenant network
* Fix network/secgroup scenario tests for ironic
* Allow out of quota failure status code to be 413 or 403
* Migrate test\_network\_basic\_ops to tempest clients
* Fix IPv6 default masks for SLAAC
* Adds v2 keystone service test to service v3
* Fix response body format of orchestration\_client to dict
* Fix "mutable" object as default value
* Cleanup neutron default security groups on tenant deletion
* Use safe\_setup instead try block in setUpClass
* Add a check\_telemetry method to javelin
* javelin: implement resource destruction
* Heat SwiftResources : only count containers created by Tempest
* Migrate test\_volume\_boot\_pattern to tempest client
* Migrate test\_server\_advanced\_ops to tempest client
* Migrate test\_server\_basic\_ops to tempest client
* Refactor ways of creating anonymous test user
* Improve the selectability of Swift tests
* Fix tox coverage job
* Adds Ironic set/get boot device API test
* Extract SwiftScenarioTest class to manager
* Client response checking for orchestration service
* Move API response success check to Neutron client
* Ensure proper ordering of XML arguments
* Add a test for inline parameter of TempURL
* Adds support for custom image formats in scenarios
* Fixes Hyper-V basic scenario volume partition name
* Add cases for Swift scenario test
* Allow FWaaS API test to accept more than one end state
* Revert change to get\_remote\_client()
* Add \_interface attribut in BaseNetworkTest
* Add sec-group rules for ping6 and ssh -6
* Catch BadRequest exception from correct module
* Add REVIEWING.rst
* Ensure PYTHONHASHSEED=0 for the 'all' tox env
* Remove functionality to load json files
* Updated database clients for bp client-checks-success
* Updated the baremetal client for bp client-checks-success
* missing network configuration in telemetry tests
* Add glance tag to test\_server\_actions
* Migrate test\_snapshot\_pattern to tempest client
* Migrate test\_minimun\_basic to tempest client
* Fix "NotFound" error in \_clear\_stacks()
* test\_hotplug\_nic wait for the guest
* Change default size for strings to 1
* Add functools.wraps on all function decorators
* Update volume client check success
* Add service tags to tempest/api/orchestration/stacks
* Add network's status check after creation of network
* Supports DEFAULT group opts in TempestPrivateConfig
* Do not run fwaas API tests in smoke
* Don't run lbaas scenario test as smoke test
* Add MatchesDictExceptForKeys custom matcher
* Deacrease the required image store size by 4 GiB
* Rename Marconi to Zaqar
* Remove test\_db\_archive\_deleted\_rows
* Add os-networks JSON client for tempest
* Migrate test\_aggregates\_basic\_ops to Tempest clients
* Migrate swift scenario test to tempest client
* Remove test start output in pretty tracer
* Use python abc in DeletableResource class
* Use python abc in StressAction class
* Add new snapshot compute feature flag
* Disable hacking rule H305
* Remove not used server creation from test\_server\_rescue
* Add ironic instance rebuild test
* Convert request schema (servers)
* Convert request schema (flavors\_admin)
* Convert request schema (flavors)
* Allow dict's as schema definitions
* Revert "Added neutron cli test case"
* Adds an orchestration API test for resource types
* Enable E128 ignore E129
* Use list comprehension in create\_bulk\_networks
* Enable H407,H305,H307,E122 ignore E123
* Relax check for router interface in \_verify\_network\_details
* Remove cleanup code according to TODO comment
* Fix errors on import with service tags
* Added neutron cli test case
* Add console\_output compute feature flag
* Add a config option to select compute xml api
* Fix arguments for method expected\_success
* Remove skipping test\_list\_servers\_by\_admin\_with\_all\_tenants test
* Remove skipping flavor\_access\_add/remove related tests
* Fix typo in comment
* Router API Tests Enhancements
* Move response validation schema's in sub folder
* Allow new quota types
* Removes test\_force\_delete\_server\_invalid\_state negative test
* Implement javelin2 destroy images
* Do not isolate networks for baremetal
* Add interface\_attach compute feature flag
* Skip ceilometer test test\_check\_glance\_v\*\_notifications
* Avoid unneeded use of set, and use list instead
* Stop leaking identity resources in teardown\_all()
* Add image-list to glance cli help test
* Set python hash seed to 0 in tox.ini
* Allow out of quota failure status code to be 413 or 403
* Change 'ceilometer' tag to 'telemetry' and add tags to cli tests
* Add a new credential provider to use a list of creds
* More comments to doc strings
* Add min\_client\_version decorator for CLI tests
* Skip test\_rescope\_token
* Add compute tags to tempest/api/database/flavors test
* Enable some volumes v2 tests by sharing codes part2
* If no volume, don't delete volume in teardown
* Allow out of quota failure status code to be 413 or 403
* Use random binary data for test images
* Tag test\_nova\_keypair\_resources as gate, not slow
* Fix skip\_path logic if path part is empty
* Add network tags to test\_quotas\_negative
* Separate create server schema for admin password
* Sahara: add API tests for jobs
* Sahara: preparations for job tests
* Move CommandFailed exception to tempest.exceptions
* Add unit test section to the field guide index
* Add links to the field guide index
* Fix javelin2's skip logic in checks
* Run javelin2 check at the end of create
* Make javelin2's ping for longer
* Make javelin2 create\_server wait for server to boot
* Avoid errors in log when neutron tests are skipped
* Add glance notifications tests for ceilometer
* Check rescue\_server action attributes of Nova APIs
* Add destroy\_server to javelin2
* Add logs to javelin2
* orchestration api test\_stacks wait for deletion
* orchestration: tolerate NotFound in wait\_for\_stack\_status
* Skip telemetry\_notification\_api test due to bug 1336755
* test\_neutron\_resources to read template's values
* Adds "user-password-update" to v3/test\_users
* Fix exception when api\_extensions is set to empty
* Use python abc in auth class
* Revert "Add tests for wait\_for\_server\_status"
* Add new shelve compute feature flag
* Check rebuild server action API attributes
* Delete unused class Service
* Add client response checking for data processing service
* Add config file flag to javelin
* Log when javelin2 finishes running successfully
* Make javelin resources optional
* Update compute attach tests to use "volume\_device\_name"
* Updated from global requirements
* Move baremetal API tests to an /admin subdir
* Skip migrate server invalid state if resize is off
* Make sure cli CommandFailed prints out stdout and stderr
* Fixes incorrect assertion check
* Migrate test\_dashboard\_basic\_ops to tempest clients
* Base class for scenario test using Tempest clients
* remove default=None for config options
* Fix a few bugs when running with -u
* Add base class for all credential providers
* Refactor random url generation into its own method
* Adjust stress test documentation
* Verify get\_instance\_action attributes of Nova API
* Call clear\_isolated\_creds in scenario tests
* Removed deprecated command from glance cli
* Make javelin check logging a bit better
* Added Heat Software Config-Deploy API tests
* Skip hypervisor uptime test for baremetal
* Create test images via Glance instead of Nova
* Correct misspelled words
* Add tests for wait\_for\_server\_status
* Adds new v3 projects tests to Keystone
* Adds list users tests in v3
* Correct volume type api schema validation
* Add "capabilities:" to multiple\_backends extra-spec key
* Re-enable 'check\_trust\_roles'
* Add three new CLI tests of sahara
* fix javelin to let you specify imgdir
* olso log sync
* Don't use swift roles when no swift
* Avoid conflicts with other tests instances
* Skip baremetal tests if driver not supported
* Always pass str to shlex.split for py26 compat
* First part of moving success response checking to identity client
* Enable some volumes v2 tests by sharing codes
* Read template's expected value orchest test Part-2
* Read template's expected value orchest test Part-1
* Add a skip for bug #1334368
* Change of copyright to HP for keystone regions
* Make os-quota-class-sets test not break quotas
* Running without keystone v3 doesn't require uri\_v3
* Adds test for Sec group default rule Nova V2 API
* Remove docutils pin
* Exclude volume tags while listing instance tags
* Validate server detail list attribute of Nova APIs
* Add Ironic show driver API test
* Make test\_drivers.py use driver name from conf
* Fix disk\_available\_least in JSON schemas
* Add python-ceilometerclient in requirements
* Convert scenario test tearDown to addCleanup
* Improve cinder CLI existing tests
* unskip list server actions tests
* update iptables rules for more useful debugging
* Remove unnecessary log message
* Sahara: minor changes for API tests
* Add skip decorators in test\_servers\_negative
* Fix "create a flavor" tests for strong validation
* VPNaaS API Tests Enhancements
* Add querying for lists in ceilometer client
* Fix race condition in flavor tests
* Remove the skip for test\_get\_instance\_action()
* Add network service tag to compute tests
* Verify "get a server" API response attributes
* Add parametric tests of Swift object API, part 4
* add py27 to default tox
* Make unable to ping log messages appropriate level
* Add caller to v1 image\_client wait\_for\_image\_status timeout exception
* Correct nc command in test\_load\_balancer\_basic
* Improve neutron CLI existing tests
* Require stevedore for check\_uptodate.sh
* Add 'id' to the server group cleanup list, not body
* Fixes Scoping bugs
* Replace the console output on Error with fault a message
* Skip quota-out tests temporary to change error codes
* Fix availability zone client in compute admin test
* Missing node driver interface validation API
* Sharing codes for volumes list tests
* Allowed Address Pair API Tests Enhancements
* Avoid snapshotting from compute authorization test
* Verify create agent attributes of V2/V3 APIs
* Drop unused admin client in server metadata tests
* provide enough time to do expires in obj tests
* Add Tests for Message & Claim APIs
* Add 'Member' role to all created users
* Add client response checking for image service
* HEAD doesn't return a body
* Added service "data\_processing" to service list
* Remove assertTrue from ssh unit tests
* Updated from global requirements
* Verify list-Floating-IP-Bulk Nova API attributes
* Add new rescue compute feature flag
* Avoid empty string for length in os-getConsoleOutput
* Use the http image location conf option for api tests
* Make test\_snapshot\_pattern ssh error path work
* Improve test isolation in test\_networks:BulkNetworkOpsTest\*
* Use config generator rc instead of wrapper script
* Update config generator from oslo-incubator
* Sahara: add API tests for job binaries
* Fix T104 for scenario test subdirs
* Add Ceilometer client for scenarios tests
* Skip case for fixing incorrect exception assertion
* Verify delete-Floating-IP-Bulk Nova API attributes
* Force connection auth as part of RemoteClient in scenario
* Don't try to trace non-printable characters in debug output
* Add tox job to build docs
* Adds scenario tests for volume encryption
* Added swift CLI test cases
* Verify V2 list server\_group API attributes
* Check create-Floating-IP-Bulk Nova API attributes
* Fix calls to mock.assert\_not\_called()
* Enable E251,E265 rules ignore H402
* Sharing codes for cinder v1 and v2 tests
* Enable E113,E111,H302,F812,E713 rules
* Don't include boto tests as part of smoke tests
* Bump hacking to 0.9.x series
* Unbreak baremetal API tests that were not updated
* Add test for compute API os-quota-class-sets
* Set default to false for nova v3\_api config option
* javelin: create and attach volumes
* Code clean-up of CLI test "cinder list-extensions"
* Verify list\_instance\_action attributes of Nova API
* Use known flavor ID as marker
* Tempest API tests: Add ipv6 attribute tests
* Disable isolated\_creds.net\_resources on network scenarios
* Sahara: preparations for job binary tests
* Handle backup not found in test\_create\_backup
* Remove the validate\_driver\_info test
* Sync versionutils from oslo-incubator
* add block\_device\_mapping to create\_server params for nova clients
* Add total runtime to summary output
* Heat Overlapping ip issue
* fix usage of allow\_tenant\_isolation
* Cleanup for local variable in test\_attach\_volume
* make 'server' as 'required' in server update schema
* Adds test for Floating Ips bulk Nova V2 API
* Correcting 'id' type in compute schema
* Add unittests for remote client
* cleanup on remote\_client
* Fix update\_server JSON Schema for Nova V2
* make logformat more similar to oslo
* Bump baremetal power/assoc/unprovision timeouts
* Add a hacking check to block scenario manager in api tests
* Convert get\_console\_output length=None to -1 for Nova V3 API calls
* Change how tempest debug logs are displayed
* Use correct base test class for test\_stress unit tests
* VPNaas IPSec policies tests
* Mising CLI test for Keystone
* Adds keystone roles v2 tests in v3
* Consolidate \_check\_tenant\_network\_connectivity in NetworkScenarioTest
* Consolidate \_check\_public\_network\_connectivity into NetworkScenarioTest
* Add bug skip for test\_container\_synchronization()
* Make run\_stress.py script an entry point
* Add README section about API stability
* Revert "don't reuse servers in test\_server\_actions"
* provide ability to tweak oslo log defaults
* Place baremetal common methods in base class
* Add parametric tests of Swift object API, part 1
* Optimization and response status code update
* Check create/get/delete V2 server\_group attributes
* Revert "Fail fast during advanced networking test"
* don't reuse servers in test\_server\_actions
* Add branchless tempest section to README.rst
* dump console if we time out on a server op
* Fix warnings from build\_sphinx
* Remove the list\_servers\_since\_test
* adds the missing \_interface variable
* Clarify API extension description of Nova API
* Nodestate API test for power state set
* Add cinder CLI tests "qos-list" and "encryption-type-list"
* Add CLI test of "nova server-group-list"
* Add missing compute service tags to volume API tests
* Reworked scenario tests to use their own non-default security groups
* Wait for server activations for the updated servers
* Add compute notifications tests for ceilometer
* Enhanced Trove (database) flavor API tests
* Verify 'update-server-metadata' APIs attributes
* botoclient does not honor disable\_ssl\_certificate\_validation
* Fixed argument parsing in run script
* Upload public image requires admin role by default
* Relax security group rules cleanup
* Sahara: add API tests for cluster templates
* Add veritification to name property in cinder volume
* Don't store duplicate policies for server\_group
* test\_aggregates\_basic\_ops picks a non compute node
* javelin 2
* allow for arbitrary kwargs in image client
* Updated from global requirements
* cleaning up index.rst file
* Sahara: minor changes for API tests
* allow 'main' as valid name for find\_test\_caller
* log request start when tracing classes
* Verify delete security group response of V2 API
* Remove default from image\_ref options
* Remove dependency on keyring
* Fix sudo\_cmd\_call in tempest.common.commands
* set all build\_intervals to 1s
* Deduplicate status call checks
* remove skip attributes for fixed bug
* Test script for CRUD operations on regions
* Use old dict generator syntax in baremetal/test\_ports
* validate server action 'console\_output' attributes
* Remove nova v2 client in ListSnapshotImagesTest
* Update version string to follow new convention
* Add quota delete test to cinder
* Make test\_server\_cfn\_init a scenario test
* Add Marconi Smoke Tests
* tests the Keystone extensions V2 API
* Verify server list\_addresses V2/V3 APIs attributes
* Cleanup docstring in test\_l3\_agent\_scheduler
* Verify Server Actions attributes of Nova APIs
* Revert "Adds certificate tests for keystone v3"
* Sahara: add API tests for job binary internals
* Sahara: preparations for job binary internal tests
* Make sure image exists in test
* Start using oslotest for tempest unit tests
* Sahara: add API tests for data sources
* Add "create a server" test with server group
* Switch back to nc in test\_load\_balancer\_basic
* Fail fast during advanced networking test
* Remove time.time mock from test\_ssh
* lbaas basic - open firewall for http on vip port
* Fix security\_group\_create\_get\_delete testcase
* Fix alt tenant id's issue in BaseV2MemberImageTest
* Enable H302 rule everywhere
* Use a more sensible network topology for some router tests
* Fix test\_create\_show\_delete\_security\_group\_rule
* Add hacking import exception for service clients
* tolerate HTTPNotFound in scenario manager teardown
* add test for command bash-completion
* Add API test for resizing a stopped server
* Verify more information in floating ip tests(part2)
* Fix hardcoded gateway in IPV6 subnet api tests
* Fix subnet api test case for non-default cidr
* Sahara: editing licenses
* Fix test case in security groups
* Verify more information in floating ip tests
* Adds certificate tests for keystone v3
* Get credential IDs from Credentials class
* Split large-ops into three tests so each has its own timeout
* Remove tempest\_auto\_config script
* Enable GET port\_detail API to set parameters
* Fix issues introduced /w migration to Credentials
* adds tests for CINDER encryption volume-type APIs
* Updated from global requirements
* Verify the response attributes of 'aggregate-add-remove-host' API
* Add a common admin class for Nova v2/v3 API tests
* create test and worker summary report
* Add tests for server-group Nova V2 APIs
* Verify "list interfaces" Nova v2/v3 API response attributes
* refactor out code duplication
* orchestration: add test for untyped provider resources
* orchestration: Add test for resource\_registry environment
* orchestration add basic support for environment API test
* Use find\_test\_caller to put test name in timeout exception details
* Check list servers attributes of Nova APIs
* Share Certificates API's tests between V2 & V3
* Inherit V2 API's flavors tests from V3 tests
* Inherit V2 keypair API's tests from V3 tests
* Verify list\_addresses\_by\_network APIs attributes
* Verify the response attributes of 'create-aggregate' API
* Verify update host Nova V2/V3 APIs attributes
* Add unit tests for tempest hacking checks
* Check non json type on glance client json\_request method
* Add in a concurrency aware subunit filter
* Access credential fields as attributes
* Enforces the use of Credentials (part2)
* tests the user-password-update for Keystone V2 API
* Removing unnecessary pass instructions
* Refactor \_find\_caller into a public test finder utility
* Add tests for availability-zone-list CINDER V1 API
* modifies the test to sort based on UUID
* Add compute service tags to ListSnapshotImagesTest
* Verify "update a server" API response attributes
* Skip creation of network resources for disabled IPv6 tests
* Added Trove (database) version API tests
* Extending quota support for neutron LBaaS entities
* Add noqa support to no\_setupclass\_for\_unit\_tests
* Neutron Allowed Address Pair API test
* Revert "add server personality files test"
* Updated from global requirements
* Add a common class for Nova v2/v3 API tests
* Add test for subnet gateway IPv4 and IPv6
* Separate common 'start\_up' definition from v2 schema
* Add unit tests for verifying extensions list
* Add unit tests for api\_version detection
* Add unit tests for \_get\_unversioned\_endpoint
* Add cmd entry point for verify\_tempest\_config
* Add support for updating the config file
* Enforces the use of Credentials (part1)
* Use auth data to fill credentials
* Define V3 Credentials
* Skip lbaas test test\_load\_balancer\_basic
* Fix stress runner not stopping on first fail
* Stress runner/driver prints stats after SIGINT
* Remove {begin,roll}\_detaching volume API tests
* Add a lacking message format letter 's'
* Verify Set/Get/Delete server meta item attributes
* Use fixed ips for lbaas pool members
* Add V3 Test to get Spice & RDP console of server
* Sahara: preparations for data source tests
* ssh\_floating verify reboot
* Updated from global requirements
* Add tests for CINDER services v1 APIs
* Verify create/get flavor attributes of Nova APIs

1
-

* Add a response header validation
* Verify more information for member in lbaas api tests
* fix test\_compute\_with\_volumes
* Remove unused arguments
* Adds more testcases to test\_telemetry\_alarming\_api
* Account failure to the tearDown instead of setUp
* Check for 'Generated' in SSH key comment
* Verify 'list-server-metadata' APIs attributes
* Verify the attributes of 'set-server-metadata' API
* Defines a Credentials class
* Verify addrs only against ports with fixed IPs
* Verify os-migration API response attributes
* Verify attributes through Nova os-quota-sets API
* orchestration api add test for volume retain deletion policy
* orchestration api add basic volume resource test
* orchestration api refactor access to stack outputs
* Verify tenant usages API response attributes
* Verify certificate API response attributes
* Verify delete aggregate attributes of Nova APIs
* Remove Nova v3 XML test skip
* Delete OrchestrationManager, and its unusual credentials
* skip the quota enforcement test for swift
* Add parametric tests of Swift object API, part 2
* Verify flavor extra specs attributes of Nova APIs
* Fix stress runner signal related issues
* ssh instance validation add options for Neutron
* Verify list agents attributes of V2/V3 APIs
* Added cleanup in some tests
* Check detail list Images attributes of Nova V2 API
* Check attributes of attach/detach volume Nova APIs
* Make large-ops test boot a group of instances 3 times
* Verify delete server attributes of Nova API
* Missing baremetal NodeState API test
* fix dict reference error
* Verify delete agent response of V2/V3 APIs
* VPNaaS API tests cleanup
* skip test\_stack\_update\_add\_remove because of race
* orchestration convert API test Timeouts to respect build\_timeout
* Avoid passing empty string as AZ name
* List multiple fields tests for networks/ports
* move out ironic exception from common import
* add quotas tests
* Skip more pause tests if pause is not available
* Up the default timeout for stack builds
* Remove test\_create\_port\_with\_no\_ip
* Validate list\_instance\_usage\_audit\_log Nova V2 API
* Fix test\_verify\_created\_server\_ephemeral\_disk
* Move exceptions back into one place
* Remove the unused \_get\_unused\_flavor\_id()
* Consider state in firewall create/delete test
* Add Sahara client for scenarios tests
* fix import for default clients in clients.py
* Swift formpost cleanup
* Implementing XML client for VPNaaS
* Fix import group ordering in test\_utils.py
* Add load\_test mechanism for InputScenarioUtils
* Move the test\_utils module to scenario test dir
* Add cinder api version detection to verify\_tempest\_config
* Fix service list in verify\_tempest\_config
* Fix url parsing for api version check
* Inspect listed ports for created port with binding
* Verify the response attributes of 'update-aggregate' API
* Check  get\_vnc\_console attributes of Nova APIs
* Remove test\_create\_server\_response
* Updated from global requirements
* Verify delete interface response of V2/V3 APIs
* remove n-sch from the watch list
* Unit Tests for glance\_http
* Add keystone api version detection to verify\_tempest\_config
* Add check that service tag isn't in path name
* Add unit tests for commands
*  Improve test\_load\_balancer\_basic
* Add unit tests for all generators
* safe\_setup preserve original trace
* Rename instance\_actions v3 plugin tests to server\_actions
* Don't output auth tokens with trace output
* Verify attributes through Nova os-security-groups API
* orchestration API add coverage for stack update API
* orchestration API refactor test\_list\_resources
* Verify delete quota response of V2/V3 APIs
* Verify "get az list" API response attributes
* Add opportunity to directly update headers
* Verify the response attributes of 'shutdown/reboot\_host' API
* Change to use absolute path in load\_template()
* Stop swift resource leaking even if an error occurs
* Verify list\_virtual\_interfaces attributes of API
* Add V2 Nova API os-agents tests
* Improve the extra routes test on router
* Remove created routers as part of test cleanup
* Make heat-slow job run in parallel
* Unskip load balancer basic scenario test
*  Verify the response attributes of 'aggregate-set-metadata' API
* Waiting for ACTIVE state in rescue tests
* Enable security\_groups\_basic\_ops blocking tests
* Network fwaas API test
* Volume size could be specified to create volume
* orchestration API base class rename clear\* functions
* Multiple fixes to test\_server\_basic\_ops
* Trailing '/' throws error
* Add network API test to create/update a port with 2 IP addresses
* Adds unit test for negative class decorator
* Sahara: preparations for new tests
* Missing baremetal driver API test
* Server create - JSON schema validation: adminPass is optional
* Check attributes of get server password Nova APIs
* Check attributes of create/delete sec groups rule
* unskip test\_list\_servers\_filtered\_by\_ip
* add trace\_requests option to debug section
* Remove python25 workaround from glance\_http
* Move run\_ssh class variable into skip decorators
* Honor suspend/pause config switches in scenario tests
* Verify the response attributes of 'startup\_host' API
* Remove singleton pattern in base\_generator
* Enable one flavor tests
* Verify detail\_list flavor attributes of V2/V3 APIs
* Adds Ironic test\_baremetal\_basic\_ops scenario test
* Add and use a StackResourceBuildErrorException
* Use OS::Nova::Server for NeutronResourcesTestJSON
* Move resize\_available class variable into skip decorators
* Move pause\_available class variable into skip decorators
* Move suspend\_available class variable into skip decorators
* Disable other suspend/resume tests if not supported
* Stress action for volume attach verify
* Expand baremetal port coverage
* Verify more information for pools in lbaas tests
* Split certificate API test
* Check add/remove flavor access APIs attributes
* Remove variable part of agent dict to fix AgentManagementTest
* orchestration add resource limit API test
* orchestration remove unused invalid\_template\_url
* orchestration api tests remove duplicate client assignment
* orchestration api tests, docstring cleanups
* Verify list extensions attributes of V2/V3 APIs
* Verify "get version" API response attributes
* Verify the create/delete volume APIs attributes
* Add os-migration tests for Nova v3 API
* Add os-migration tests for Nova v2 API
* Remove unused create\_image of Nova v2 API
* Check attributes of image meta item Nova APIs
* Validate image metadata attributes of Nova APIs
* Verify the response status of create delete Image
* Enable private flavors tests
* Verify hypervisor uptime attributes of Nova API
* Check list & search hypervisor attributes of Nova
* Validate hypervisors\_servers Nova V2/V3 API
* Introduce .coveragerc
* Verify the response attributes of 'get\_aggregate'
* Updated from global requirements
* Check show\_hypervisor attributes of Nova V2/V3 API
* fix sahara base class
* Verify list\_hypervisors\_detail Nova V2/V3 API
* Stop neutron resource leaking even if an error occurs
* Validate get\_instance\_usage\_audit\_log Nova V2 API
* ceilometer-collector now has errors
* Move xml common code into the common dir
* Verify "get quotas detail" API response attributes
* Deduplicate negative test calls
* Check hypervisor statistics attributes of Nova API
* Removing unnecessary pieces of code from network client
* factor out templates to yaml files
* Add list roles api to identity v3
* Update documentation for negative testing
* Validate for list flavor attributes of V2/V3 APIs
* Stop leaking in images tests
* Cinder client does not honor disable\_ssl\_certificate\_validation
* Typo in config.py
* simplify heat test\_limits
* Add config fixture support to unit tests
* Skip volume snapshot tests if feature is not enabled
* Verify attributes through Nova "list security groups" API
* Adds more verification in list alarms
* Add unit tests for cli.output\_parser
* Add a new exception for invalid structure
* Add unit tests for NegativeRestClient class
* Check reserve/unreserve fixed-ips APIs attributes
* Fail a test if stack delete failed
* Add sahara edp cli commands tests
* Cleanup sahara cli tests
* Some keystone V3 API tests throw incorrect errors
* Verify the response attributes of 'list\_aggregates'
* Add sahara to list of clients for T102
* Renew token before expiry time
* Check create/delete keypair attribute of Nova APIs
* Add Keystone role and service test cases
* Verify the list volume attributes of Nova APIs
* Stop volume leaking
* Test current tenant not added to private flavor
* Check attach-detach FIP & get FIP pool attributes
* Validate list\_keypair attribute of Nova V2/V3 APIs
* Validate get keypair attributes of Nova V2/V3 API
* Add "delete the volume-attached server" tests
* Verify list Image attributes through Nova V2 API
* Verify Nova create & get Floating IP attributes
* Define 'links' as a common parameter type
* Move to the python-saharaclient
* Remove resize-revert workaround for bug 924371
* don't log cli output on success
* add request timing
* add \_find\_caller to the request log
* Adds "add\_dhcp\_agent" to test\_dhcp\_agent\_scheduler
* add back empty whitelist
* Add Cinder quota negatives
* API test for 'create server with scheduler hints'
* simplify rest\_client logging
* Translate xml server tenantId /userId
* Skip loadbalancer basic scenario test
* Verify quotas attributes through Nova os-quota-sets API
* unskip test\_integration\_1
* Add error handling if testscenarios aren't supported
* Add parametric tests of Swift object API, part 3
* Verify "create a server" API response attributes
* Make add\_remove\_fixed\_ip tests executable in Nova gate
* Fix cinder quota cleanup
* Remove usage of internal library function in basic generator
* Add server to clean up even in case of errors
* fix cinder quota equality
* Verify attributes through Nova list flavor-access API
* Stop keystone resource leaking even if an error occurs
* Stop heat resource leaking even if an error occurs
* Make the checks of identity status code strict
* Add tests for external network extension
* Add validation test in identity v3 test\_role
* Use HTTP\_SUCCESS for checking success status code
* Verify "enable a service" API response attributes
* Verify Image attributes through Nova V2 GET API
* change dirty logs to work off a whitelist
* Verify the response attributes of 'show\_host\_detail'
* Verify the response attributes of 'list\_hosts'
* Validate of Nova list Floating IPs attributes
* Validate get limits attributes of Nova V2 API
* Networks,Ports: delete with subnet, port with no IP
* Add unit tests for configurable network resources
* Add slow tag for test\_ceilometer\_resource\_list
* Update Oslo config sample generator
* Volume boot test uses new block device syntax
* Introduce load\_tests mechanism for negative tests
* Stop test server leaking even if an error happens
* Refactor create\_ and update\_ methods for floating ips
* add volume list tests for cinder v2
* Cleanup common.debug
* Add unit tests for debug
* add server personality files test
* add compute quotas test
* Validate get fixed-ips attributes of Nova V2 API
* Ignore .coverage\* files
* Add utils.misc unit tests
* Enhance test to rescope token using v2
* Enhance rescope token test using v3
* Add test to rescope token using v3
* Add missing client names to T102 hacking check
* Add unit tests for wait\_for\_resource\_deletion
* Add test to rescope token using v2
* Add unit tests for the tempest.common.utils.file\_utils
* Add network credential unit testing
* Add unit basic unit tests for tenant\_isolation
* Support endpoint type in CLI tests
* Remove test\_can\_log\_into\_created\_server
* Add V2 Nova API os-quota-sets tests
* Add cinder tempest cases for encryption-type
* Modified test case for nova security group
* Add api tests for load balancer's VIPs and health monitors
* change teardown check to LOG.error
* Add return value of classmethod in network base.py
* Move verification of response attributes into service client
* Stop volume leaking even if an error is occurred
* Add list user groups api to identity v3
* Fix error trace induced by dhcp test actions
* Rename Savanna to Sahara
* Do not assert router l3 agent association
* Wait properly for server deletion in test\_volumes\_actions
* Add tests for binding extended attributes for ports
* Object storage tests to use default auth\_provider
* Volume xml client translate json attribute names
* Fix issue with pep8 gate job
* Validate Volume attributes of Nova POST & GET API
* Fix V3 image tests according to new image\_client
* Make imports proper order
* Convert fake\_config class to use config fixture
* Add agents tests for Nova v3 API
* Add basic Delete Queue Marconi test
* Make test\_volume\_quotas force tenant isolation
* Stop leaking test\_update\_images
* Move network test\_quotas to admin directory
* Skip Nova API attribute tests if an XML response
* Move negative tests for test\_images
* Verify service attributes through Nova "get services" API
* Updated from global requirements
* Unset the imageRef when booting from volume
* Verify more information in API tests for LBaaS
* Add quota\_set delete test for Nova v3 API
* API test for Get Image Member(s) Schema
* V2 API Test to get the VNC console of a Server
* Improve readability of test\_networks
* Adds basic Marconi test
* Support disabling suspend/resume for compute api
* Support disabling server pausing for compute API
* Updated from global requirements
* Prepare for enabling H302 rule(services/telemetry, object\_storage, etc)
* Add unit test for data\_utils
* fix flake8 errors
* Removed teardown method from image test
* add token get tests
* Remove unused build\_url function in data\_utils
* Add negative tests for endpoints
* Increase testing of network connectivity
* Fix problem of deleting dhcp port
* Allow failing logs with errors on a per-log-file basis
* Enable H302 check (tempest/services/volume)
* Add shelve\_offload test for Nova API
* Fixed \_error\_checker in rest client
* Make tempest accounts independent from devstack
* cleanup resources in setUpClass if exception raised
* Volume backup details API test
* Raise orchestration build\_timeout to 600 seconds
* Add ignore files related to coverage to .gitignore
* ServerCfnInitTestJSON wait for stack complete before ssh
* Skip nova cli tests with volumes if Cinder unavailable
* Fix RemoteClient usage in scenario tests
* Enable H302 check (api/compute/{c\*,f\*,i\*,s\*,t\*})
* Add support for negative tests with admin client
* Add multiple negative test generator support
* Add Trove (database) Flavor API Tests
* Fix test by waiting to lbaas entity delete
* Stop volume leaking test\_server\_rescue\_negative
* Do not setUpClass or tearDownClass V3 tests if API is disabled
* Prepare for enabling H302 rule(services/identity)
* Cleanup \_interface class variables in compute
* Prepare for enabling H302 rule(api/image)
* Prepare for enabling H302 rule(services/compute/v3/json)
* Separate negative tests for test\_images
* Prepare for enabling H302 rule(services/compute/json)
* Add status code checks for Nova attach\_interfaces API
* Nova V3 API test for resetNetwork/injectNetworkInfo
* Assign floating ip to a server in load balancer scenario
* Prepare for enabling H302 rule (api/volume,tempest/\*)
* Prepare for enabling H302 rule (api/compute/admin)
* image(s) schema image metadata API test
* Removes gate test annotation in security\_groups
* Fix invalid syntax in HOT templates
* Move ipv6 config option into network-feature-enabled
* Cleanup subnet creation in network api tests
* Stop running CONF getattr during import
* Seperate negative tests for V3 test\_server\_rescue
* Updated from global requirements
* Add Cinder tests for quota sets
* Add parametric tests of Swift account API
* Add "delete the resized server" tests
* Remove unused definition in network base.py
* Add "Nova V3 API test for add-fixed-IP/remove-fixed-IP"
* replace basetring/xrange
* Add V3 API Test to get the VNC console of server
* Add service/endpoint discover to verify\_tempest\_config
* Add swift discoverable\_api support to verify\_tempest\_config
* Make reseller admin role configurable
* Split out config option registration
* Add unit tests for image waiter
* Configure the ec2 zone explicitly
* Adds VM connectivity check after advanced VM operations
* Add Nova V2 API test for resetNetwork/injectNetworkInfo
* Remove unused \_parse\_array functions
* XML endpoint client use correct string for enabled
* Cleanup \_interface class variables in compute/v3
* unskip test\_security\_group\_rules\_negative tests
* Use pretty tox with the \`\`all\`\` env
* Revert "always use sitepackages"
* Fix setup\_test\_v3\_user method in identity base.py
* Add "V2 API- add-fixed-IP and remove-fixed-IP server action" tests
* Separate negative tests for test\_server\_addresses
* Skip test\_get\_instance\_action test for nova v3
* Prepare for enabling H302 rule (thirdparty)
* Extend network debug infos on network failures
* Add endpoint\_type option to Savanna,Ironic and Ceilometer groups
* stress/actions/ssh\_floating.py n-net compatibility
* Test to update neutron security group
* Improve tempest auth tests
* Fix api\_version filter for KeystoneV3AuthProvider
* Adds L3 agent test case to test\_l3\_agent\_scheduler.py
* Add namespaces to xml in Network client
* Adds scenario for hotplug nic in network\_basic\_ops
* NeutronResourcesTestJSON Use the correct resource name for console log
* Check server terminations on "delete server" tests
* Removal of methods from json/xml network\_client files
* Move admin "delete a server" tests to test\_servers
* Separate negative tests for test\_instance\_actions
* Improved tests in tempest.api.image.v2.\*
* Fix the usage error for config
* Clean network scenarios
* Test creating router setting tenant\_id
* Scenario : Start instances using fixed network when possible
* Prepare for enabling H302 rule (scenario)
* Prepare for enabling H302 rule (common,services,stress)
* Prepare for enabling H302 rule (api/compute)
* Stress runner friendly logging.conf.sample
* Add unit tests to tempest auth file
* Add security group deletion to the cleanup util
* Implement pluggability for tempest (exceptions)
* Separate negative tests for V3 test\_quotas
* Fix author information
* Log ip Information on ssh failures in the minimum scenario
* Fix stress runner exit issues
* Refactor Managers to a common base class
* Preventing overlapping subnets in network scenarios
* Fix a typo of debug log in scenario/manager.py
* Removed RestClientXML class
* Avoid masking an assert failure with a KeyError Exception
* Use Python 2.6.x compatible syntax for dict comprehension
* add cli.has\_manage option
* Fix InvalidInstanceID.NotFound handling
* Clarify admin\_delete\_server\_of\_others test case
* EC2 client token is not reuseable for new instance creation
* Add tests for Swift in orchestration
* Add qcow2 image support
* Clean up scenario functions
* Add "delete a shelved server" tests
* Separate the deleting server tests
* fix duplicate api\_extensions
* Improve ServerCfnInitTestJSON asserts and debugging
* Skip EC2VolumesTest if Cinder is not available
* Allow IPv6 tests to be disabled
* add TRACE level to the items that are being flagged
* Separate negative tests for test\_projects
* Makes some Swift API tests optional
* Separate negative tests for test\_multiple\_create
* Separate non-admin AZ tests from admin test files
* Remove unsed client variables
* Adds cinder backup functional tests
* Fix misspellings in tempest
* Splits network\_basic\_ops to fully isolated test cases
* Refactor cross\_tenant to security\_groups\_basic\_ops
* Minor changes to scenario manager
* Prepare for enabling H302 (identity,volume,etc.)
* Introduce T106 rule for vi modelines
* Seperate negative tests for test\_server\_rescue
* Mildly wound the interlopers
* Couple of fixes to tempest/auth
* Add python-savannaclient to requirements
* remove some unused code in nova image tests
* fix quotas client in admin/test\_quotas.py
* Fix test classes name of test\_tokens.py
* Migrate negative test to a different file
* Skip test\_list\_server\_addresses if neutron until bug 1210483 is fixed
* Restore heat tests running with admin user, demo tenant
* Fix get\_versions string parsing
* Fix get versions call in verify\_nova\_api\_versions()
* Fix containers with expired objects deletion problem
* Add quota\_set detail test for Nova v3 API
* Remove using of deprecated self.headers (part2)
* Make endpoint type configurable
* unskip test\_list\_non\_public\_flavor
* Removes vim headers 5th round
* Add basic Savanna CLI tests
* Refactor create\_ and update\_ methods for VIPs and health\_monitors
* Remove using of deprecated self.headers (part1)
* Add extra list servers by host test
* Prepare for enabling H302 rule (api/object\_storage)
* port nova v2 images related tests into nova v3 part2
* Neutron Extra DHCP Options API test
* Neutron LBaaS Agent Scheduler API test
* Add api tests for neutron router
* Replace assertEqual(None, \*) with assertIsNone in tests
* Switch over to oslosphinx
* Fix request id log messages
* Add a note about python2.6 support to the README
* Ensure that bug number is actually a number for skip\_because
* Test tempest decorators used on integration tests
* unskip neutron\_meter\_label cli tests
* cleanUp() removing all test resources as an admin
* Rename Openstack to OpenStack
* Add CRUD tests for telemetry alarming
* clean up security groups tests
* port flavors and server\_password tests into nova v3 part2
* Define py27 assertFoo methods for py26
* Add test case for snapshot-create with in-use volume
* Test updating port's admin\_state\_up
* Separate negative tests for test\_list\_image\_filters
* Fix coverage option for run\_tests.sh
* Adapt documentation for negative testing
* Remove tests for Nova V3 API os-simple-tenant-usage
* Adds list pool stat test case
* Refactor rest-client and identity v2-client
* Add some cases about volume-create and volume-rename
* Remove tests for Nova V3 API os-instance-usage-audit-log
* Fix test\_create\_list\_delete\_volume\_transfer without tenant isolation
* Fix usage of NotImplementedError exceptions in auth classes
* Rename images variable in TempestConfigPrivate
* Add a serial full tox job to tox.ini
* auth.py is too verbose
* port flavors and server\_password tests into nova v3 part1
* Remove tox locale overrides
* Use testtools.matchers.GreaterThan in test\_volumes\_transfer
* Use service catalog\_type when getting the heat/glance clients
* Fix syntax in test\_load\_balancer\_basics.\_check\_load\_balancing
* Let the soft reboot really happen in the minimum scenario
* enable volume list tests for cinder v2 - part2
* enable volume list tests for cinder v2 - part1
* fix base\_url in auth.py
* Network API: default to ipv4, add ipv6 tests
* Fix volume transfer tests with tenant isolation disabled
* Fix images tests with tenant isolation disabled
* Add support for special char in volume metadata
* Fix client usage in multibackend volume test
* Add nova migration-list CLI test
* InputScenarioUtils load images if glance available
* Skip failing test load balancing test
* Test to list ports filtered by router ID
* Support building wheels (PEP-427)
* network: add metering api operations
* Fixed misspellings in Tempest
* Add more information to BuildErrorException
* Make v2 and v3 identity apis configurable
* The rescue tests requires neutron resources
* Negative tests: Add result check for resources
* Savanna: add API client and tests for plugins
* Fix admin tenant credential
* Multiversion authentication part2
* Add check\_uptodate.sh to run\_tests.sh -p
* Use isolation credentials for neutron api tests
* Add the keyword "Test" to some test class names
* Clean/leave OpenStack after a stress test
* Add unit tests for negative test framework
* Multiversion authentication part1
* Removes leftover self.conf from isolated creds
* Add logging config values
* make testing neutron api extensions optional
* Remove unnecessary volume creation in test\_server\_rescue
* Correctly call client inits from test\_multi\_backend
* Change import of exceptions for keystoneclient
* Add log info for tempest SSH connection issues
* Negative test autogeneration framework
* Add scenario test for load balancer
* Fix attach\_interfaces tests of Nova v3
* Remove suffix "JSON" from Nova v3 API test classes
* Remove suffix "JSON" from Nova v3 API last test class
* Add parametric tests of Swift container API
* Add skips to the services decorators
* Fix services decorator to use object\_storage
* Fix stress test README.rst
* Don't run extensions list if service isn't available
* Updated from global requirements
* Add test for OS::Neutron::Router Heat resource
* Add missing isolated\_cred cleanup to savanna tests
* Remove last uses of config without global CONF object
* Add key -n for sudo utility
* Convert all service clients to global CONF object
* Convert cli tests to use global CONF object
* Convert scenario tests to use global CONF object
* stop leaking tempdirs
* Enable tenant isolation for the boto tests
* Convert thirdparty and stress tests to use global CONF object
* Convert volume api tests to use global CONF object
* Convert ironic, swift, and heat api tests to use global CONF object
* Matches one flavor and one image by default
* Remove network resources created in scenario tests
* Forbid availability\_zone None in aggregate Nova API
* Removes vim headers 4th round
* Add alias as prefix for flavor\_rxtx v3
* remove unused variable
* Add bool and integer support to XML parser
* Convert network api tests to use global CONF object
* Convert image and identity api tests to use global CONF object
* Convert compute api tests to global CONF object
* test\_rescued\_vm\_add\_remove\_security\_group missing addCleanup
* Return body output after given status reached
* Skip negative tests of v3 server metadata
* Move negative tests for v3 test\_server\_metadata
* Revert "skip test\_volume\_boot\_pattern"
* Removed unnecessary lock from a aggregate test
* Move common \_delete\_volume cleanup method in base compute test class
* Add tempest test for heat resource OS::Nova::KeyPair
* Remove super call in overloaded close()
* Separate negative tests for test\_templates
* tighten up isolated creds create
* Fixed up an error message
* Remove Nova v3 XML tests completely
* Use BaseComputeTest.create\_test\_server
* Run SNAT specific test cases only with ext-gw-mode extension
* Specify 'active' status for deleting situations
* Fix glance\_http HTTPS response issues
* Remove unused method basic\_auth from rest client
* Removes vim headers 3rd round
* Use unittest2.TestSuite with py26
* Cleanup exceptions
* Increase failure details for network\_basic\_ops
* Update 'Member' with option 'operator\_role' in tempest.conf
* add tests for force delete snapshot:
* Add volume cleanup to test\_volume\_transfer test
* Exclude heartbeat timestamp from agent list checks
* Add more descriptive assertion message for test\_create\_backup
* Separate negative tests for Swift
* Do not assume volume metadata is identical to POST request
* Remove baremetal xml support
* Increase ping timeout from 60 to 120 seconds
* Skip test\_list\_servers\_by\_admin\_with\_all\_tenants test
* Create telemetry client
* Change status available to active
* remove the nova v3 xml tests from the code
* remove Nova v3 XML testing
* stop validating user IDs on role assignment operations
* Avoid using assertGreater
* Separate negative tests for test\_quotas
* Call super class after extension check in vpnaas api test
* Remove vim headers 2nd round
* Add test for volume list with all-tenants
* Fix class inheritance for volume\_types tests
* Fix attach\_interfaces tests
* Check if service is available for cli tests
* Add simple node group tmpl API test for Savanna
* Use automated create and update methods for core network resources
* Fix logic for config file env variables
* Make --debug flag on run\_tests and run\_tempest use testtools.run
* Fix parameter in auth error message
* Sync Patch and PatchObject fixtures from oslo-incubator
* Python 2.6 do not has unittest.loader, we import unittest2 instead
* skip test\_volume\_boot\_pattern
* Remove X-Storage-Stoken from object\_storage
* Add tests for testing swift bulk middleware
* Rewrite RemoteClient.get\_boot\_time()
* text-html type is absent in TXT\_ENC
* Remove vim headers
* Avoid expiration before updating metadata
* Fix log\_console\_output call in test\_network\_basicops
* Add a couple log errors to whitelist.yaml
* Move console output log place in test\_cross\_tenant\_connectivity
* Only create necessary resources for compute v3 tests
* Add unit tests for SSH client functionality
* Create only necessary resources for compute v2 and network tests
* Make network resource creation in isolation configurable
* Fix typo in imagev2 class name : Memeber should be Member
* Make BaseV2MemeberImageTest inherits from BaseV2ImageTest
* AttachInterfacesTest: use build\_timeout on iterface deletion
* Fixing typo in test\_volumes\_get.py
* Fix parameter type spelling tempest HOT template
* Remove user creation in object service and healthcheck test
* Fixing typo "existant". Must be "existent"
* Create only necessary networks resources for scenario tests
* Create only necessary resources for image, object\_storage, volume
* Forbid admin\_password None in rescue Nova API
* Add to whitelist two errors that slipped through
* Add more console output log for scenario tests
* Remove test\_network\_quotas\_scenario
* Fix host\_update test case for losing essential parameter
* Create security group rule with additional args
* Fix parameter of nova v3 flavors API
* Add missing whitespace in config description
* Add a check for compute api versions to verify\_tempest\_config
* Add neutron extension support to verify\_tempest\_config
* Rework extension verification in verify\_tempest\_config
* Moves negative tests from test\_server\_metadata
* Fix an error when executing run\_tests.sh
* Use install\_venv from oslo to fix no post\_process issue
* Test server create with ephemeral disk
* Remove copyright from empty files
* Improve testing of list\_extensions for compute
* Update README.rst with details about unit tests
* Add aggregates scenario test
* Tests object\_storage extension listing
* Fix volume metadata validation of identical to request
* Add delete specific status server test
* cinder v2 api tests - fix volume client
* Input scenario capability for tempest
* Add coverage option to run\_tests.sh
* Fix v3 test\_list\_servers\_negative
* Fixes handling of arrays in XML to JSON conversion
* trusts API test, avoid creating duplicate user
* Neutron Agent Management List Agents Non Admin
* Remove Swift container-sync test skipping
* Adds test\_list\_XX\_fields cases to list some fields
* log console\_output when test\_network\_basic\_ops failed
* Add a config option for trusts
* Fix typo in ssh\_floating.json for stress tests
* Add a discoverable\_apis option for swift
* Adds test\_show\_XX\_fields cases to show some fields
* Refactor usage of custom\_match tests
* Fix bug in validating Swift transaction ID
* List Nova and Cinder extensions in debug log
* Delete a BuildError server
* Add list server filter with extra limits
* Add a version API test for Nova v3 API
* API tests for Ironic
* Fix typo in ceilometer and neutron tests
* Remove skip\_because in swift object expiry test
* Moves negative tests from test\_instance\_actions
* port test\_server\_metadata and test\_server\_personality into v3 part2
* add keystone group tests
* Add heat stack action test case
* Add a unit test coverage tox job
* Add base class for Telemetry tests
* Add python-swift client to the requirements
* Add extra list server by status test
* fix a minor bug when detecting server image flavor
* Wait for the server before validate the rotation result
* Add a run\_tempest.sh script
* Make run\_tests.sh for running unit tests
* Add basic read-only tests for heat cli
* Fix reference config before initialization in cli tests
* Skip simple\_tenant\_usage related tests
* Skip flavor\_access\_add/remove related tests
* Add tests for snapshot\_metadata
* remove eventlet from requirements
* always use sitepackages
* keystone trusts API test, move delete into tearDown handler
* port nova v2 images related tests into nova v3 part1
* sync oslo to current
* Catch ssh exception and detach in min scenario
* Remove test\_auth\_token.py
* Increase exception log details
* add tests for security\_group updating
* Kill finally, use addCleanUp
* Add test for HEAD queries on Swift tempurl MW
* Dump all log errors to console
* Moves negative tests from test\_absolute\_limits
* port admin/test\_servers\* into Nova V3 tests part2
* port admin/test\_servers\* into Nova V3 tests part1
* port instance\_usage\_audit\_log tests into nova v3 part2
* port test\_live\_block\_migration into nova v3 part2
* port test\_live\_block\_migration into nova v3 part1
* port test\_quotas into v3 part2
* Add tests for volume\_metadata
* Add config for Telemetry
* port some servers tests into nova v3 part2
* Moves negative tests from test\_server\_addresses
* port test\_aggregates and test\_hosts into nova v3 part2
* port test\_aggregates and test\_hosts into nova v3 part1
* Remove unused wait\_for function
* Use wrapper create\_volume() in volume tests
* Refactor network client: add create\_ and update\_ methods
* Moves negative tests from test\_multiple\_create
* Separate negative tests for test\_image\_metadata
* port servers negative tests into v3 Part2
* port some flavor tests into nova v3 part2
* Separate negative tests for test\_simple\_tenant\_usage
* Make testing neutron agents optional
* Fix the example of testr testing
* Fix OS\_TEST\_PATH in .testr.conf
* allow hypervisors to be down but still pass
* keystone OS-TRUST extension, test with expiry
* keystone OS-TRUST extension, test list operations
* Add negative tests for routers
* Add 2 tests to the Floating IP test case
* Add create\_floating\_ip function
* Use create\_router\_interface and create\_port
* Serialize plurals correctly in neutron xml client
* Add version test for Ceilometer cli
* remove last errant file parse warning
* remove unneeded \_\_init\_\_ file
* rename old config object to TempestConfigPrivate
* Remove FloatingIPChecker from network\_basic\_ops
* Fix AutoScalingTest test suite error
* moving to global lazy loaded config
* cinder v2 api tests - part1
* port test\_keypairs into nova v3 part2
* Refactor cross\_tenant\_connectivity for tenant isolation
* Remove unnecessary spaces from messages
* Add unit tests for rest\_client
* Fix AttributeError on BadRequest in scenario tests
* scenario/network\_basic\_ops: reassociate floating-ip
* Enable HostsAdminTestXML
* Add swift scenario tests
* Increase support for isolated tenants in scenario
* Add testcases for images
* move negative tests out of test\_services in nova v3
* Skip extraroute tests if extension is not enabled
* Add test\_discover module to provide a load\_tests hook
* scenario cross\_tenant\_connectivity
* attach\_interfaces as smoke
* SSH connection related cleanups
* Separate negative tests for test\_fixed\_ips
* Add negative tests for network
* Fix cinder test cases when cinder extensions are in use
* Use rand\_uuid and remove unused client for clean-up
* Fix the help message for run\_ssh
* Fix three accidentally formatted paragraphs
* clean up invalid\_multibyte test
* provide a valid utf8 multibyte test for nova images
* Refactor network client
* port certificates tests into nova v3 part2
* port certificates tests into nova v3 part1
* port instance\_usage\_audit tests into nova v3 part1
* port related volumes tests into nova v3 part2
* port related volumes tests into nova v3 part1
* add some tests for aggregates
* add some negative tests for flavor
* Add volume extensions tests
* Add Savanna client for node group templates
* Add Savanna-related configs for testing
* Adds ping method to remote client
* Separate negative tests for test\_availability\_zone
* Test for the agent management extension API
* scenario/network\_basic\_ops: detach floating-ip
* Make negative snapshot tests faster
* Move common wait\_for\_image\_status from compute images\_client to waiters
* Set pipefail for wrapper scripts
* actually turn on neutron cli tests
* Add whitelist entry for s-proxy 'Timeout talking to memcached'
* don't fail on dirty logs with grenade
* Run test\_service\_type\_management test only if extension is available
* Fix failures when l3\_agent\_scheduler ext is not available
* Add a control point for floating IP assignment
* Add new env variable to specify test path
* Remove duplicate negative test of flavor\_id
* port test\_keypairs into nova v3 part1
* avoid resource leaks in keypairs tests
* remove a spurious wait that could get us into trouble
* Only initialize the glance\_http if service is enabled
* add both v2 and v3 tests for get specified extension
* Wait for backup images to be ACTIVE in test\_create\_backup
* Make the wait\_for\_server\_status timeout message a bit more clear
* Tighten ERROR regexp in log checker
* Don't have tox install pre-release software
* Fix the scope to share a server between tests
* Add testcases for security groups
* Change unstable test which gets console output
* Heat: check response fields
* Make Heat's non\_empty\_stack usable without a server
* Fix Neutron VPNaaS Test
* Remove generic\_setup\_package() function
* Updated from global requirements
* Add tests for keystone OS-TRUST v3 API
* Separate negative tests for list\_floating\_ips
* Fix the upper values of test\_network\_quotas
* Add the external gateway interface to vpn router
* Race condition in ListImageFilters tests
* Separate negative tests in flavors/test\_flavors
* Add config options for enabled extensions
* Handle rest client 500 response if non-json body
* Fix display\_name of volume for test\_volumes\_list
* Test for the update extra route
* Modify the name of a negative test class
* add admin server tests
* Add testcases for volume
* Moves negative tests from api/compute/servers/test\_virtual\_interfaces
* Separate negative tests for test\_services in Tempest
* remove  test\_service\_enable\_disable in nova V3 tests
* port test\_server\_rescue into v3 part2
* Add mock to test-requirements.txt
* Update tempest hacking regarding unit tests
* Remove redundant whitelist for DHCP agent
* VPNaas IKE policies tests
* Check HTTP response headers of Swift middleware API in detail
* Skip autoscaling test until more reliable
* Move import to import block again
* Fix a minor error in method \_get\_alternative\_flavor
* Add tests for testing swift slo middleware
* port test\_simple\_tenant\_usage into nova v3 part2
* port some flavor tests into nova v3 part1
* remove the test: test\_service\_enable\_disable
* Remove unused allow\_tenant\_reuse flag
* update to hacking 0.8
* Adds paramiko logs to console output
* Rip out the coverage extension client from tempest
* port test\_server\_metadata and test\_server\_personality into v3 part1
* port test\_quotas into v3 part1
* Negative tests separate file for floating\_ips\_actions
* port some server tests into nova v3 part1
* Add internal testing for the stress test framework
* port test\_server\_rescue into v3 part1
* add some test for force delete:
* Fix rebuild\_server() function
* Adds "list hosts" test case - Cinder
* Adds improvements to the Swift TempURL test
* Use correct types for thresholds
* Revert "Add test\_cases for cinder cli in v2 version"
* Start failing logs with errors except neutron
* Fix file print logic bug and update whitelist
* port test\_hypervisor into nova v3 part2
* Moves negative tests from api/compute/keypairs/test\_keypairs
* Some tests for dhcp agent scheduler
* Support Neutron security groups in scenario testing
* More stuff in the whitelist
* Dump all error messages for neutron
* Add missing "interface" argument to AltManager
* Use channel\_timeout for SSH connection timeout
* Add two more tests for Swift staticweb middleware
* Add some tests for os\_update\_readonly\_flag
* Add test\_cases for cinder cli in v2 version
* Ensure no dangling resources are left if tests are skipped
* port test\_simple\_tenant\_usage into nova v3 part1
* port attach\_interfaces and server\_address tests into v3 part2
* Add hopefully last batch to the whitelist
* Enable a uuid flavor
* Improve the UX around sample config generation
* Add hard reboot for outputting console log
* Adds delete api test to glance
* Check HTTP response headers of Swift API in detail
* port servers\_negative tests into v3 part1
* Add migrate negative tests
* Enable the Nova V3 API Tests
* Add sample config check to tox pep8 job
* Move admin client initialization into stress-openstack
* Cleanup using about the data\_utils module and functions again
* port test\_availability\_zone into nova v3 part2
* Cleanup using about the data\_utils module and functions
* Make sure ssh retries on paramiko.SSHException
* Add test for Swift formpost middleware
* Add test for update/reset\_snapshot\_status API
* Avoid deleting ports assigned to router interfaces
* Rename object storage features section
* Enhance tests for flavor\_extra\_spec API
* Skip test\_create\_backup
* Disable V3 tests
* Forced isolation for the tests in test\_list\_servers\_negative.py
* port instance\_actions and server\_list tests into nova v3 part2
* port instance\_actions and server\_list tests into nova v3 part1
* Don't use duplicate IP addresses
* add some negative tests for security group:
* Moves negative tests to test\_images\_oneserver\_negative
* add tests for server\_password
* Update openstack/common/lockutils
* port test\_hypervisor into nova v3 part1
* Add test cases for volume-transfer
* Add some tests for security\_group\_rules api
* Remove unused code in user test
* Test for service type management
* add role negative tests
* Make smoke tests parallel
* Add special serial smoke option
* Adds negative tests to glance api's
* port test\_extensions into nova v3 part2
* Reuse a server instance in test\_disk\_config
* Remove unused code in tempest files
* Enable all nova v3 tests
* Adds tests to cover Swift's crossdomain middleware
* Fixing ImageKilledException raising
* Add negative resize server action test
* Added images support and existing config support
* add tests for InstanceUsageAuditLog
* port attach\_interfaces and server\_address tests into v3 part1
* Add shelve/unshelve test of nova APIs
* add negative volumes tests
* Remove unused code in api/compute/admin/test\_quotas.py
* Remove skips for bug 1182384
* removes a duplicate volume type test
* add tests for certificates
* Test image member is enforced
* Added some tests for reserve and unreserve volume
* Skip all nova v3 tests temporarily
* Remove unused run\_ssh variable
* Add additional documentation for stress tests
* port test\_availability\_zone into nova v3 part1
* port test\_services into nova v3 part2
* port test\_services into nova v3 part1
* port test\_extensions into v3 part1
* Rename to create\_test\_server in API tests
* removing dead docs
* remove old README files that are now redundant
* move nova v3 delete image tests into glance testing
* Adapt scenario readme with real-life aspect
* port test\_images and test\_server\_actions into v3 part2
* Configure scenario clients with region
* port test\_images and test\_server\_actions into v3 part1
* remove redundant code in fixed\_ips\_client for xml
* glance v2 image sharing tests
* Test for l3 agent scheduler API
* Add design principles to docs
* Change all non-slow scenario tests to smoke
* add positive tests for volume
* Switch base unit test class to oslo mox fixture
* Fix NameError exception
* Make test\_show\_host\_detail work with multi host installation
* Add tempest unit test to verify the test list
* remove skip bug 1233026
* Add missing CLI Neutron tests
* add test for create\_backup
* add debugging for when changes-sinces fails
* add tests for show and update of Flavor Extra Spec API extension
* Add test case to api/compute/test\_quotas
* Adds api test to test\_images
* Sync config file generator from oslo
* Fix default values so they work in a devstack run
* Fix incorrect config option types
* Add api version detection to verify\_tempest\_config
* Add config feature verification script
* Stop auto-detecting glance API versions
* Reorganize project feature config options
* Adds test to cover Swift healthcheck middleware
* Stop testing deprecated command nova-manage instance\_type
* Test for flavor-access-list with private/public flavor
* edit inheritence tree api/network/security\_groups
* Move decision\_maker() call into setUpClass
* Add base test class for unit tests
* Update mailmap for Joe Gordon
* Fix bad classname
* add some negative tests for force\_delete/restore
* Replace assertLessEqual - is not in py26 testtools
* assertTrue to assertIn
* Raise specific exceptions on tearDownClass failure
* Preserve the configured log level
* Add some test\_cases for glance\_cli
* Fix bad classname
* Sync latest module versions from oslo-incubator
* Sync fixtures from oslo and use LockFixture
* Updated from global requirements
* Update to latest pbr
* Set max\_template\_size to heat's default value
* Added some test for image tags
* Early die if on image gets killed
* Revert "Use isolation credentials for neutron api tests"
* Add more stuff to the whitelist
* RunTimeError on tearDownClass explained
* add extend volume tests:
* add tests for set\_metadata in aggregate
* fix DeletableSubnet in api/network/common
* Refactor duplicate isolated creds code
* api/network/security\_groups\_negative add testcases
* Adds initial ceilometerclient testing code
* add negative test cases for create snapshots:
* Fix issue with ImagesOneServerJSON test
* Use isolation credentials for neutron api tests
* Simplify xml/json client selection
* Add filenames to skip\_tracker.py output
* API tests for neutron router gateway
* Use lower case true/false in the sample config file
* use "" instead of "None" in xml file
* Inject "-tempest-" string to rand\_name
* Forced isolation for the nova quota test
* add BaseV2ComputeTest as the base class of nova v2 api tests
* Changed the exception name
* server status remained in unexpected state
* Set tempest version for icehouse
* Add a skip for meter-label cli tests
* VPNaas vpnservice test cases
* Separate negative tests  api/network/security\_groups
* Skip negative compute quota tests that don't work with Neutron
* uses skip\_because where appropriate instead of regular skip
* Fixing ImagesOneServerTestXml issue
* add test for updating server's disk\_config test
* Skip get\_server\_diagnostics test until bug 1240043 is fixed
* add some tests for host and seperate negative ones
* Fix to use proper random values
* add some tests for hypervisor operation
* add volume tests
* Reduce vm creations in negative tests
* Change six to match global requirements
* remove tearDownClass in test\_quotas.py
* add more test cases to api/network/security\_groups
* Add a flavor test for getting a specified key value API
* Restores passing additional parameters to nosetest
* Move negative action tests to right place
* Script to filter logs for ERRORs based on whitelist
* Rename cli tests from compute to nova
* Add section for negative tests to HACKING.rst
* Add some test-cases for cinder cli
* add token test for token-api
* add some negative tests for tenant
* Test for server create with IPv6 address only
* Accept gzip files in find\_stack\_traces.py
* Add a create\_router utility function
* Update lockutils from oslo-incubator
* Add security group to large\_ops test
* Use built in cleanup for servers in test\_large\_ops
* Split out unit tests as separate tox jobs
* Update to latest tox
* glance image v1 member test cleaup
* delete the duplicated variable definition
* Increase heat's default max\_template\_size
* add some tests for user api
* Add CLI tests for Neutron's metering agent
* Add some test\_cases for compute-cli
* skip test\_lock\_unlock\_server
* add some negative tests for volume updating:
* remove code duplication in tempest/config.py
* add volume list tests
* Add addtional logging and catch exceptions
* Placeholder log check script to be called by devstack-gate
* Cleanup existing instances in setup for test\_list\_servers\_negative.py
* Fix skip\_because decorator
* Test for the nova diagnostics API
* Use predictable instance/volume names in test\_volumes\_actions
* Cleanup test\_list\_server\_filters setup/teardown
* add two negative tests for flavor-access
* Remove unused CONF variable and import statement
* add a negative test for flavor\_extra\_specs
* introduces skip\_because decorator
* pass stop\_on\_error to \_has\_error\_in\_logs
* Clean up existing instances when not using tenant isolation
* Orchestration autoscaling improve status polling
* Allow \_status\_timeout to be used for non-nova polling
* TEMPEST\_PY26\_NOSE\_COMPAT in py26 jobs
* Handle test\_list\_servers\_by\_changes\_since without tenant isolation
* Add xml support to the floating ip and router
* add server delete/unpause tests
* add server suspend/resume negative tests
* Revert "unskipping bug related to test\_stamp\_pattern.py"
* Update style guide link in HACKING.rst
* meta should be metadata in rebuild server
* Unskip test\_tokens and update expected status to 404 from 401
* Do not check for id in the keystone output
* Initial basic setup of openstack and tempest config file
* Make smoketests working again with Python 2.6/nose
* Add test for admin deleting servers of others
* add server reset\_state tests
* Heat: use first\_address instead of first\_private\_address
* Explicity specify network for heat slow tests
* \_error\_in\_logs function of driver.py shall check all nodes
* Bump oslo.config version
* \_get\_tenant\_by\_name doesn't return correctly
* tempest/config.py parse some sections incorrectly
* \_create\_creds function shouldn't call rand\_name twice
* Add tempest tests for os-aggregate update
* Adds more test to cover Swift tempURL middleware
* Added Negative tests for image member
* driver.py should log errors when ssh operations fail
* fix typo in config.py
* add \_\_str\_\_ function to RestClient class
* Fix problem with never stopping stress tests
* Print the lekaed 'boto' tags on Failure
* The debug configuration group is not registered
* Update docs config
* Add positive tests for os-floating-ip-pools
* Handling network resources in tenant isolation
* Don't log 'Not Found' ERROR during image cleanup
* makes passing the client optional to utilities in scenario/manager.py
* Add test for nova API of VM lock/unlock
* Fix json version of bootable check
* Add locking to test\_list\_hosts\_with\_zone
* Move LockFixture to tempest.common
* Fix typos in tempest/HACKING.rst Edit
* README.rst of tempest stress is misleading
* add server resizing tests
* add negative volume tests
* Added test to check list/show extensions-neutron
* Adds test\_update\_all\_metadata\_field\_not\_included negative test
* Replace OpenStack LLC with OpenStack Foundation
* Test that Heat max\_template\_size is applied
* Sync install\_venv\_common.py from oslo-incubator
* Consider lc string for bootable True/False
* unskipping bug related to test\_stamp\_pattern.py
* Raise OS\_TEST\_TIMEOUT for heat slow test
* Add tempest tests for os-host/{host-name} api
* Test cases for V3 Project Actions
* Skip test tokens
* Remove claim that scenario tests need 2 services
* Adding health monitoring test case
* Adding LB member operation test cases
* LBaaS client functions and pool testcases
* Add update-volume test
* Use built-in print() instead of print statement
* Add 'Field' to the title of the Field Guides
* Update README.rst to use testr instead of nose
* fix pep8 errors: E231, E128
* Adds tests covering Swift's container quotas middleware
* Add a function for creating a server on a given network
* Move \_check\_tenant\_network\_connectivity to the end
* Add update-snapshot test
* Add keystone user-update test
* Fix misused assertTrue in unit tests
* Fix a test case of 35chars+
* assertEquals is deprecated, use assertEqual
* Add "region" config for each service
* Add parallel test execution section to HACKING.rst
* Sync latest versions of oslo incubator
* Fix overlapping subnet creation
* test\_fixed\_ips unsafe xml/json resource sharing
* Enable the quota test cases
* Adding xml support for load balancer
* Network load balancer testing
* Fixes some typos in tempest
* add required python modules(six,iso8601,fixtures) to requirements.txt
* Fixes typos in tempest/api
* Add missing import of 'subunit' in test-requirements.txt
* Remove wait\_for\_image\_resp\_code
* Use common create\_server method for advanced\_ops
* VolumesListTest may hide configuration issues
* Add tearDownClass to base swift test class
* Adding negative test for port
* Bulk Subnets and Ports creation
* Make the admin role configurable within tempest
* Remove Whitebox tests
* Remove bin/tempest script
* Add service tag section to HACKING.rst
* Add hacking check for service tags in scenario
* Add services tags to scenario tests
* added an api test for security\_groups
* Adds disk\_format parameter to upload\_volume method in volumes client
* task\_state must be consider before many action
* Dump basic network info  in the test\_network\_basic\_ops
* Adds verfication for Bootable Volume
* Translate server extension attributes to json
* Add service tags to api.volume
* Add @services decorator
* Remove order dependence from network\_basic\_ops
* Fix import grouping in scenario tests
* Fix tempest config usage in test\_attach\_volume
* Fix race condition for test\_flavors\_extra\_specs
* Eliminate the impact of "wait\_until='BUILD'"
* fix race condition between addCleanup and lockutils
* Credentials Keystone V3 API Tests
* Add a create\_server test for flavor authorization
* Add device name, ssh password to Tempest config
* Fix colon in create volume logging output
* Append some operations to boot from volume pattern
* Added test case to check floating IP API operations
* Switch heat template to use native nova resource
* Add tests for Swift's StaticWeb middelware
* fix test\_flavors\_extra\_specs failure
* Restrict Volume type deletion with volumes assoc
* add flavor creation tests
* Added missing xml tests of volume
* raise assertion error if output is falsy
* Add handling for inherited stress attributes
* Remove unused LOG variable in scenario tests
* Add more detailed message about the volumes missing
* Increase default test timeout for timeout fixture
* Log request ids from glance and nova
* moves addCleanup few lines upper to avoid potential leftovers
* Fix logging problem for stress test wrappers
* KeyError when tearDownClass called from setUpClass
* Add common "create\_server\_snapshot" method
* Fix test\_admin\_catalog\_list
* Always log stdout and stderr of CLI commands
* Create discovery option for stress tests
* emit warning while running flake8 without virtual env
* Switch run\_tests.sh to run in parallel by default
* Add unittest framework + tests for wrapper scripts
* Move the network api tests to smoke
* Add logging to the python-clients
* removes self.fail as suggested by HACKING.rst
* Rename heat logical\_resource\_id to resource\_name
* Add large-ops option to tox
* Updating HACKING.rst
* Stress ssh\_floating test
* Adds tests for Heat
* Update requirements from global requirements
* uniforms skip messages
* Use common create\_keypair method for autoscaling
* Skip orchestration scenario tests if heat service not available
* Switch gating tox jobs to testr parallel
* Provide tox entry for running slow heat tests
* close http connections
* Fixed up a missing space in an error message
* refactor - \_is\_timed\_out using instance timeout
* Fix ssh timeout issue
* Heat autoscaling scenario test
* cli: add messages to assertTrue
* Cleanup: Add common "ssh-login server" method
* Cleanup: Add common "create volume" method
* use assertIsNotNone instead of assertNotEqual(\*, None)
* Skip os-fixed-ips test since neutron has not implemented it
* Cleanup: Add common "create security rule" method
* Add tenant isolation to the swift tests
* Adding network api xml support
* Set missing attribute self.server in \_create\_and\_attach utility
* Mismatch dictionary key in the process of parsing XML
* Remove skip of neutron connectivity check
* Fix skip tracker regex for multi-line skips
* Add more tests for Swift Account Quota
* Fixing format\_flavor to handle flavor extra\_specs
* Cleanup: Add common "create keypair" method
* Fixing the rest of the comment spacing issues
* per test\_method logging
* Remove identity race condition
* Protected matcher import
* Cleanup: Add common "create\_server" method
* Fixed test for non-public flavor
* Add nose to run\_tests and tox for python 2.6
* skip test\_list\_servers\_filtered\_by\_ip\_regex on neutron gate
* Fix typos in tempest/api/README.rst
* Unit tests as stress tests
* Cleanup try/except/finally blocks in several tests
* setUpClass/tearDownClass full chain
* Testcase to create bulk networks in one API call
* Added 3 Routers related testcases for Neutron API
* Adding extra\_specs to flavor format
* Add tenant isolation for scenario tests
* Switch use of select() to poll()
* Remove positive tag
* Fix return code for pretty\_tox\_serial.sh
* Fix posargs usage for tox jobs
* Add tests for swift container listing filters
* Switch to testr serial instead of nose
* Rework class inheritance for scenario tests
* Change logging in stress test
* Added negative tests for server
* scenario test involving glance, cinder and nova functionalities
* Flag InstanceCfnInitTestJSON as the first slow heat test
* Add test for swift ACLs
* Adds tests covering Swift's Account Quota middleware
* Remove duplicate image tests for tenant authZ
* Skip more security group tests until bug 1182384 is fixed
* Skip secgroup invalid name/desc tests until bug 1161411 is fixed
* Make CLI timeout tests configurable
* Added a test for stop and start a server
* Add locks for all aggregates tests with hosts
* Test cases for Roles V3 Actions
* Add network api test cases
* Whitebox server expects deleted > 0
* Negative tests added for network
* Negative attribute added in server negative test
* Skip secgroup rules invalid id tests until bug 1182384 is fixed
* Make testr full runs skip tests with 'slow' tag
* renames the stress test class to include the Volume keyword
* Generate temepst API doc from source
* White space after # in tempest/api files
* White space after # in the tempest/services
* White space after # in thirdparty
* Disable logging to the stderr
* add image tests v2
* Add argument to stop stress test on first error
* Add testing of Neutron per tenant quotas API
* Switching to oslo importutils in the stress tests
* Make test\_neutron\_dhcp\_agent\_list\_hosting\_net use net name from conf
* Sync up the default value for the network\_for\_ssh option
* Sorting services list before asserting in test\_get\_service\_list test
* Negative test added for rescuing a paused vm
* Add tox job for serial testr
* Add eventlet to requirements.txt
* Fix fail logic for server of another tenant test
* Add locking to test\_aggregates
* Switch to using Oslo logging
* Fix neutron cli tests skip for testr
* Use state transition checker wait function in the ec2 image tests
* Add wait\_for\_volume\_status in upload\_to\_image test
* Handle a possible volume attachment visibility wait/race issue
* Use assertIn and assertNotIn instead of assertTrue/assertFalse
* Add stress test to attach volumes to vm's
* Negative attribute added in volume negative test
* Revert "Add jsonschema to requirements.txt"
* Allow to run swift and keystone api tests standalone
* skip stamp test until race in nova can be debugged
* Sync lockutils and log from oslo
* Add environmental variables to test.conf
* fix race condition in service list compares
* Add posargs to testr-full tox job
* Add Neutron CLI tests to tempest
* Unskip test\_register\_get\_deregister\_ari\_image
* Add jsonschema to requirements.txt
* Simplify whitebox/manager
* Added a server-pause test
* Negative test for rescuing a non-existent server
* Increase ping timeout on scenario testing
* Basic starter scenario for testing the dashboard
* Fixing man page generation
* Use nose skip exception conditionally
* add service tests
* Add tenant isolation for glance api tests
* Move isolated credential code to BaseTestCase
* Add isolated tenants for admin compute tests
* Add exit codes if run\_stress.py detects an error
* Move heat\_available option to service\_available
* Add nova config option to service\_available group
* Add swift config option to service\_available group
* Add glance to service\_available config group
* Move neutron\_available option to service\_available
* Ignore the default quota values
* Updating HACKING with some test writing recommendations
* update hacking to 0.6
* Add global statistic for stress tests
* Add scenario test of instance/volume snapshot
* add image tests
* Add cinder\_available config option
* Adds tests for tags in boto (EC2 API)
* add missing apache2 license headers
* fix use of locals() in strings
* Skip test that is not relevant to Neutron
* Add boto tests for idempotent RunInstances calls
* Remove unneeded class filter from .testr.conf
* Document E125 as a won't fix
* Add unittest like output for testr-full in tox
* Use subunit colorizer from nova for run\_tests.sh
* run\_stress.py -h doesn't work without a connection
* Remove duplicate flaky test
* Remove skip code for test\_servers\_whitebox as bug had been fixed
* Fix stress-tox-job.json action file
* Switch to using testr as the test runner for everything non-gating
* Rework stress to be more UnitTest like
* Add an option to run\_stress.py to run tests serially
* Fix tox job for stress tests
* Change path for "Run one test" example in README.rst
* Make tenant\_network\_mask\_bits default setting consistent
* Remove version caps from python-fooclient
* Cleanup and make HACKING.rst DRYer
* Test Tokens - V3
* Fix SSH host to floating IP from fixed IP
* Configure a heat security group for testing ssh
* Add large\_ops scenario test
* improve minDisk checking
* Add new test for the volume upload in Glance functionality
* Add cinder CLI tests to tempest
* Fixed test - segmented upload of file
* Domain Actions Test Case-V3
* update Quantum to Neutron
* Using relative path for personality file in rebuild server test
* Sync install\_venv\_common from oslo
* Add tests for server actions
* Add exception handling doc
* Postgresql is an Optional dependency
* Use the same logger class in all test cases
* add tests - list hosts tests using admin user
* Proposing a change to remove user validation tests
* Fixes a test case name
* Add a tox job to run stress tests
* Orchestration tests to use admin user, demo tenant
* Use build\_timeout & build\_interval from heat config
* Create stack in class setup, rather than instance
* Implement update\_stack client method
* Always include credentials for heat stack create
* Use print\_function
* Fix index link in footer bar
* add tests - list servers using admin user
* Clear keypairs on teardown
* Heat test ssh to the server
* Skip fixed\_ip\_details test with Quantum
* Skip list\_vifs test with Quantum
* Revert "Update a test to work with Quantum SecGroup"
* Use os.path.join to form the cli command
* Skip test that is not relevant to Quantum
* CLI doc missing colon for code block
* Configurable volume storage\_protocol + vendor\_name
* Add scenario test of instance snapshot and boot
* Remove dependency on MySQL-python
* Use Python 3.x compatible syntax constructs
* Oslo Merge
* Remove automated skip decsion from compute
* Avoid potential race condition in list\_stacks assert
* Fix create\_security\_group\_rule to work with python 2.6
* Fix test\_volumes\_get volumes cleanup
* Add a volume create/delete stress test
* Ensures testtools 0.9.32
* Actually raise BadRequest if create\_subnet fails
* Fix XML security group rule client
* Loosen constraints on Swift status codes
* Add posargs to tox coverage job
* skip test\_ec2\_instance\_run.InstanceRunTest.test\_integration\_1
* Object client adds content-length if PUT is empty
* Fix a doc indentation bug
* add create\_image\_from\_server to base class for auto cleanup
* Implement a new test case for volume cloning functionality
* Remove TODO note
* actually enable our no tempest/tests check
* Raise BadRequest if unable to create subnet
* Remove basic\_auth strategy
* Add negative tests label
* Increase to 255 the length of the user name
* Remove quota whitebox tests
* Tempest Coding Guide
* Quantum client should not be conditional
* Fix: WhiteBox server leak
* Tests for os-hypervisors API extension of Nova
* Fixed Typos
* Add logic to tox.ini to run all tempest tests
* Enhance the validation of the quotas update
* Fixes list\_snapshots and \_with\_details methods in snap XML client
* ensure no code merges to tempest/tests
* Fixed last merge file from "tests" folder to new "api" folder
* TestServerAdvancedOps server leaking
* Multi-server handling in base.py
* Fix a race condition in test\_create\_delete\_image()
* Remove duplicate appends to image list
* Add keystone client optional arg tests
* List servers by changes since with dynamic date
* Default to m1.micro for heat test flavor
* Add python-cinderclient to requirements.txt
* Removed invalid skipped tests
* Fixes the multi-backend skip bug and the cleanup steps
* Remove executable bit on some files
* Makes run\_tests.sh exit code match the nosetests exit value
* Unskipped object storage test
* Added test - conditional object download
* identity v3 token
* List Domains Test Case-V3
* Rename requires files to standard names
* Remove skip mark to test\_create\_image\_when\_server\_is\_rebooting
* Removes 'positive' tag from tests
* Adding test\_server\_sequence\_suspend\_resume
* Implement minimum basic scenario
* Add ssh check to quantum smoke test
* Heat test to launch a heat-cfntools based instance
* Merged 2 tests dependent on each other
* Fixes bugs in test\_s3\_ec2\_images
* Test cases for Policy V3 API-New
* Add Flake8 extension for python client import checks
* update docs for consistency
* Moved swift container cleanup to a class method
* Configure logging format flexibly
* Update skip\_tracker test directory
* Update README file
* Modify hacking flake8 extension
* Limit tests should pass correct image and flavor
* Update a test to work with Quantum SecGroup
* Set smoke/gate attributes for tests in "compute"
* initial seed for tempest doc directory
* Add some basic snapshots listing test
* Initial heat orchestration tests
* Add tests list tenant usage
* Remove unnecessary tags/attributes from our tests
* rename tests -> api
* Smoke attribute implies gate attribute
* Moved part of test cases to another class
* break out whitebox tests
* move boto tests to thirdparty directory - part 1
* add scenario directory
* Create Flake8 extension for tempest checks
* Code cleanup of object storage tests
* Removing redundant, possibly flaky test
* Add a sleep with back-off to retries
* Add tests list the services to compute
* Set smoke/gate attributes for tests in "image"
* Set smoke/gate attributes for tests in "identity"
* Set smoke/gate attributes for tests in "volume"
* A Heat client which does basic stack operations
* make test non executable, otherwise nose skips it
* Permits a list of values for the "type=" tests attribute
* Adding new test for iSCSI live block migration
* Clean up tenants created in test\_users.py
* Adding negative test to check limits of Security Groups and rules
* collapse tox.ini test commands for readability
* move cli directory into new tree structure
* make status\_timeout a method
* Enhance the validation of the quotas update
* only install things in the venv for pep8
* proposal for tempest directory restructure
* Do super()'s tearDowns last (bug 1178337)
* Put the logic from devstack gate into tox
* Remove old stress tests
* Simplified stress tests
* Enabling assertions disabled for bug #1074901
* Declare the config attribute in a simpler way
* Configurable fixed network name
* Add Aggregate XML client and tests
* Make sure isolated tenants are not left behind
* Add setup failure logging in tearDown method
* change test\_register\_http\_image to use explicit url
* Ignore .testrepository/
* Adds Cinder Multi-Backend Test
* Update service test case - V3
* Add a test for creation of volumes' snapshots
* Remove reference to dead script configure\_tempest.sh
* Migrate to pbr from openstack.common.setup
* Finish up flake8 conversion
* Fixes volumes cleanup in base class
* Removed duplicate usage of TempestConfig()
* Fix status\_timeout incorrectly referencing self
* Added 2 user related testcases for Keystone V3API
* Fix to enable negative test image\_invalid\_metadata
* Missing image-del func in test\_create\_delete\_image
* Clean up servers created in test\_multiple\_create.py
* Add tests list actions on a specified instance
* Remove skips in test server rescue
* Added tests to list instances by regexp
* Adding test\_max\_image\_meta\_exceed\_limit
* Add tests list the availability zone
* Make CLI tests python2.6 compatible
* Exclude etc/logging.conf from versioning
* fix E122 and E126 flake8 issues
* attempt to get to flake8/hacking plugins
* Add fixed ip client and tests
* Fix to create an image with given  min\_ram value
* Add logging configuration
* Add aggregate json client and tests
* Configure quantum basic ops tests as smoke
* Fix to use an API to get the default quota set
* raise the first exception in flavors and security\_group test
* Fix HACKING compliance of test\_network\_basic\_ops
* Remove smoke.py and clean up base test classes
* make stack traces tool find individual traces
* Re-enable detach volume from unrescued VM
* Fix docs for admin user config in conf sample
* Create tests for multiple server creation
* Fix AttachInterfacesTest error
* Adds create volume from image test
* xenapi:live-block-migration - fix XML client test
* Add tests for adding/removing flavor access
* Test cases for Endpoints V3 API
* RestClient:keystone\_auth hides requests and errors
* Removes redundant tearDownClass methods
* Fix IBM copyright strings
* Set version to 2013.2
* Remove skips in quota tests
* Fix typo for run\_tests.sh -S option
* Replace try/except/else with self.assertRaises
* Add basic quota tests
* Update test\_networks.py to v2 of Quantum API
* refine \_get\_isolated\_creds
* delete servers in setUpClass if ecxeption raised
* Reduce chance of name collision for resources
* cleanup resource in setUpClass if ecxeption raised
* Add missing exceptions import
* Remove unused variables
* Add glance register image from http service test case
* Use the same style checking everywhere
* Xml Support for Image Test scripts
* Addition of XML support to test\_list\_servers\_negative
* In CLI tests set merge\_stderr to False by default
* Fix SimpleReadOnlyNovaManageTest.test\_flavor\_list CLI test
* Move tempest runtime dependencies to the pip-requires
* Remove unused imports
* Create and delete flavor as regular user
* Make volume attach and detach rescue tests negative
* Add basic read only glance cli tests
* Add properties to CreateRegisterImagesTest case
* enable xml tests test\_disk\_config
* Update hacking.py for @testtools.skip() formatting
* Normalize skip bug format
* Refactor of test\_network\_basic\_ops -prep new tests
* correct the reduplicate tests for list\_severs\_with\_detail({'limit':1})
* Remove skips in volume types tests
* Adds XML support to test\_live\_block\_migration.py
* Remove skips from bugs marked as fixed
* add test for creating a floating IP specifying an non-existent pool
* Updating the try/except blocks to assertRaises
* Add bug number for skips in CLI tests
* Add basic Keystone CLI tests
* Add service cleanup handler for test\_list\_services
* clean up trys in test\_servers
* Replace try/except/else with self.assertRaises
* Extend compute-manage cli tests
* Make skip\_tracker bug keyword detection more robust
* Expand CLI test
* Tweak quotas in tempest to include new fixed ip quota
* Change server create to use tracked create\_server
* Convert try/expect/else as per new Tempest style
* fix the confused issue in server\_client about list\_server
* Fix exception name in test\_server\_actions
* Fix skip formats to trigger skip\_tracker
* Remove unnecessary asserts from test\_images.py
* Add api version detection support to glance tests
* xml\_to\_json should not convert xmlns into attribute
* Add base classes for image tests
* Convert try/expect/else as per new Tempest style
* Add a test to list the security group rules
* Disable test\_rescued\_vm\_attach\_volume
* Replace try/except/else with self.assertRaises
* add find\_stack\_traces tool
* Remove skip decorator from keypairs tests
* Switch to final 1.1.0 oslo.config release
* Add duplicate bug detection to skip\_tracker.py
* fix sever not deleted issue in test\_attach\_detach\_volume
* Replace try/except/else with self.assertRaises
* Fix rate limit handling and logging
* Tests to verify Nova VM Rescue operations
* Fix test\_flavor\_extra\_specs
* Remove skips for fixed bugs
* Add image members tests
* Use oslo.config-1.1.0b1
* Have paramico to register the event pipe in time
* Remove skip from test\_invalid\_host\_for\_migration()
* Add glance api v2 testing
* RestClient remove wait parameter from the get method
* Small fixes around variable usage
* Enable XML testing for test\_server\_addresses
* Correct getchildren() usage in list\_addresses()
* Adding test\_security\_group\_rules\_create\_with\_invalid\_port\_range
* Adding test\_delete\_the\_default\_security\_group negative test
* Move glance image client and tests into v1 dirs
* skip ec2 test until it can be debugged
* Add tests for nova's os-attach-interfaces extension
* Add quantum\_available config option
* Update live migration test to use new syntax for create\_server
* enable test\_servers\_negative
* Fix endpoint usage for glance\_http in image client
* Sync latest setup.py from oslo
* Add negative test in test\_quotas.py
* Update defaults for s3 materials paths/names
* Catching new exception while disassociating a disassociated floating ip
* More assertions for test\_integration\_1
* Add basic image filtering tests
* add the version requirement for testtools
* Standardises expected exception layout
* convert to resource tracked create\_server
* create\_server cleanup
* test\_server\_metadata.py - BP add-xml-support
* add database drivers for whitebox testing
* Sync latest install\_venv\_common.py
* Update stress tests to properly use tempest.config
* Prepare base test class for CLI tests
* Implements test\_update\_all\_metadata\_field\_error
* Catching new exception while disassociating a disassociated floating ip
* Add tests for server metadata
* Move the console tests to the other server actions tests
* Simplify xml-json inheritance in identity
* test\_live\_block\_migration cleanup
* Implement assertRaises assertions on all tests
* Small server action code compression
* Handle XML body of server's virtual interfaces correctly
* tempest.tests.boto merge to tempest.testboto
* Cleanup of identity/admin/test\_users.py
* Handle error in test\_create\_get\_delete\_service
* Expand read only cli compute test
* Add negative test for get server in test\_servers\_negative.py
* Add negative test for  set server metadata
* Clean up logging from glance\_http.py
* Have all test case to use a single base class
* Simplify xml-json inheritance in compute
* update identity to handle new table attributes
* Fix update option for run\_tests.sh
* Compare ipv6 only with canonized form
* Adding list\_virtual\_interfaces method to the servers\_client
* Stress improts
* T4xx fixes
* Add object based wait capability to boto tests
* Fix compute tests init
* Add an update option to run\_tests.sh
* Modify roles tests to deal with a default role
* Imports in alphabetic order
* Remove skipped test for bug 1061738
* By default the features are not skipped
* Configurable Tempest config file location
* First commit for python client test suite
* Fix init of test\_volume\_type\_extra\_specs\_list
* Sync in latest version of oslo
* Remove duplicate calls to clear\_servers
* Simplify volume test classes inheritance
* Add missing import to the image\_client
* Remove unnecessary client alias in console tests
* Correction in quota\_client's condition logic
* Fix 'if' in the clear\_isolated\_creds
* json name usage
* Update HACKING file
* Fixes test\_resize\_server\_(confirm|revert) methods
* Add an images client
* Break out RestClient error checking
* Fixes around variable usage
* Remove unused imports
* Add negative test for create server
* Change quota tests to use assertEqual
* Remove duplicated wait
* Convert to use tempest attr implementation 2/2
* Convert to use tempest attr implementation 1/2
* Fix MismatchError error when checking flavor value
* Implements test\_(create|update)\_metadata\_key\_error
* Implements test\_flavors.test\_invalid\_min(Ram|Disk)\_filter
* Enable test\_absolute\_limits.test\_absLimits\_get
* Add generic nose/testtools attr decorator
* Add support for testrepository
* Implements test\_flavors.test\_invalid\_is\_public\_string
* Change test\_get\_default\_quotas to use assertEqual
* Sync latest install\_venv\_common from oslo
* Implements test\_flavors.test\_is\_public\_string\_variations
* Removes use of nose.tools.raises
* Small Bug fixes
* Verbose logging on error
* Remove variable assignment that appears twice
* Add a volume from snapshot test case
* Make isolated volume tests have unique tenant
* clean the unittest2
* Fixes "not in" usage
* Fixes duplicate "-s" option in run\_tests.sh
* Use real capabilites for all volume type instead of fake ones
* Move out http response checking from the request
* Adds unitest2 and keyring to pip-requires
* Fix boto initialization
* Fix volume XML tests
* Proposed EC2 OpenStack extension
* Remove use of detailed-errors nose plugin
* Removes assertGreaterEqual for Python 2.6 backward compat
* Enable boto keyapir test
* Testcase for keystone - List services
* bug 1110343 Fix missing config.network.username
* Derivate most of the RestClient's exception from the failureException
* Update TEMPEST\_README.txt
* Move the singleton to a common location
* Addition of XML support to test\_quotas.py
* Use install\_venv\_common.py from oslo
* Fix Py2.6 dict comprehension SyntaxError
* Handling rate-limit for JSON request- rest\_client
* Use testtools as the base testcase class
* Add whitebox section
* Add NotImplementedError to the abstract method
* Remove not used configuration variables
* Fixes whitebox testing for deleted type change
* Credentials Configuration changes
* update whitebox testing for deleted type change
* Remove few unnecessary backslashes in ObjectTest
* Ensure package-wide test init is done with testr
* Flavor min memory tests
* Test to check container synchronization
* Fixes test name typo
* TestCase to check set/get/unset flavor extraspecs
* Add back missing return in ObjectClient
* bug 1101184 add new test: verify new n/w visible
* Fix flavors tests so they can be run in parallel
* Test to upload object in segments and download it
* Fix PEP8 compliance problems
* Refactor identity
* change ipv6 format to pass on postgresql
* Revert "Split up XML and JSON testing."
* Split up XML and JSON testing
* Test to check temp url support
* Fix install\_venv-get\_distro failure on Fedora
* Only create 1 server for server actions tests
* Allows identity endpoint to be specified as URI
* Add skips for tests when dependency not present
* Adds setting to disable SSL cert validation
* Removes paramiko dependency from test-requires
* Object write/read ACL and few security testcases
* Fix test\_authentication\_with\_invalid\_tenant
* Fix test\_authentication\_when\_tenant\_is\_disabled
* Add CentOS-specific OpenSSL package installation
* Remove skips that are no longer necessary
* boto: instance teardown wait until instance is gone
* Don't ignore exceptions
* ensure setup\_test\_user has been called before using test\_user
* Convert these tests of ServerBasicOps into one test
* make skip\_tracker directly executable
* Refactor compute image tests
* Use '-m' for tempest\_coverage.py in tox.ini
* Remove skip from Server Filters Tests
* Fix list images xml deserialization
* Add missing methods to xml admin\_client
* ensure we wait for server deletes
* Disable test\_run\_terminate\_instance
* Use real capabilites for volume type instead of fake ones
* Add wait for resource deletion on volume teardown
* Update gitignore because of oslo setup.py
* Modified Server Actions Create Image test
* Fix tenant leaking in test\_tenants.py
* Adds 3 additional tests to test\_flavor.py script
* Add tools/tempest\_coverage.py script
* Fix parsing of addresses. lp#1074039
* Fix T401 and T402 errors
* tempest error codes should start with T
* Fix boto lib config
* ensure isolated test cases run with an isolated tenant
* add hacking.py rule to prevent docstrings
* fix file injection test to not assume /etc is present
* convert docstrings to comments
* convert docstrings to comments
* convert docstrings to comments
* convert docstrings to comments
* Fixes PEP8 error E121
* Fix venv for ./run\_tests.sh -p
* Use oslo cfg module for tempest config.py
* Initial Oslo sync for Tempest
* Add python-quantumclient to pip-requires
* add run\_tests.sh option to not capture stdout
* Addition of XML support to test\_console\_output.py
* Logic in rest\_client incorrect "resp.status=413"
* Tests to check few object actions anonymously
* Remove unused imports
* Add error handling to smoke test cleanup
* Do not limit the max versions in the requirements
* Negative Cinder tests for Volume Types,extra specs
* Fix sample conf for compatability with devstack
* Specify region by name
* Fix use of venv in Tempest
* Test Case to check "swift object expiry"
* RestClient: Don't hard code volume service name
* Add smoke tests for quantum
* Add admin credential config for network client
* Fix smoke tests to delete resources synchronously
* Test to GET public-readable container's object
* ensure servers are deleted between tests
* add create\_server\_with\_extras
* Check images by ids, not by count. lp#1088515
* Add num\_retries configuration option
* Tempest should ignore SSL certificate validation
* Adds paramiko to pip-requires
* Ensure we check for the right body
* Add ability to skip disk\_config tests regardless of extension status
* Improve pep8 checks to be similar to those in nova
* Fix pep8 failures in tests for Volume Types and extra specs
* fix formatting errors to help debugging
* Fix typo that causes NameError: global name 'exception' exception
* Enable EC2 Create volume from snapshot
* Enabling the tests of floating ip script test\_floating\_ips\_actions.py that were skipped due to bug #957706
* Fix pep8 violations in stress tests
* Assign TODO to committer
* Fix use of except in tempest
* Fix import order to comply with import ordering rules
* Reenable security group related test case
* Remove tempest.conf.tpl
* Adds Cinder tests for Volume Types and extra specs
* early failures would prevent cleanup
* Make parameter list generation consistent using urlencode()
* Check for the canonical form as well, either is valid
* Skip tests broken by nova b u g 1086980
* Start making setup.py similar to other OpenStack Projects
* Empty Body testing according to the RFC2616
* Remove unused configuration variables
* Test Case to check "copy object across container"
* Started consolidation of disk config tests
* Fix and simplify arbitrary\_string. lp#1085048
* Add swift object versioning test case
* Simplify parse\_image\_id
* Fixed potential unbound varialble errors on test failures
* Don't try to cleanup volume that doesn't exist
* Fix issue with 404 logs on wait for delete
* Fix pep8 failures in test\_ec2\_security\_groups.py
* Don't log stack trace on S3/EC2 client errors
* test\_absolute\_limits.py to check limits response
* Adds a Quotas client for Nova
* Spelling: executng=>executing
* fix some typo
* Add start of the EC2/S3 API testing to tempest
* Adds JSON client for servers admin API
* fix for Bug1078481
* use deleted=False instead of deleted=0 in queries
* be specific about metadata too long error
* make it possible to run only one test in tempest
* exclude venv directories from local pep8
* Make assertion failures more informative
* Added Swift tests:       \* account: delete account metadata       \* container: retrieve/delete container metadata       \* object: retrieve/copy(2 ways) object Syntax bug fix in container\_client.py:       return resp. body => return resp, body Fixed passing headers parameter in head method in rest\_client.py:       return self.request('HEAD', url, headers) Removed unused imports
* Remove unnecessary test. Fixes bug 1072841
* Fix SyntaxError: invalid syntax - comma
* Remove kong. Fixes bug 1052511
* General cleanup/organization of compute tests
* flavors with disk sizes of 10 10 20 30 would fail unexpectedly before since flavor[1]['disk'] == flavor[0]['disk]
* Initial add of Swift tests
* Fix 'message' is not defined errors
* Handle ImportError's when quantumclient is missing
* Added missing import for SkipTest in test\_authorization
* Tempest tests to cover live-block-migration
* Refactor list servers negative test and fix remaining gate bugs
* Put skip at top level
* Add XML support for test\_security\_groups.py and test\_security\_group\_rules.py
* Clean up pep8 E125 violations
* Clean up pep8 E123 and E124 violations
* Clean up pep8 E127 violations
* Clean up pep8 E128 violations
* Clean up pep8 E711 violations
* Passing endpoint makes authenticate lazy so getting catalog fails
* Add XML support for test cases under identity admin
* Clean up pep8 E502 violations
* Add XML support to the cinder client
* make the rand\_name value shorter
* Update test\_associate\_already\_associated\_floating\_ip
* Add support to XML in images\_client and its tests
* Add XML support for test\_list\_floating\_ips.py
* Adds client API and tests for volume attachments
* Fix test\_rebuild\_nonexistent\_server
* Refactor status\_timeout() methods in tempest.test
* Add XML support to the volumes tests
* Add XML support to the volumes client
* Add lxml to pip-requires
* Add .tox to .gitignore
* Replace glance.client with python-glanceclient
* Fix ssh.Client retval and deadlock danger LP#1038561
* Fix test\_create\_server\_with\_unauthorized\_image
* Re-enable 3 flavor tests
* Fix bug 1005397
* Fix undefined name 'nose'
* Added missing imports in tempest.tests.compute.base
* Fix forgotten import of \`exceptions\`
* Provide more default clients for smoke tests
* Comment out flakey failing tests
* Adds Cinder client
* Ensure token refresh. Fixes bug 1044316
* Add \*.egg-info to .gitignore
* Add XML support for extensions\_client
* Add XML support for flavors\_client
* Add XML support for test\_attach\_volume
* Add XML support for test\_security\_groups.py
* Prevent stale isolated tenants from blocking test runs
* Add xml support to keypairs\_client and its tests
* Resolves lp#1042541
* Add XML support to the server personality test
* Add XML support to the limits client
* Fix XML formatting for create server personality
* Add XML support for test\_create\_server.py
* Add XML support for test\_server\_actions.py
* Add XML support for test\_list\_server\_filters.py
* Add XML support for test\_servers.py
* Add XML support for test\_images.py
* Add an xml/servers\_client.py implementation
* Attempt to clean up any servers we left behind after a test
* Add a RestClient variant that sends and expects XML
* Skip tests that are causing tempest gate to fail
* Fixes LP Bug# 930482 - Test for security -tenanid by pass
* Skip whitebox tests until they are fixed
* Resolves lp#1033757
* Match name of test class to filename. Fixes bug 1006193
* Addresses lp#1004971
* Addition of base Smoke and Whitebox tests
* Fixes bug 902402- Integration Testcases for Keystone - users, Roles, and tenants
* Fixes Bug 1031639: admin\_client.py- 'Assign and Remove role to user' points to a different URI
* Tolerate set\_admin\_password not implemented
* Fix for bug 1025552- Modifies test\_servers\_negative.py script
* Fix Bug1029936 :SKIP TEST removal and change of Bug ID
* Fix Bug1029334 :Skip Test removed from test\_volumes\_negative
* Fix for Bug 1029792. Added Documentation Strings to test cases in test\_console\_output.py
* fix for Bug 1029015.Added single quotes to remove unnecessary space in msg
* Disable ConfigParser interpolation (lp#1025993)
* Fix checks in server listing only lok for an ID
* Remove skip for bug #984762
* Remove skips for resolved bugs and fixed some coding errors in tests
* Fix logic on alt user tenant/password check
* Fix an unbound variable in setup\_package
* Fix NameError in list image filters test
* Adds a script for tracking bug skips in tempest
* Optimized and reduced the scope of smoke tests
* Add skip for disabled user test until associated bug is fixed
* Fixes bug #1016042 - New tests for security groups
* Add tests for volume attach and detach
* Remove duplicate line cls.floating\_ips\_client = os.floating\_ips\_client from tempest/tests/compute/base.py
* Refactor Tempest to be parallel-test friendly
* Add BaseComputeTest.wait\_for and use it to fix bug 1017932
* Skip slow/buggy soft reboot test until bug 1014647 is dealt with
* Comment out broken test involving soft reboot
* Step 1 of refactoring compute tests
* Wait for resource deletion after 202 response. Fixes bug 1007447
* Fix LP #1006198 - Network tests should be skipped if no Quantum
* Fixes lp:1003476. Adds negative tests for images
* Setup Nose multiprocessor config for:
* Fixes bug 1006405-Additional test cases to be added to test\_volumes\_negative.py
* Wait for server to be deleted before reboot/rebuild. Fixes bug 1006586
* Fixes bug 992088- Testcases for Console Output and one test case to test\_authorization.py
* Deleted flavors can be viewed ... but not listed
* Adds admin tests for roles and roleRef API
* First cut of Network client and positive tests
* Fixes bug 992721- Metadata testcases for authorization testcases
* Fixes bug 972130- Testcases to CREATE, GET, DELETE, FILTER volumes
* Added an AddImageException to exceptions.py and modified images\_client to use this exception rather than BuildErrorException
* Fix floating ip tests by adding missing an import
* Fixes Bug 1004138 - Fix for Bug 992275 Breaks on Python < 2.7
* Added tests for servers API as per bug/992299
* Fixes Bug 992167-Some new tests to be added to test\_security\_groups.py and test\_authorization.py
* Fixes Bug 992215-Some new tests to be added to test\_images.py and test\_authorization.py
* Fixes lp:1002135. Minor re-factor to rest client
* Fixes bug/999647. Adds negative tests for LIST and GET servers API
* Adds instance\_utils library and initial SSH tests
* Fixes bug 992275-Some new tests to test\_floating\_ips\_actions.py
* Fixes bug 972673-Incorrect named parameters in BuildErrorException in test\_volumes\_list
* Fixes bug 992149-Some new tests to test\_keypairs.py and test\_authorization.py
* Fix LP #992228 - Test rebuild/reboot of deleted server
* Adds negative tests for Identity Tenants API
* Fixes bug/902405. Adds users tests and methods to admin client
* Add resources for floating\_ip, keypair, volume. Add floating\_ip test
* Skip blank role name test until resolved upsteam
* Minor fixes and docstrings updates
* Test cases for keystone tenant operations
* Fixes LP #992640 - Volumes sometimes not cleaned
* Moved parse\_image\_id() to data\_utils
* Fixed the LP bug 993754. Ensure that the server created in the test is destroyed in finally: block of the test
* Fixed the LP bug 993739
* Adds key\_name parameter in create\_server
* fix for bug 992877
* Ensures that floating IP created in test is destroyed in a finally: block
* Fixed LP bug 991806. Ensures that floating IP created in test is destroyed in a finally: block
*     Adds an identity admin client and API tests for keystone roles
* Fixes LP #992096 - Add configure\_via\_auth=False
* Addresses lp#948243 - Tempest handles misconfig better
* Remind user about log\_level
*   fixed the bug 983856. Pep8 complient made
* Added keypairs negative tests, removed unused client objects
* bug 985867: remove conf\_from\_devstack in favor of             devstack.git/tools/configure\_tempest.sh
* Clients subclass the RestClient to allow attributes to be overrided by each client and allow better code reuse
* Do not assume network names
* Don't pass None for any values in post body
* Allow skip of disk\_config tests that require resize
* Don't pass disk config as None. Fix for bug 980119
* Add License to Tempest
* Use \`username' in ImagesConfig
* Fixes LP 973338 - Add custom alt and admin manager
* Adds config file template (for use in gate script)
* Convert to UNIX line endings
* Remove obsolete config file
* Enabling flavor marker tests
* Fixes lp##971527
* Properly handle skipping if no alt user
* Fix and simplify reboot stress test. Add new env stuff
* Refactor configuration setup and document config
* Adds basic tests for disk config extension
* Fixes bug 960864- Testcases for the action list Volumes and list Volumes with Detail
* Avoid new bug 963248
* Fix unbound local variable 'password error
* Generalize configuration for controller access
* Fixes lp#960647
* Fixes bug 902374-Negative tests for Volumes
* Addresses lp#940832
* Remove glance dependency. Fixes bug 944410
* Fixes bug 938953 parsing of image id
* Fixes LP Bug# 955349 - No init file in compute tests
* Fixes LP Bug#953450 - Remove vestigial ssh\_timeout
* Initial checkin of Stress Test for nova
* Lowercase boolean configs before comparison
* Addresses lp#942382 - refactor configuration for clarity
* Intermediate improvement of Tempest quickstart
* Narrow race in wait\_for\_server\_status()
* Redrive rate limited API calls
* test\_rebuild\_server tolerant of imageRef as URI
* Fixes lp#945419 - use\_ssl value is ignored
* Fixes lp#945803
* Remove trailing whitespaces in regular file
* Pass credentials to glance client
* Fixes bug 902352 – New tests for security groups
* Addresses lp#902371
* Fixed Bug#943092
* Fixes lp#940532
* Resolves lp#941705
* Addresses lp#933845 \* Changed config to use catalog type instead of catalog name
* Removed expected failure from negative access IP tests
* Fix hardcoding of status bug
* Skip test that is failing due to nova bug 940500
* Fix for bug 931712. Make keypair test work
* Fixes lp#932320 \* Made catalog name configurable
* Make floating ip test work. Fixes bug 929765
* Fix for critical part of bug 929765
* Fixes LP#921409 \* Adds /servers filter tests \* Re-ordered resource building in fixtures to improve   execution time
* Fixes LP Bug#903977 - Boundary tests for list servers
* Fixes LP#922784 \* Removed duplicate test \* Re-ordered resource allocation
* Addresses LP#917976 \* Adds basic logging when exceptions occur
* Fixes LP#902358 - Test case for Floating IPs
* Fixes LP#903978 - Write testcases for test\_server\_actions (boundary)
* Added flavor filter tests: lp899979, lp899980, lp899982 \* Modified flavor service to return results in line with other services \* Added bug flag to tests that are failing due to known issues
* Fixes LP #920782 - Malformed request URL
* Fixes LP#920812 - KeyError: 'overLimit' on 413 return
* KeyPairsClient: Configure client to query nova service from Keystone catalog
* Added Keypair extension (os-keypairs) client and tests LP#900139
* Adds Images API tests
* Don't set multiple images if image\_ref\_alt is the same as image\_ref. Fix typo in skip\_unless\_addr
* Fixes LP Bug#903969 - Image metadata boundary tests
* Rework exceptions in Tempest
* import error on security groups clientfix 917867
* incorporated Jay's suggestion bug915695 security groups client - to list
* Fix for bug917490 \* Adds a wait for the image to become active before deleting it
* Removed an invalid test Added nonexistant tests for list images operations
* Minor style related change in strings Changed indentation to 4 space width Added nonexistant tests for server metadata operations
* LP Bug#914770 - NameError in test\_images
* Patch4 corrected typo - for server. not changing try except block Patch3 removed wait time Patch 2. Incorporated Jay's review comments fix for bug903970 create image from deleted server. Verified Pep8 formats. Verified that the test run fine . No image created
* Fixes LP Bug #912596 - image\_ref\_alt not found
* Added test\_create\_server\_metadata\_key\_too\_long
* Create a Tempest conf from a Devstack env
* RestClient to target specific services in Keystone catalog
* Added filter tests to list images tests, addresses lp bug 900088
* Fixed issue with white space after pep8 review Code review changes for Fixes for lp:903989 Change-Id: Ic345f0b30f24764a6f933684577323042fdeb8aa
* Negative test for Flavor - testcase bug 903967. Test run successfully fixed Pep8 issues. Ran Pep8, and it is fine now. Change-Id: I23f04adcbffef4ec67a996e406aec544fa2deb5b
* Code review changes for Bugfix for lp904407, /extensions tests
* Fixing revert/confirm resize tests
* Fixes lp:903466
* General test cleanup
* Fixes Bug lp:900910
* Fixed bug 902058 (review comments fixed)
* PEP8 fixes
* Removed storm references from README.rst
* Daryl's latest renaming commit needed some fixes
* Changes the namespace from storm to tempest, as well as adding addition tests and improvements \* Changed namespace from storm to tempest \* Added absolute limits service and server personality file tests \* Optimized run time for image metadata tests \* Added additional assertions for create server and rebuild server tests \* Removed any SSH verification until further decisions are made
* Fixes LP Bug#899383 - Cleanup config file search
* \* Added build\_url() utility that returns an endpoint URL based on config parameters \* Updated storm.conf \* Added more properties to Nova config object \* Fixed pep8 and the 'set' typo that came from a vi editor 'set list' fumble
* Removed unnecessary 'self' reference
* Update .gitreview with new project name
* Added image metadata tests, fixed minor bug in servers service with metadata
* Fix numeric header values for kernel\_id and ramdisk\_id
* Added server metadata and image tests. Also added a README for storm.conf
* Added negative tests for servers
* Assert we receive a scoped token & the correct user
* Removed unused imports; whitespace normalization
* Documented availability of 'auth' tag
* Added server details tests. Also re-added several files that somehow missed the initial commit
* Fix rabbitmq login
* Initial import of tests from the Zodiac project. On suggestion from Westmaas, imported tests under the nova directory (final naming TBD) to more quickly get them imported. To run these tests, execute 'nosetests nova/tests'. I've also only submitted the most stable of the tests. More to come
* Tests were not passing for test\_servers in Kong tests. Kong was expecting too much information back from the POST
* Cleaning up kong.tests.test\_server\_actions
* Adding missing kong.common.utils module
* Removing link doctoring in test\_images
* Adding identity api v2.0 tests
* Updating images tests
* Further optimize kong.tests.test\_servers
* Removing unnecessary printing of config file
* Removed non-testing suggestions
* Stop kong/run\_tests.sh from building venv each run
* Relaxing FlavorsTest entity checking
* Adding paramiko and unittest2 to pip-requires
* Updating sample config with required values
* The servers test deal with the new uuid params
* Add .gitreview config file for gerrit
* test supporting API v1.1
* Making run\_test.sh python version and directory agnostic
* Adding generic run\_tests.sh
* Add rfc.sh to help with gerrit workflow
* Consolidate configuration some more
* Make ServersTest.setUpClass just setUp to make sure we have read the config
* Annotate old stacktester tests so that they get run by run\_tests.sh --whatever
* Output request to create server call for easier debugging
* Output response from create server call for easier debugging
* Make the use of a ramdisk optional for tests
* Pull in changes from stacktester
* Skip Rabbit tests if pika is not available
* Initialise openstack.Manager() with config from self.nova
* Make all tests inherit from the same base class
* Import all the stacktester stuff as-is (s/stacktester/kong/, though)
* Add \_\_init\_\_.py
* Move everything under the kong/ namespace
* PEP-8 compliance
* Remove a bunch of unused imports
* No need for xmlrpclib.Server
* This is not exactly Kong
* Add sample instructions for fetching images. Make sample config match these instructions
* cleanup of self.asserts
* cleanup self.asserts
* moved sample\_vm directory under include dir. Added image/kernel/initrd declaration to config file. Updated glance tests to reference config variables for image/kernel/initrd
* Successfully deleting a server returns a 202 now instead of a 204
* Modified the logic to determine which ip to ping during build\_check routine
* Initial Release
* Add README
