2022-09-14T17:29:38.908 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18
2022-09-14T17:29:39.053 INFO:teuthology.lock.ops:Start node 'smithi121.front.sepia.ceph.com' reimaging
2022-09-14T17:29:39.054 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: reset os type and version on server
2022-09-14T17:29:39.054 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2022-09-14T17:29:39.075 INFO:teuthology.lock.ops:Node 'smithi121.front.sepia.ceph.com' reimaging is complete
2022-09-14T17:29:39.075 INFO:teuthology.lock.ops:Start node 'smithi178.front.sepia.ceph.com' reimaging
2022-09-14T17:29:39.076 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: reset os type and version on server
2022-09-14T17:29:39.076 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-09-14T17:29:39.098 INFO:teuthology.lock.ops:Node 'smithi178.front.sepia.ceph.com' reimaging is complete
2022-09-14T17:29:39.299 INFO:teuthology.provision.fog.smithi121:Scheduling deploy of rhel 8.4
2022-09-14T17:29:39.318 INFO:teuthology.provision.fog.smithi178:Scheduling deploy of rhel 8.4
2022-09-14T17:29:39.641 INFO:teuthology.orchestra.console:Power off smithi121
2022-09-14T17:29:39.682 INFO:teuthology.orchestra.console:Power off smithi178
2022-09-14T17:29:48.042 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-09-14T17:29:48.144 INFO:teuthology.orchestra.console:Power on smithi178
2022-09-14T17:29:52.128 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2022-09-14T17:29:52.229 INFO:teuthology.orchestra.console:Power on smithi121
2022-09-14T17:29:56.503 INFO:teuthology.orchestra.console:Power on for smithi178 completed
2022-09-14T17:29:56.605 INFO:teuthology.provision.fog.smithi178:Waiting for deploy to finish
2022-09-14T17:30:00.597 INFO:teuthology.orchestra.console:Power on for smithi121 completed
2022-09-14T17:30:00.698 INFO:teuthology.provision.fog.smithi121:Waiting for deploy to finish
2022-09-14T17:34:32.354 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-14T17:34:32.550 INFO:teuthology.provision.fog.smithi121:Node is ready
2022-09-14T17:34:32.605 INFO:teuthology.orchestra.run.smithi121.stdout:smithi121.front.sepia.ceph.com
2022-09-14T17:34:32.661 INFO:teuthology.orchestra.run.smithi121.stdout:172.21.15.121 smithi121.front.sepia.ceph.com smithi121
2022-09-14T17:34:32.993 INFO:teuthology.provision.fog.smithi121:Deploy complete!
2022-09-14T17:34:52.461 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-09-14T17:34:52.657 INFO:teuthology.provision.fog.smithi178:Node is ready
2022-09-14T17:34:52.715 INFO:teuthology.orchestra.run.smithi178.stdout:smithi178.front.sepia.ceph.com
2022-09-14T17:34:52.771 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.15.178 smithi178.front.sepia.ceph.com smithi178
2022-09-14T17:34:53.100 INFO:teuthology.provision.fog.smithi178:Deploy complete!
2022-09-14T17:34:53.391 INFO:teuthology.lock.ops:Checking smithi121.front.sepia.ceph.com
2022-09-14T17:34:53.392 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-14T17:34:53.415 INFO:teuthology.lock.ops:Checking smithi178.front.sepia.ceph.com
2022-09-14T17:34:53.416 INFO:teuthology.lock.ops:New key found. Updating...
2022-09-14T17:34:53.440 INFO:teuthology.lock.ops:Updating [smithi121.front.sepia.ceph.com]: set os type and version on server
2022-09-14T17:34:53.441 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2022-09-14T17:34:53.689 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64
2022-09-14T17:34:53.744 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="Red Hat Enterprise Linux"
2022-09-14T17:34:53.745 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="8.4 (Ootpa)"
2022-09-14T17:34:53.745 INFO:teuthology.orchestra.run.smithi121.stdout:ID="rhel"
2022-09-14T17:34:53.746 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="fedora"
2022-09-14T17:34:53.746 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="8.4"
2022-09-14T17:34:53.747 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el8"
2022-09-14T17:34:53.747 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-09-14T17:34:53.747 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31"
2022-09-14T17:34:53.748 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-09-14T17:34:53.748 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://www.redhat.com/"
2022-09-14T17:34:53.749 INFO:teuthology.orchestra.run.smithi121.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-14T17:34:53.749 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-14T17:34:53.749 INFO:teuthology.orchestra.run.smithi121.stdout:
2022-09-14T17:34:53.750 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-14T17:34:53.750 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-09-14T17:34:53.750 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-14T17:34:53.751 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-09-14T17:34:53.753 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server
2022-09-14T17:34:53.780 INFO:teuthology.lock.ops:Updating [smithi178.front.sepia.ceph.com]: set os type and version on server
2022-09-14T17:34:53.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2022-09-14T17:34:54.023 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64
2022-09-14T17:34:54.077 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Red Hat Enterprise Linux"
2022-09-14T17:34:54.078 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="8.4 (Ootpa)"
2022-09-14T17:34:54.078 INFO:teuthology.orchestra.run.smithi178.stdout:ID="rhel"
2022-09-14T17:34:54.078 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE="fedora"
2022-09-14T17:34:54.078 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="8.4"
2022-09-14T17:34:54.078 INFO:teuthology.orchestra.run.smithi178.stdout:PLATFORM_ID="platform:el8"
2022-09-14T17:34:54.079 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-09-14T17:34:54.079 INFO:teuthology.orchestra.run.smithi178.stdout:ANSI_COLOR="0;31"
2022-09-14T17:34:54.079 INFO:teuthology.orchestra.run.smithi178.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-09-14T17:34:54.079 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.redhat.com/"
2022-09-14T17:34:54.080 INFO:teuthology.orchestra.run.smithi178.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-09-14T17:34:54.080 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-09-14T17:34:54.080 INFO:teuthology.orchestra.run.smithi178.stdout:
2022-09-14T17:34:54.080 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-09-14T17:34:54.080 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-09-14T17:34:54.081 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-09-14T17:34:54.081 INFO:teuthology.orchestra.run.smithi178.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-09-14T17:34:54.082 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server
2022-09-14T17:34:54.222 INFO:teuthology.dispatcher.supervisor:Running job 7032612
2022-09-14T17:34:54.222 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/bin/teuthology -v --owner scheduled_lflores@teuthology --archive /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032612 --name lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} -- /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032612/orig.config.yaml
2022-09-14T17:34:54.229 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/lflores-2022-09-14_15:11:39-rados-quincy-release-distro-default-smithi/7032612
2022-09-14T17:34:54.231 INFO:teuthology.dispatcher.supervisor:Job PID: 7117
2022-09-14T17:34:54.231 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-09-15T05:35:53.087 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2022-09-15T05:35:53.271 INFO:teuthology.kill:Killing Pids: {7117}
2022-09-15T05:35:54.962 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-09-15T05:35:54.964 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-09-15T05:35:54.964 INFO:teuthology.misc:Compressing logs...
2022-09-15T05:35:54.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com'
2022-09-15T05:35:55.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com'
2022-09-15T05:35:55.587 INFO:teuthology.misc:Compressing logs...
2022-09-15T05:35:56.702 INFO:teuthology.orchestra.run.smithi121.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-15T05:35:56.714 INFO:teuthology.orchestra.run.smithi178.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-09-15T05:35:57.380 INFO:teuthology.misc:Compressing logs...
2022-09-15T05:42:33.603 INFO:teuthology.kill:No teuthology processes running
2022-09-15T05:42:35.035 INFO:teuthology.kill:Nuking machines: ['smithi121', 'smithi178']
2022-09-15T05:42:36.189 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b58f2c18636eb10faa77ed3614abd00cb85dfc2c/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release.
2022-09-15T05:42:36.190 INFO:teuthology.kill:  from cryptography.hazmat.backends import default_backend
2022-09-15T05:42:36.191 INFO:teuthology.kill:2022-09-15 05:42:36,188.188 INFO:teuthology.nuke:targets:
2022-09-15T05:42:36.191 INFO:teuthology.kill:  smithi121.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDhjV59kRkQiBMzCDVUc/Wt0vmeire92btiVrO3SmBj6/uYyHLRxB8rK0aHgZkebJrs91BexZTwd8WCiICvR7oZU88iH4hF9ELf/J4I9S4mWxbYO9u8wXAD3NGvZ9mYwALyrszRVDNmoK0NOXw2j/qYGhD4Y+TzXjLodGn10UkwXniVsVYzNoStWLSNAOPrBsFGMSNVbOcbufob3qCPvQvnjF6xhvi768wjKm/6o3H7xDvUA/NLeGY3nJOoIkGHnHWqHluV6eNMhBNBo386ArRI2aauWEzcdik0h/+l+8CS9q/ZwkbzfENJ7l+/sJxp+qHZ5pdOx8mnVdr+OLvYCvRDEpCJ8rED1O0th0b1cwAkDXmuPvVrWdg1eqShDlQz0GC+/GR0DEHkMPn94BLlqUlrRhaW1gzo5TZ7QytRJZTLyC46+aqXfr90RfEG4E88Mcm9ViElxQG0Arrxo4hR0+6yVzQlpfKtvAc7BSJ5ZspubGkJKDYKkMHgQ+LCcN3gsZs=
2022-09-15T05:42:36.192 INFO:teuthology.kill:  smithi178.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCiH+mqu9z7G1f64flDg89KbBc3PKQQGbxE9Xyk3axevemnYfm3dBHttgchnBo4DUKsIvgxd8/NWAaQt5Wn7fNfo02D0FqqOExUwaVORU/nvk7ZkF1OFtE6bYe0WZ6HhwnAl8O8NigGmqEDFyuSLN47Zmh8gBDd84jmwHSARGyki/oNUt4/h1ZtcMwI9yB81jv9ZLHTRqfddBnDRFedmbVwHMs+RS+PjQGHTpOdft+CDiCdBuoBUeIeijmlr+IuMMAHdueg7cv2hQM2Gu6oz2uWPic0Y53bPFEbcIlKUU1rB7ZWDRcMU0w/+7/uU+AThsGa7b1CcHkPfqR57S3VhmxwUXggUcRYDik1mrNFpTHr+hs72OkO+vWcJ+8dgJl5KIwAuZpFdYqBZjdMlnvphztWGmICXlPDTceFcowGPhYdxZgaklSR9ujZi4BjHJ6eQ7r9mFVHF1yBo7T+7koSGn1qTDHmXFjvYcGJr60WqGRMcsPH8SOfaeJxUPbLz7aHtgs=
2022-09-15T05:42:36.193 INFO:teuthology.kill:2022-09-15 05:42:36,188.188 INFO:teuthology.nuke:Checking targets against current locks
2022-09-15T05:42:36.244 INFO:teuthology.kill:2022-09-15 05:42:36,243.243 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-15T05:42:36.276 INFO:teuthology.kill:2022-09-15 05:42:36,275.275 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-09-15T05:42:36.340 INFO:teuthology.kill:2022-09-15 05:42:36,340.340 INFO:teuthology.orchestra.console:Power off smithi121
2022-09-15T05:42:36.394 INFO:teuthology.kill:2022-09-15 05:42:36,393.393 INFO:teuthology.orchestra.console:Power off smithi178
2022-09-15T05:42:44.778 INFO:teuthology.kill:2022-09-15 05:42:44,777.777 INFO:teuthology.orchestra.console:Power off for smithi178 completed
2022-09-15T05:42:44.953 INFO:teuthology.kill:2022-09-15 05:42:44,953.953 INFO:teuthology.lock.ops:unlocked: smithi178.front.sepia.ceph.com
2022-09-15T05:42:48.848 INFO:teuthology.kill:2022-09-15 05:42:48,848.848 INFO:teuthology.orchestra.console:Power off for smithi121 completed
2022-09-15T05:42:48.999 INFO:teuthology.kill:2022-09-15 05:42:48,998.998 INFO:teuthology.lock.ops:unlocked: smithi121.front.sepia.ceph.com
2022-09-15T05:44:49.421 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-09-15T05:44:49.527 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi121 but it was locked by another job: /home/teuthworker/archive/pdhange-2022-09-15_04:10:46-rados-wip-pdhange-testing-distro-default-smithi/7033509
2022-09-15T05:44:49.528 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi178 but it was locked by another job: /home/teuthworker/archive/pdhange-2022-09-15_04:10:46-rados-wip-pdhange-testing-distro-default-smithi/7033509