2022-02-27T03:03:42.465 INFO:root:teuthology version: 1.1.0-eea25212
2022-02-27T03:03:42.590 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging
2022-02-27T03:03:42.591 INFO:teuthology.lock.ops:Updating [ubuntu@smithi042.front.sepia.ceph.com]: reset os type and version on server
2022-02-27T03:03:42.591 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2022-02-27T03:03:42.610 INFO:teuthology.lock.ops:Node 'ubuntu@smithi042.front.sepia.ceph.com' reimaging is complete
2022-02-27T03:03:42.611 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging
2022-02-27T03:03:42.611 INFO:teuthology.lock.ops:Updating [ubuntu@smithi123.front.sepia.ceph.com]: reset os type and version on server
2022-02-27T03:03:42.611 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-02-27T03:03:42.651 INFO:teuthology.lock.ops:Node 'ubuntu@smithi123.front.sepia.ceph.com' reimaging is complete
2022-02-27T03:03:42.821 INFO:teuthology.provision.fog.smithi042:Scheduling deploy of rhel 8.4
2022-02-27T03:03:42.860 INFO:teuthology.provision.fog.smithi123:Scheduling deploy of rhel 8.4
2022-02-27T03:03:43.126 INFO:teuthology.orchestra.console:Power off smithi042
2022-02-27T03:03:43.171 INFO:teuthology.orchestra.console:Power off smithi123
2022-02-27T03:03:51.505 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2022-02-27T03:03:51.528 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-02-27T03:03:51.607 INFO:teuthology.orchestra.console:Power on smithi042
2022-02-27T03:03:51.636 INFO:teuthology.orchestra.console:Power on smithi123
2022-02-27T03:03:59.976 INFO:teuthology.orchestra.console:Power on for smithi042 completed
2022-02-27T03:04:00.049 INFO:teuthology.orchestra.console:Power on for smithi123 completed
2022-02-27T03:04:00.077 INFO:teuthology.provision.fog.smithi042:Waiting for deploy to finish
2022-02-27T03:04:00.151 INFO:teuthology.provision.fog.smithi123:Waiting for deploy to finish
2022-02-27T03:07:57.583 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-27T03:08:07.730 INFO:teuthology.orchestra.run:Running command with timeout 600
2022-02-27T03:08:07.950 INFO:teuthology.provision.fog.smithi042:Node is ready
2022-02-27T03:08:07.966 INFO:teuthology.orchestra.run.smithi042.stdout:smithi042.front.sepia.ceph.com
2022-02-27T03:08:08.022 INFO:teuthology.orchestra.run.smithi042.stdout:172.21.15.42 smithi042.front.sepia.ceph.com smithi042
2022-02-27T03:08:08.365 INFO:teuthology.provision.fog.smithi042:Deploy complete!
2022-02-27T03:08:12.843 INFO:teuthology.provision.fog.smithi123:Node is ready
2022-02-27T03:08:12.903 INFO:teuthology.orchestra.run.smithi123.stdout:smithi204
2022-02-27T03:08:12.959 INFO:teuthology.orchestra.run.smithi123.stdout:172.21.15.204 smithi204.front.sepia.ceph.com smithi204
2022-02-27T03:08:13.301 INFO:teuthology.provision.fog.smithi123:Deploy complete!
2022-02-27T03:08:13.500 INFO:teuthology.lock.ops:Checking smithi042.front.sepia.ceph.com
2022-02-27T03:08:13.501 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-27T03:08:13.520 INFO:teuthology.lock.ops:Checking smithi123.front.sepia.ceph.com
2022-02-27T03:08:13.521 INFO:teuthology.lock.ops:New key found. Updating...
2022-02-27T03:08:13.540 INFO:teuthology.lock.ops:Updating [smithi042.front.sepia.ceph.com]: set os type and version on server
2022-02-27T03:08:13.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2022-02-27T03:08:13.779 INFO:teuthology.orchestra.run.smithi042.stdout:x86_64
2022-02-27T03:08:13.835 INFO:teuthology.orchestra.run.smithi042.stdout:NAME="Red Hat Enterprise Linux"
2022-02-27T03:08:13.835 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION="8.4 (Ootpa)"
2022-02-27T03:08:13.835 INFO:teuthology.orchestra.run.smithi042.stdout:ID="rhel"
2022-02-27T03:08:13.836 INFO:teuthology.orchestra.run.smithi042.stdout:ID_LIKE="fedora"
2022-02-27T03:08:13.836 INFO:teuthology.orchestra.run.smithi042.stdout:VERSION_ID="8.4"
2022-02-27T03:08:13.836 INFO:teuthology.orchestra.run.smithi042.stdout:PLATFORM_ID="platform:el8"
2022-02-27T03:08:13.836 INFO:teuthology.orchestra.run.smithi042.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-27T03:08:13.836 INFO:teuthology.orchestra.run.smithi042.stdout:ANSI_COLOR="0;31"
2022-02-27T03:08:13.837 INFO:teuthology.orchestra.run.smithi042.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-27T03:08:13.837 INFO:teuthology.orchestra.run.smithi042.stdout:HOME_URL="https://www.redhat.com/"
2022-02-27T03:08:13.837 INFO:teuthology.orchestra.run.smithi042.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-27T03:08:13.837 INFO:teuthology.orchestra.run.smithi042.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-27T03:08:13.838 INFO:teuthology.orchestra.run.smithi042.stdout:
2022-02-27T03:08:13.838 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-27T03:08:13.838 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-27T03:08:13.838 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-27T03:08:13.838 INFO:teuthology.orchestra.run.smithi042.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-27T03:08:13.840 INFO:teuthology.lock.ops:Updating smithi042.front.sepia.ceph.com on lock server
2022-02-27T03:08:13.859 INFO:teuthology.lock.ops:Updating [smithi123.front.sepia.ceph.com]: set os type and version on server
2022-02-27T03:08:13.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-02-27T03:08:14.091 INFO:teuthology.orchestra.run.smithi123.stdout:x86_64
2022-02-27T03:08:14.145 INFO:teuthology.orchestra.run.smithi123.stdout:NAME="Red Hat Enterprise Linux"
2022-02-27T03:08:14.145 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION="8.4 (Ootpa)"
2022-02-27T03:08:14.145 INFO:teuthology.orchestra.run.smithi123.stdout:ID="rhel"
2022-02-27T03:08:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:ID_LIKE="fedora"
2022-02-27T03:08:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:VERSION_ID="8.4"
2022-02-27T03:08:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:PLATFORM_ID="platform:el8"
2022-02-27T03:08:14.146 INFO:teuthology.orchestra.run.smithi123.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2022-02-27T03:08:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:ANSI_COLOR="0;31"
2022-02-27T03:08:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2022-02-27T03:08:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:HOME_URL="https://www.redhat.com/"
2022-02-27T03:08:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2022-02-27T03:08:14.147 INFO:teuthology.orchestra.run.smithi123.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2022-02-27T03:08:14.148 INFO:teuthology.orchestra.run.smithi123.stdout:
2022-02-27T03:08:14.148 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2022-02-27T03:08:14.148 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2022-02-27T03:08:14.148 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2022-02-27T03:08:14.148 INFO:teuthology.orchestra.run.smithi123.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2022-02-27T03:08:14.149 INFO:teuthology.lock.ops:Updating smithi123.front.sepia.ceph.com on lock server
2022-02-27T03:08:14.249 INFO:teuthology.dispatcher.supervisor:Running job 6697162
2022-02-27T03:08:14.250 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_eea2521245e542c7c1a063d296779f572aa0255a/virtualenv/bin/teuthology -v --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2022-02-20_07:01:03-rados-master-distro-default-smithi/6697162 --name teuthology-2022-02-20_07:01:03-rados-master-distro-default-smithi --description rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} -- /home/teuthworker/archive/teuthology-2022-02-20_07:01:03-rados-master-distro-default-smithi/6697162/orig.config.yaml
2022-02-27T03:08:14.253 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/teuthology-2022-02-20_07:01:03-rados-master-distro-default-smithi/6697162
2022-02-27T03:08:14.254 INFO:teuthology.dispatcher.supervisor:Job PID: 6868
2022-02-27T03:08:14.254 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2022-02-27T09:38:43.499 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing...
2022-02-27T09:38:43.701 INFO:teuthology.kill:Killing Pids: {6868}
2022-02-27T09:38:44.810 INFO:teuthology.task.internal:roles: ubuntu@smithi042.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a']
2022-02-27T09:38:44.811 INFO:teuthology.task.internal:roles: ubuntu@smithi123.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']
2022-02-27T09:38:44.812 INFO:teuthology.misc:Compressing logs...
2022-02-27T09:38:44.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi042.front.sepia.ceph.com'
2022-02-27T09:38:44.998 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi123.front.sepia.ceph.com'
2022-02-27T09:38:45.348 INFO:teuthology.misc:Compressing logs...
2022-02-27T09:38:45.885 INFO:teuthology.orchestra.run.smithi123.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-27T09:38:46.070 INFO:teuthology.orchestra.run.smithi042.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping
2022-02-27T09:38:46.447 INFO:teuthology.misc:Compressing logs...
2022-02-27T09:39:03.538 INFO:teuthology.kill:No teuthology processes running
2022-02-27T09:39:04.686 INFO:teuthology.kill:Nuking machines: ['smithi042', 'smithi123']
2022-02-27T09:39:05.661 INFO:teuthology.kill:2022-02-27 09:39:05,660.660 INFO:teuthology.nuke:targets:
2022-02-27T09:39:05.661 INFO:teuthology.kill:  smithi042.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzSvTGTApX68nixtYZhoDmOPyN0008uTPGvmXtUVsk3s+8rvYW9bkG2OxPrboFQwgcHS57tW4immW6CY9/vhYoaQGI2JBgNxwmP6xbs2k9GWSBxgGP9qNrTdhx9kbNj7SaEun9IwcJRyTYCCgpYdpdE7OwlgDSpr4eDVlNf7VLvQbkdXo5p2oQ1hM7HRDCtiko7TjkJf9ZMsOj+rZtkWVzbhcWoInW/wfQLfHiNljEJssjiDBxkPNjRPYcHC6x4nidYYyrKGKxGv1zy7UK7VVogEEDBUkFd1t0k9JroB739spVCJeYbLlVsey7teKla9qmJqwTvFn/KuSW742bZozIciGXtt9rWFeQE60gVauCer2K+GmH7GvZyWaZ0C6OyXyQ7Hx/3+2W1cMGVzeKHcEguMg+FS94fiQgxsHz4NWPhpSxl05oVmRvXxWoybAlofcx5dekQgYW8E8Lp+ZVRObXu/OiHa1n1Sc+8qnZxWjuDcUV57qylNE67r7hSuZ8Tj8=
2022-02-27T09:39:05.662 INFO:teuthology.kill:  smithi123.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAJkH7GLfZh+Yy4tSCEP3tVbGzyP6ZgkrqGv1qnRSzOrUuCAmPm3pNbgaOEl1pmxOlWETKrGrY1eisU2vDyHyvBGNCWN7JmOPPRoyLr2ZZNpMkJp1B8GUPDgWqLpdP6UwKlfAX2sc5p3XZ/AfomNZQoQ5p8B1gSfumAbEmopjCNDKiUl7Auu7FPzHzUyJ9af/s1xTRDq+TkG5spw1OwD9e9U80guFXQiZBI5gSrRMHjTbgPV3EXJRZqlI1X4OeaUQjEafdXbruYyw2mQGSRRcqc+sHDX+6lgk0HkJNtu+ZvoO3w73pGoXyF9kGt23ZQqa0wYPnV8qaReKctO9ogpugT9Ipsx0FGqgQgHtorFQEWOSNbZFdFZjmtsQY1i+Jq1+S4gBKRCHD9hKDs2zIlwPJ2s2MzNHtKWXV3DH3EiV9AtrGifugNKLRcWdjzBv73FWbeyUOyJcvBeeJBAas4CLmh5hRjT0JiTArAZ/grdjGwZ1L9EWexEofBij06FTc4JU=
2022-02-27T09:39:05.688 INFO:teuthology.kill:2022-02-27 09:39:05,688.688 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-27T09:39:05.691 INFO:teuthology.kill:2022-02-27 09:39:05,691.691 INFO:teuthology.task.internal.check_lock:Checking locks...
2022-02-27T09:39:05.766 INFO:teuthology.kill:2022-02-27 09:39:05,766.766 INFO:teuthology.orchestra.console:Power off smithi042
2022-02-27T09:39:05.781 INFO:teuthology.kill:2022-02-27 09:39:05,781.781 INFO:teuthology.orchestra.console:Power off smithi123
2022-02-27T09:39:14.138 INFO:teuthology.kill:2022-02-27 09:39:14,138.138 INFO:teuthology.orchestra.console:Power off for smithi042 completed
2022-02-27T09:39:14.143 INFO:teuthology.kill:2022-02-27 09:39:14,143.143 INFO:teuthology.orchestra.console:Power off for smithi123 completed
2022-02-27T09:39:14.284 INFO:teuthology.kill:2022-02-27 09:39:14,283.283 INFO:teuthology.lock.ops:unlocked: smithi042.front.sepia.ceph.com
2022-02-27T09:39:14.287 INFO:teuthology.kill:2022-02-27 09:39:14,287.287 INFO:teuthology.lock.ops:unlocked: smithi123.front.sepia.ceph.com
2022-02-27T09:41:14.602 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2022-02-27T09:41:14.699 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi042 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-21_02:01:04-rbd-master-distro-default-smithi/6697436
2022-02-27T09:41:14.700 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi123 but it was locked by another job: /home/teuthworker/archive/teuthology-2022-02-21_02:01:04-rbd-master-distro-default-smithi/6697436