2023-02-11T06:59:46.031 INFO:root:teuthology version: 0.0.1.dev37+g00690ec
2023-02-11T06:59:46.144 INFO:teuthology.lock.ops:Start node 'smithi073.front.sepia.ceph.com' reimaging
2023-02-11T06:59:46.145 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T06:59:46.145 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2023-02-11T06:59:46.199 INFO:teuthology.lock.ops:Node 'smithi073.front.sepia.ceph.com' reimaging is complete
2023-02-11T06:59:46.199 INFO:teuthology.lock.ops:Start node 'smithi155.front.sepia.ceph.com' reimaging
2023-02-11T06:59:46.199 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: reset os type and version on server
2023-02-11T06:59:46.199 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-02-11T06:59:46.216 INFO:teuthology.lock.ops:Node 'smithi155.front.sepia.ceph.com' reimaging is complete
2023-02-11T06:59:46.359 INFO:teuthology.provision.fog.smithi073:Scheduling deploy of rhel 8.4
2023-02-11T06:59:46.361 INFO:teuthology.provision.fog.smithi155:Scheduling deploy of rhel 8.4
2023-02-11T06:59:46.579 INFO:teuthology.orchestra.console:Power off smithi155
2023-02-11T06:59:46.597 INFO:teuthology.orchestra.console:Power off smithi073
2023-02-11T06:59:54.957 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2023-02-11T06:59:54.969 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2023-02-11T06:59:55.066 INFO:teuthology.orchestra.console:Power on smithi155
2023-02-11T06:59:55.105 INFO:teuthology.orchestra.console:Power on smithi073
2023-02-11T07:00:03.513 INFO:teuthology.orchestra.console:Power on for smithi073 completed
2023-02-11T07:00:03.566 INFO:teuthology.orchestra.console:Power on for smithi155 completed
2023-02-11T07:00:03.640 INFO:teuthology.provision.fog.smithi073:Waiting for deploy to finish
2023-02-11T07:00:03.667 INFO:teuthology.provision.fog.smithi155:Waiting for deploy to finish
2023-02-11T07:03:08.042 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-02-11T07:03:08.054 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:03:17.157 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:03:17.158 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-02-11T07:03:26.213 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:03:26.213 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-02-11T07:03:35.269 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:03:35.269 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.73
2023-02-11T07:03:44.325 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:03:53.386 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.155
2023-02-11T07:04:41.318 WARNING:teuthology.provision.fog:timed out
2023-02-11T07:04:47.671 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T07:04:47.975 INFO:teuthology.provision.fog.smithi073:Node is ready
2023-02-11T07:04:47.991 INFO:teuthology.orchestra.run.smithi073.stdout:smithi073
2023-02-11T07:04:48.047 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.15.73 smithi073.front.sepia.ceph.com smithi073
2023-02-11T07:04:48.382 INFO:teuthology.provision.fog.smithi073:Deploy complete!
2023-02-11T07:04:59.405 WARNING:teuthology.provision.fog:timed out
2023-02-11T07:05:05.784 INFO:teuthology.orchestra.run:Running command with timeout 600
2023-02-11T07:05:06.024 INFO:teuthology.provision.fog.smithi155:Node is ready
2023-02-11T07:05:06.079 INFO:teuthology.orchestra.run.smithi155.stdout:smithi155.front.sepia.ceph.com
2023-02-11T07:05:06.134 INFO:teuthology.orchestra.run.smithi155.stdout:172.21.15.155 smithi155.front.sepia.ceph.com smithi155
2023-02-11T07:05:06.477 INFO:teuthology.provision.fog.smithi155:Deploy complete!
2023-02-11T07:05:06.656 INFO:teuthology.lock.ops:Checking smithi073.front.sepia.ceph.com
2023-02-11T07:05:06.656 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T07:05:06.703 INFO:teuthology.lock.ops:Checking smithi155.front.sepia.ceph.com
2023-02-11T07:05:06.704 INFO:teuthology.lock.ops:New key found. Updating...
2023-02-11T07:05:06.751 INFO:teuthology.lock.ops:Updating [smithi073.front.sepia.ceph.com]: set os type and version on server
2023-02-11T07:05:06.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2023-02-11T07:05:06.945 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64
2023-02-11T07:05:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Red Hat Enterprise Linux"
2023-02-11T07:05:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="8.4 (Ootpa)"
2023-02-11T07:05:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:ID="rhel"
2023-02-11T07:05:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="fedora"
2023-02-11T07:05:06.999 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="8.4"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el8"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.redhat.com/"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-02-11T07:05:07.000 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-02-11T07:05:07.001 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server
2023-02-11T07:05:07.058 INFO:teuthology.lock.ops:Updating [smithi155.front.sepia.ceph.com]: set os type and version on server
2023-02-11T07:05:07.058 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-02-11T07:05:07.240 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="Red Hat Enterprise Linux"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="8.4 (Ootpa)"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:ID="rhel"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="fedora"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="8.4"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el8"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31"
2023-02-11T07:05:07.294 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://www.redhat.com/"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
2023-02-11T07:05:07.295 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4"
2023-02-11T07:05:07.295 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server
2023-02-11T07:05:07.432 INFO:teuthology.dispatcher.supervisor:Running job 7160280
2023-02-11T07:05:07.432 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-02-08_19:38:46-fs-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160280 --name yuriw-2023-02-08_19:38:46-fs-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{frag ignorelist_health ignorelist_wrongly_marked_down prefetch_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/osd 2-workunit/suites/pjd}} -- /home/teuthworker/archive/yuriw-2023-02-08_19:38:46-fs-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160280/orig.config.yaml
2023-02-11T07:05:07.456 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-02-08_19:38:46-fs-wip-yuri3-testing-2023-02-07-0852-quincy-distro-default-smithi/7160280
2023-02-11T07:05:07.457 INFO:teuthology.dispatcher.supervisor:Job PID: 15827
2023-02-11T07:05:07.457 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2023-02-11T19:06:11.677 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing...
2023-02-11T19:06:17.697 INFO:teuthology.kill:Killing Pids: {15827}
2023-02-11T19:06:26.041 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0']
2023-02-11T19:06:26.041 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']
2023-02-11T19:06:26.045 INFO:teuthology.misc:Compressing logs...
2023-02-11T19:06:26.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com'
2023-02-11T19:06:28.132 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com'
2023-02-11T19:06:28.954 INFO:teuthology.kill:No teuthology processes running
2023-02-11T19:06:30.316 INFO:teuthology.kill:Nuking machines: ['smithi073', 'smithi155']
2023-02-11T19:06:31.372 INFO:teuthology.kill:2023-02-11 19:06:31,372.372 INFO:teuthology.nuke:targets:
2023-02-11T19:06:31.374 INFO:teuthology.kill:  smithi073.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDXrZBzfbtKYkWiKW+9QHfgxJ9C2+XrKVIz1rsHZ2GBm4Xdi97Eub6sjYumDHb3Ly8fR0Z+d8cp225wpEHNn7z8z8sTAx0Pwuc+qLuagHB7RbmkrF+TcOlgc3TBUsHTFnLCGJanNiTeeiM9N7dSouSICP61OLv8t1lvOYQykMihHc7X3+2aZKJEHkN3OduYXfr1Mvia4odiTkonXZ7CBSArYi1s8tNcRGj2S+D1Vs4mgAuhrY9y2+Zvt6FjuYjikkkH5b4p2GBMFT06pyDyF+Pth+k0M0RS3qtCfoBfcC501ciOlc9IQJvMu4STkl11ymgNNjdGQOMPtRCNEETVp89QFJJT+RmmxMO1Be6+ullbST//A8GbO0Qf8joWUJpm/LNdIxseHIRGAJ+Vf2WhH3bKG3gfE++Ki5lTDz7AYVBip8i4rUFKYTGuMTCO3WZmhXD7i/n8sr9KWAD9ceurc+9axB56rnKcYcF7p/USnYex6TIsJFM1ZHNAeT4v0WThrck=
2023-02-11T19:06:31.374 INFO:teuthology.kill:  smithi155.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCsO4FTgZi2Lpi0WCQav4zNBsN4wmXE2BbfXKZd9j+HkCg5QL8DhFGs22RuE8mFYE0XDdGERMNlqtJS1Vcj47alWeQ+1vIHKFFLGLEEKULeXvVfpvGze+7n01dvUsoD+vr0r3huV2f12RHpgZp+Xhg+5bJd2bU4xmUmA06ZS2fiJUXvzoL4Q6i96DXsPuO8xOHdBHnPU2k9jvNSXFcOcKDAqS/L0qd+nUj7zrcPqf5w5NHRH6ERnaO2PPyL++txC3NbOAnKLkeLXN9I2EPzGI+W0BI4+9V+zT422AawOlJ/5FY9tQNBBFDZq9O3mtvPrSmu8IafVtUKVzzMR7p6fBlZ5lN8aN9VJHsV6jCUFMw33Ct4Zl4qu/R1TcxFijBwVdtpJB2AImdOPq7ZeAQ6A1nKsLk9OPmPhTxZG8PF6z/l9/VQfboQdKOm1tpAAubR2wv6YH7g6n9UdhiDbdKBoNsyjSwbDCOKJi6g47+JiVO6phHvZ72VBqqlzE/c58F69B0=
2023-02-11T19:06:31.374 INFO:teuthology.kill:2023-02-11 19:06:31,372.372 INFO:teuthology.nuke:Checking targets against current locks
2023-02-11T19:06:31.432 INFO:teuthology.kill:2023-02-11 19:06:31,431.431 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-11T19:06:31.455 INFO:teuthology.kill:2023-02-11 19:06:31,455.455 INFO:teuthology.task.internal.check_lock:Checking locks...
2023-02-11T19:06:31.509 INFO:teuthology.kill:2023-02-11 19:06:31,509.509 INFO:teuthology.orchestra.console:Power off smithi073
2023-02-11T19:06:31.584 INFO:teuthology.kill:2023-02-11 19:06:31,583.583 INFO:teuthology.orchestra.console:Power off smithi155
2023-02-11T19:06:40.074 INFO:teuthology.kill:2023-02-11 19:06:40,073.073 INFO:teuthology.orchestra.console:Power off for smithi155 completed
2023-02-11T19:06:40.285 INFO:teuthology.kill:2023-02-11 19:06:40,284.284 INFO:teuthology.lock.ops:unlocked: smithi155.front.sepia.ceph.com
2023-02-11T19:06:44.181 INFO:teuthology.kill:2023-02-11 19:06:44,181.181 INFO:teuthology.orchestra.console:Power off for smithi073 completed
2023-02-11T19:06:44.324 INFO:teuthology.kill:2023-02-11 19:06:44,324.324 INFO:teuthology.lock.ops:unlocked: smithi073.front.sepia.ceph.com
2023-02-11T19:08:44.633 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15
2023-02-11T19:08:44.913 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi073 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169637
2023-02-11T19:08:44.913 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi155 but it was locked by another job: /home/teuthworker/archive/cbodley-2023-02-11_16:16:51-rgw-wip-cbodley-testing-distro-default-smithi/7169637