2022-05-18T11:50:09.609 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-18T11:50:09.892 INFO:teuthology.lock.ops:Start node 'smithi158.front.sepia.ceph.com' reimaging 2022-05-18T11:50:09.902 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:50:09.902 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2022-05-18T11:50:09.923 INFO:teuthology.lock.ops:Node 'smithi158.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:50:09.924 INFO:teuthology.lock.ops:Start node 'smithi166.front.sepia.ceph.com' reimaging 2022-05-18T11:50:09.924 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: reset os type and version on server 2022-05-18T11:50:09.924 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-05-18T11:50:09.993 INFO:teuthology.lock.ops:Node 'smithi166.front.sepia.ceph.com' reimaging is complete 2022-05-18T11:50:10.195 INFO:teuthology.provision.fog.smithi158:Scheduling deploy of centos 8.stream 2022-05-18T11:50:10.234 INFO:teuthology.provision.fog.smithi166:Scheduling deploy of centos 8.stream 2022-05-18T11:50:10.539 INFO:teuthology.orchestra.console:Power off smithi158 2022-05-18T11:50:10.665 INFO:teuthology.orchestra.console:Power off smithi166 2022-05-18T11:50:19.041 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2022-05-18T11:50:19.091 INFO:teuthology.orchestra.console:Power off for smithi166 completed 2022-05-18T11:50:19.145 INFO:teuthology.orchestra.console:Power on smithi158 2022-05-18T11:50:19.195 INFO:teuthology.orchestra.console:Power on smithi166 2022-05-18T11:50:27.559 INFO:teuthology.orchestra.console:Power on for smithi158 completed 2022-05-18T11:50:27.595 INFO:teuthology.orchestra.console:Power on for smithi166 completed 2022-05-18T11:50:27.668 INFO:teuthology.provision.fog.smithi158:Waiting for deploy to finish 2022-05-18T11:50:27.699 INFO:teuthology.provision.fog.smithi166:Waiting for deploy to finish 2022-05-18T11:53:14.284 ERROR:teuthology.orchestra.connection:Error authenticating with smithi158.front.sepia.ceph.com: Authentication failed. 2022-05-18T11:54:57.251 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:54:57.570 INFO:teuthology.provision.fog.smithi166:Node is ready 2022-05-18T11:54:57.594 INFO:teuthology.orchestra.run.smithi166.stdout:smithi166.front.sepia.ceph.com 2022-05-18T11:54:57.653 INFO:teuthology.orchestra.run.smithi166.stdout:172.21.15.166 smithi166.front.sepia.ceph.com smithi166 2022-05-18T11:54:58.011 INFO:teuthology.provision.fog.smithi166:Deploy complete! 2022-05-18T11:55:11.098 INFO:teuthology.orchestra.run:Running command with timeout 600 2022-05-18T11:55:36.319 INFO:teuthology.provision.fog.smithi158:Node is ready 2022-05-18T11:55:36.342 INFO:teuthology.orchestra.run.smithi158.stdout:smithi158.front.sepia.ceph.com 2022-05-18T11:55:36.401 INFO:teuthology.orchestra.run.smithi158.stdout:172.21.15.158 smithi158.front.sepia.ceph.com smithi158 2022-05-18T11:55:36.772 INFO:teuthology.provision.fog.smithi158:Deploy complete! 2022-05-18T11:55:37.022 INFO:teuthology.lock.ops:Checking smithi158.front.sepia.ceph.com 2022-05-18T11:55:37.023 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:55:37.058 INFO:teuthology.lock.ops:Checking smithi166.front.sepia.ceph.com 2022-05-18T11:55:37.059 INFO:teuthology.lock.ops:New key found. Updating... 2022-05-18T11:55:37.088 INFO:teuthology.lock.ops:Updating [smithi158.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:55:37.088 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2022-05-18T11:55:37.287 INFO:teuthology.orchestra.run.smithi158.stdout:x86_64 2022-05-18T11:55:37.344 INFO:teuthology.orchestra.run.smithi158.stdout:NAME="CentOS Stream" 2022-05-18T11:55:37.344 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION="8" 2022-05-18T11:55:37.344 INFO:teuthology.orchestra.run.smithi158.stdout:ID="centos" 2022-05-18T11:55:37.345 INFO:teuthology.orchestra.run.smithi158.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:55:37.345 INFO:teuthology.orchestra.run.smithi158.stdout:VERSION_ID="8" 2022-05-18T11:55:37.345 INFO:teuthology.orchestra.run.smithi158.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:55:37.345 INFO:teuthology.orchestra.run.smithi158.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:55:37.346 INFO:teuthology.orchestra.run.smithi158.stdout:ANSI_COLOR="0;31" 2022-05-18T11:55:37.346 INFO:teuthology.orchestra.run.smithi158.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:55:37.346 INFO:teuthology.orchestra.run.smithi158.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:55:37.346 INFO:teuthology.orchestra.run.smithi158.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:55:37.347 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:55:37.347 INFO:teuthology.orchestra.run.smithi158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:55:37.348 INFO:teuthology.lock.ops:Updating smithi158.front.sepia.ceph.com on lock server 2022-05-18T11:55:37.377 INFO:teuthology.lock.ops:Updating [smithi166.front.sepia.ceph.com]: set os type and version on server 2022-05-18T11:55:37.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-05-18T11:55:37.649 INFO:teuthology.orchestra.run.smithi166.stdout:x86_64 2022-05-18T11:55:37.706 INFO:teuthology.orchestra.run.smithi166.stdout:NAME="CentOS Stream" 2022-05-18T11:55:37.707 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION="8" 2022-05-18T11:55:37.707 INFO:teuthology.orchestra.run.smithi166.stdout:ID="centos" 2022-05-18T11:55:37.707 INFO:teuthology.orchestra.run.smithi166.stdout:ID_LIKE="rhel fedora" 2022-05-18T11:55:37.707 INFO:teuthology.orchestra.run.smithi166.stdout:VERSION_ID="8" 2022-05-18T11:55:37.708 INFO:teuthology.orchestra.run.smithi166.stdout:PLATFORM_ID="platform:el8" 2022-05-18T11:55:37.708 INFO:teuthology.orchestra.run.smithi166.stdout:PRETTY_NAME="CentOS Stream 8" 2022-05-18T11:55:37.708 INFO:teuthology.orchestra.run.smithi166.stdout:ANSI_COLOR="0;31" 2022-05-18T11:55:37.708 INFO:teuthology.orchestra.run.smithi166.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-05-18T11:55:37.708 INFO:teuthology.orchestra.run.smithi166.stdout:HOME_URL="https://centos.org/" 2022-05-18T11:55:37.709 INFO:teuthology.orchestra.run.smithi166.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-05-18T11:55:37.709 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-05-18T11:55:37.709 INFO:teuthology.orchestra.run.smithi166.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-05-18T11:55:37.710 INFO:teuthology.lock.ops:Updating smithi166.front.sepia.ceph.com on lock server 2022-05-18T11:55:37.862 INFO:teuthology.dispatcher.supervisor:Running job 6837888 2022-05-18T11:55:37.862 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/bin/teuthology -v --owner scheduled_amathuri@teuthology --archive /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837888 --name amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi --description rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} -- /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837888/orig.config.yaml 2022-05-18T11:55:37.868 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/amathuri-2022-05-17_05:46:36-rados-wip-yuri3-testing-2022-04-22-0534-quincy-distro-default-smithi/6837888 2022-05-18T11:55:37.869 INFO:teuthology.dispatcher.supervisor:Job PID: 27458 2022-05-18T11:55:37.869 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2022-05-18T18:25:50.147 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 23400s. Killing... 2022-05-18T18:25:50.359 INFO:teuthology.kill:Killing Pids: {27458} 2022-05-18T18:25:51.957 INFO:teuthology.task.internal:roles: ubuntu@smithi158.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-05-18T18:25:51.958 INFO:teuthology.task.internal:roles: ubuntu@smithi166.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-05-18T18:25:51.959 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:25:51.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi158.front.sepia.ceph.com' 2022-05-18T18:25:52.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi166.front.sepia.ceph.com' 2022-05-18T18:25:52.496 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:25:52.916 INFO:teuthology.orchestra.run.smithi166.stderr:gzip: /home/ubuntu/cephtest/archive/syslog/misc.log: file size changed while zipping 2022-05-18T18:25:53.169 INFO:teuthology.misc:Compressing logs... 2022-05-18T18:27:27.608 INFO:teuthology.kill:No teuthology processes running 2022-05-18T18:27:29.394 INFO:teuthology.kill:Nuking machines: ['smithi158'] 2022-05-18T18:27:30.942 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.6 is no longer supported by the Python core team. Therefore, support for it is deprecated in cryptography and will be removed in a future release. 2022-05-18T18:27:30.943 INFO:teuthology.kill: from cryptography.hazmat.backends import default_backend 2022-05-18T18:27:30.944 INFO:teuthology.kill:/home/teuthworker/src/git.ceph.com_git_teuthology_b018fa018d3f885cbc018f839b42536477653f84/virtualenv/lib/python3.6/site-packages/paramiko/transport.py:236: CryptographyDeprecationWarning: Blowfish has been deprecated 2022-05-18T18:27:30.944 INFO:teuthology.kill: "class": algorithms.Blowfish, 2022-05-18T18:27:30.944 INFO:teuthology.kill:2022-05-18 18:27:30,942.942 INFO:teuthology.nuke:targets: 2022-05-18T18:27:30.944 INFO:teuthology.kill: smithi158.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQClRtNsivqD7mSYkdGyqYZrFFfkdzoHj7KqU/z1sOO6Xf1SnSSSgoqB5nzRMBursTsFpKgRIBVPA6sef0xkxvc/CQNMwLmqpOdn/qchqEOCh48hwabJmJavKvVbkta383m2mRXXZHYJ2GXQVmg+TcdqwzCYnDoagooBa/fJBuYNrkFn61k7oHfwlkSMeuhAo2eaFjYlmVUi0mbOUpgQafu5J/AKud6xvZstNz/pSVlvyTbN8ZLdwoEgd1T5UErt+09A108IaGQH25qHooogwoTGRAaaUhP2J0IKEinMKdGOugbYONvM2urk/UiVb/sDGLfP9Ke7w7bAWM0MzsEt713HdCdJxFF2eYNKybZGxPmCyz6G4VK1vVwoIoDajtsAy6rkbCSTcWelYf11suscV2tM85SfEn0aP4TimopRnz0xo3jFppw3+E2Ug8Yusp076K2xJwB2JoUl7RbUiq6EKuaBBdOzB7eBGbgeNhi2wLY0sW/WBVuBqfYNhga5yC0TVVE= 2022-05-18T18:27:30.984 INFO:teuthology.kill:2022-05-18 18:27:30,982.982 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-05-18T18:27:31.097 INFO:teuthology.kill:2022-05-18 18:27:31,095.095 INFO:teuthology.orchestra.console:Power off smithi158 2022-05-18T18:27:39.482 INFO:teuthology.kill:2022-05-18 18:27:39,482.482 INFO:teuthology.orchestra.console:Power off for smithi158 completed 2022-05-18T18:27:39.641 INFO:teuthology.kill:2022-05-18 18:27:39,640.640 INFO:teuthology.lock.ops:unlocked: smithi158.front.sepia.ceph.com 2022-05-18T18:29:39.916 ERROR:teuthology.dispatcher.supervisor:Child exited with code -15 2022-05-18T18:29:40.090 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi158 but it was locked by another job: /home/teuthworker/archive/cbodley-2022-05-18_17:53:50-rgw-wip-cbodley-testing-distro-default-smithi/6840361 2022-05-18T18:29:40.091 INFO:teuthology.dispatcher.supervisor:Nuking machines... 2022-05-18T18:29:40.091 INFO:teuthology.nuke:Checking targets against current locks 2022-05-18T18:29:40.207 INFO:teuthology.nuke:Not nuking smithi158.front.sepia.ceph.com because description doesn't match 2022-05-18T18:29:40.208 INFO:teuthology.nuke:Not nuking smithi166.front.sepia.ceph.com because it is down