2023-01-15T05:09:42.402 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-15T05:09:42.592 INFO:teuthology.lock.ops:Start node 'smithi132.front.sepia.ceph.com' reimaging 2023-01-15T05:09:42.593 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: reset os type and version on server 2023-01-15T05:09:42.594 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-01-15T05:09:42.608 INFO:teuthology.lock.ops:Node 'smithi132.front.sepia.ceph.com' reimaging is complete 2023-01-15T05:09:42.608 INFO:teuthology.lock.ops:Start node 'smithi149.front.sepia.ceph.com' reimaging 2023-01-15T05:09:42.609 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: reset os type and version on server 2023-01-15T05:09:42.609 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-01-15T05:09:42.623 INFO:teuthology.lock.ops:Node 'smithi149.front.sepia.ceph.com' reimaging is complete 2023-01-15T05:09:42.624 INFO:teuthology.lock.ops:Start node 'smithi176.front.sepia.ceph.com' reimaging 2023-01-15T05:09:42.624 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: reset os type and version on server 2023-01-15T05:09:42.624 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-01-15T05:09:42.639 INFO:teuthology.lock.ops:Node 'smithi176.front.sepia.ceph.com' reimaging is complete 2023-01-15T05:09:42.639 INFO:teuthology.lock.ops:Start node 'smithi191.front.sepia.ceph.com' reimaging 2023-01-15T05:09:42.639 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: reset os type and version on server 2023-01-15T05:09:42.640 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-01-15T05:09:42.654 INFO:teuthology.lock.ops:Node 'smithi191.front.sepia.ceph.com' reimaging is complete 2023-01-15T05:09:42.769 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of ubuntu 20.04 2023-01-15T05:09:42.784 INFO:teuthology.provision.fog.smithi176:Scheduling deploy of ubuntu 20.04 2023-01-15T05:09:42.808 INFO:teuthology.provision.fog.smithi191:Scheduling deploy of ubuntu 20.04 2023-01-15T05:09:42.810 INFO:teuthology.provision.fog.smithi149:Scheduling deploy of ubuntu 20.04 2023-01-15T05:09:43.023 INFO:teuthology.orchestra.console:Power off smithi132 2023-01-15T05:09:43.085 INFO:teuthology.orchestra.console:Power off smithi176 2023-01-15T05:09:43.102 INFO:teuthology.orchestra.console:Power off smithi149 2023-01-15T05:09:43.115 INFO:teuthology.orchestra.console:Power off smithi191 2023-01-15T05:09:43.165 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-01-15T05:09:43.248 INFO:teuthology.orchestra.console:Power off for smithi149 completed 2023-01-15T05:09:43.253 INFO:teuthology.orchestra.console:Power off for smithi176 completed 2023-01-15T05:09:43.259 INFO:teuthology.orchestra.console:Power off for smithi191 completed 2023-01-15T05:09:43.267 INFO:teuthology.orchestra.console:Power on smithi132 2023-01-15T05:09:43.350 INFO:teuthology.orchestra.console:Power on smithi149 2023-01-15T05:09:43.357 INFO:teuthology.orchestra.console:Power on smithi176 2023-01-15T05:09:43.364 INFO:teuthology.orchestra.console:Power on smithi191 2023-01-15T05:09:47.523 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2023-01-15T05:09:47.616 INFO:teuthology.orchestra.console:Power on for smithi176 completed 2023-01-15T05:09:47.624 INFO:teuthology.orchestra.console:Power on for smithi191 completed 2023-01-15T05:09:47.624 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2023-01-15T05:09:47.718 INFO:teuthology.provision.fog.smithi176:Waiting for deploy to finish 2023-01-15T05:09:47.725 INFO:teuthology.provision.fog.smithi191:Waiting for deploy to finish 2023-01-15T05:09:51.723 INFO:teuthology.orchestra.console:Power on for smithi149 completed 2023-01-15T05:09:51.824 INFO:teuthology.provision.fog.smithi149:Waiting for deploy to finish 2023-01-15T05:13:18.818 ERROR:teuthology.orchestra.connection:Error authenticating with smithi132.front.sepia.ceph.com: Authentication failed. 2023-01-15T05:13:19.018 ERROR:teuthology.orchestra.connection:Error authenticating with smithi176.front.sepia.ceph.com: Authentication failed. 2023-01-15T05:13:38.256 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-01-15T05:13:47.308 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-01-15T05:13:52.332 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-01-15T05:13:56.364 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-01-15T05:13:56.428 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-15T05:14:01.388 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-01-15T05:14:05.420 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-01-15T05:14:05.484 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-15T05:14:10.444 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-01-15T05:14:14.476 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-01-15T05:14:14.540 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-15T05:14:19.500 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-01-15T05:14:20.021 WARNING:teuthology.provision.fog:timed out 2023-01-15T05:14:23.596 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-15T05:14:28.556 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.191 2023-01-15T05:14:32.652 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.149 2023-01-15T05:14:44.556 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.176 2023-01-15T05:14:51.792 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-15T05:14:52.664 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-15T05:15:13.602 INFO:teuthology.provision.fog.smithi132:Node is ready 2023-01-15T05:15:13.610 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2023-01-15T05:15:13.660 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2023-01-15T05:15:13.711 INFO:teuthology.provision.fog.smithi176:Node is ready 2023-01-15T05:15:13.718 INFO:teuthology.orchestra.run.smithi176.stdout:smithi176.front.sepia.ceph.com 2023-01-15T05:15:13.726 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.15.176 smithi176.front.sepia.ceph.com smithi176 2023-01-15T05:15:13.847 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2023-01-15T05:15:13.944 INFO:teuthology.provision.fog.smithi176:Deploy complete! 2023-01-15T05:15:34.560 WARNING:teuthology.provision.fog:timed out 2023-01-15T05:15:38.655 WARNING:teuthology.provision.fog:timed out 2023-01-15T05:15:40.773 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-15T05:15:41.231 INFO:teuthology.provision.fog.smithi191:Node is ready 2023-01-15T05:15:41.238 INFO:teuthology.orchestra.run.smithi191.stdout:smithi191.front.sepia.ceph.com 2023-01-15T05:15:41.286 INFO:teuthology.orchestra.run.smithi191.stdout:172.21.15.191 smithi191.front.sepia.ceph.com smithi191 2023-01-15T05:15:41.415 INFO:teuthology.provision.fog.smithi191:Deploy complete! 2023-01-15T05:15:44.869 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-01-15T05:15:45.375 INFO:teuthology.provision.fog.smithi149:Node is ready 2023-01-15T05:15:45.382 INFO:teuthology.orchestra.run.smithi149.stdout:smithi149.front.sepia.ceph.com 2023-01-15T05:15:45.389 INFO:teuthology.orchestra.run.smithi149.stdout:172.21.15.149 smithi149.front.sepia.ceph.com smithi149 2023-01-15T05:15:45.582 INFO:teuthology.provision.fog.smithi149:Deploy complete! 2023-01-15T05:15:45.970 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2023-01-15T05:15:45.971 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-15T05:15:46.000 INFO:teuthology.lock.ops:Checking smithi149.front.sepia.ceph.com 2023-01-15T05:15:46.001 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-15T05:15:46.020 INFO:teuthology.lock.ops:Checking smithi176.front.sepia.ceph.com 2023-01-15T05:15:46.020 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-15T05:15:46.039 INFO:teuthology.lock.ops:Checking smithi191.front.sepia.ceph.com 2023-01-15T05:15:46.039 INFO:teuthology.lock.ops:New key found. Updating... 2023-01-15T05:15:46.061 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2023-01-15T05:15:46.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-01-15T05:15:46.239 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-01-15T05:15:46.245 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2023-01-15T05:15:46.245 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-15T05:15:46.245 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2023-01-15T05:15:46.245 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2023-01-15T05:15:46.246 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-15T05:15:46.246 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="20.04" 2023-01-15T05:15:46.246 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-15T05:15:46.246 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-15T05:15:46.246 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-15T05:15:46.247 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-15T05:15:46.247 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=focal 2023-01-15T05:15:46.247 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=focal 2023-01-15T05:15:46.248 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-01-15T05:15:46.271 INFO:teuthology.lock.ops:Updating [smithi149.front.sepia.ceph.com]: set os type and version on server 2023-01-15T05:15:46.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi149.front.sepia.ceph.com' 2023-01-15T05:15:46.448 INFO:teuthology.orchestra.run.smithi149.stdout:x86_64 2023-01-15T05:15:46.454 INFO:teuthology.orchestra.run.smithi149.stdout:NAME="Ubuntu" 2023-01-15T05:15:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-15T05:15:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:ID=ubuntu 2023-01-15T05:15:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:ID_LIKE=debian 2023-01-15T05:15:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-15T05:15:46.455 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_ID="20.04" 2023-01-15T05:15:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-15T05:15:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-15T05:15:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-15T05:15:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-15T05:15:46.456 INFO:teuthology.orchestra.run.smithi149.stdout:VERSION_CODENAME=focal 2023-01-15T05:15:46.457 INFO:teuthology.orchestra.run.smithi149.stdout:UBUNTU_CODENAME=focal 2023-01-15T05:15:46.457 INFO:teuthology.lock.ops:Updating smithi149.front.sepia.ceph.com on lock server 2023-01-15T05:15:46.478 INFO:teuthology.lock.ops:Updating [smithi176.front.sepia.ceph.com]: set os type and version on server 2023-01-15T05:15:46.478 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-01-15T05:15:46.731 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-01-15T05:15:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Ubuntu" 2023-01-15T05:15:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-15T05:15:46.738 INFO:teuthology.orchestra.run.smithi176.stdout:ID=ubuntu 2023-01-15T05:15:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE=debian 2023-01-15T05:15:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-15T05:15:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="20.04" 2023-01-15T05:15:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-15T05:15:46.739 INFO:teuthology.orchestra.run.smithi176.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-15T05:15:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-15T05:15:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-15T05:15:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_CODENAME=focal 2023-01-15T05:15:46.740 INFO:teuthology.orchestra.run.smithi176.stdout:UBUNTU_CODENAME=focal 2023-01-15T05:15:46.741 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-01-15T05:15:46.762 INFO:teuthology.lock.ops:Updating [smithi191.front.sepia.ceph.com]: set os type and version on server 2023-01-15T05:15:46.762 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi191.front.sepia.ceph.com' 2023-01-15T05:15:46.936 INFO:teuthology.orchestra.run.smithi191.stdout:x86_64 2023-01-15T05:15:46.942 INFO:teuthology.orchestra.run.smithi191.stdout:NAME="Ubuntu" 2023-01-15T05:15:46.942 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-01-15T05:15:46.942 INFO:teuthology.orchestra.run.smithi191.stdout:ID=ubuntu 2023-01-15T05:15:46.942 INFO:teuthology.orchestra.run.smithi191.stdout:ID_LIKE=debian 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_ID="20.04" 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:HOME_URL="https://www.ubuntu.com/" 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-01-15T05:15:46.943 INFO:teuthology.orchestra.run.smithi191.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-01-15T05:15:46.944 INFO:teuthology.orchestra.run.smithi191.stdout:VERSION_CODENAME=focal 2023-01-15T05:15:46.944 INFO:teuthology.orchestra.run.smithi191.stdout:UBUNTU_CODENAME=focal 2023-01-15T05:15:46.944 INFO:teuthology.lock.ops:Updating smithi191.front.sepia.ceph.com on lock server 2023-01-15T05:15:47.038 INFO:teuthology.dispatcher.supervisor:Running job 7142422 2023-01-15T05:15:47.039 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_19d18db866afdc31fd6586f558fc29b95a87ccfb/virtualenv/bin/teuthology -v --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142422 --name yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cephfs_misc_tests} -- /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142422/orig.config.yaml 2023-01-15T05:15:47.044 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuriw-2023-01-14_16:40:39-fs-pacific_16.2.11_RC6.6-distro-default-smithi/7142422 2023-01-15T05:15:47.045 INFO:teuthology.dispatcher.supervisor:Job PID: 28227 2023-01-15T05:15:47.045 INFO:teuthology.dispatcher.supervisor:Running with watchdog