2023-04-25T05:05:37.799 INFO:root:teuthology version: 0.0.1.dev96+g8d156ae 2023-04-25T05:05:37.941 INFO:teuthology.lock.ops:Start node 'smithi111.front.sepia.ceph.com' reimaging 2023-04-25T05:05:37.942 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: reset os type and version on server 2023-04-25T05:05:37.942 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-04-25T05:05:37.964 INFO:teuthology.lock.ops:Node 'smithi111.front.sepia.ceph.com' reimaging is complete 2023-04-25T05:05:37.965 INFO:teuthology.lock.ops:Start node 'smithi122.front.sepia.ceph.com' reimaging 2023-04-25T05:05:37.965 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: reset os type and version on server 2023-04-25T05:05:37.965 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-04-25T05:05:37.989 INFO:teuthology.lock.ops:Node 'smithi122.front.sepia.ceph.com' reimaging is complete 2023-04-25T05:05:38.126 INFO:teuthology.provision.fog.smithi111:Scheduling deploy of ubuntu 22.04 2023-04-25T05:05:38.158 INFO:teuthology.provision.fog.smithi122:Scheduling deploy of ubuntu 22.04 2023-04-25T05:05:38.427 INFO:teuthology.orchestra.console:Power off smithi111 2023-04-25T05:05:38.443 INFO:teuthology.orchestra.console:Power off smithi122 2023-04-25T05:05:46.812 INFO:teuthology.orchestra.console:Power off for smithi122 completed 2023-04-25T05:05:46.914 INFO:teuthology.orchestra.console:Power on smithi122 2023-04-25T05:05:50.919 INFO:teuthology.orchestra.console:Power off for smithi111 completed 2023-04-25T05:05:51.021 INFO:teuthology.orchestra.console:Power on smithi111 2023-04-25T05:05:55.286 INFO:teuthology.orchestra.console:Power on for smithi122 completed 2023-04-25T05:05:55.387 INFO:teuthology.provision.fog.smithi122:Waiting for deploy to finish 2023-04-25T05:05:59.391 INFO:teuthology.orchestra.console:Power on for smithi111 completed 2023-04-25T05:05:59.492 INFO:teuthology.provision.fog.smithi111:Waiting for deploy to finish 2023-04-25T05:09:14.373 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:09:23.429 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:09:32.485 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:09:33.413 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:09:41.541 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:09:42.469 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:09:50.601 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:09:51.525 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:09:59.689 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:10:00.581 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:10:09.637 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:10:18.693 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:10:24.261 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:10:27.749 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.111 2023-04-25T05:10:33.317 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:10:42.373 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:10:48.380 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:10:54.388 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:11:00.394 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:11:06.402 WARNING:teuthology.provision.fog:[Errno None] Unable to connect to port 22 on 172.21.15.122 2023-04-25T05:11:12.630 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-25T05:11:13.103 INFO:teuthology.provision.fog.smithi122:Node is ready 2023-04-25T05:11:13.148 INFO:teuthology.orchestra.run.smithi122.stdout:smithi122.front.sepia.ceph.com 2023-04-25T05:11:13.197 INFO:teuthology.orchestra.run.smithi122.stdout:172.21.15.122 smithi122.front.sepia.ceph.com smithi122 2023-04-25T05:11:13.535 INFO:teuthology.provision.fog.smithi122:Deploy complete! 2023-04-25T05:11:33.769 WARNING:teuthology.provision.fog:timed out 2023-04-25T05:11:39.946 INFO:teuthology.orchestra.run:Running command with timeout 600 2023-04-25T05:11:40.353 INFO:teuthology.provision.fog.smithi111:Node is ready 2023-04-25T05:11:40.398 INFO:teuthology.orchestra.run.smithi111.stdout:smithi111.front.sepia.ceph.com 2023-04-25T05:11:40.447 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111 smithi111.front.sepia.ceph.com smithi111 2023-04-25T05:11:40.749 INFO:teuthology.provision.fog.smithi111:Deploy complete! 2023-04-25T05:11:40.940 INFO:teuthology.lock.ops:Checking smithi111.front.sepia.ceph.com 2023-04-25T05:11:40.940 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-25T05:11:40.968 INFO:teuthology.lock.ops:Checking smithi122.front.sepia.ceph.com 2023-04-25T05:11:40.968 INFO:teuthology.lock.ops:New key found. Updating... 2023-04-25T05:11:40.995 INFO:teuthology.lock.ops:Updating [smithi111.front.sepia.ceph.com]: set os type and version on server 2023-04-25T05:11:40.995 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-04-25T05:11:41.213 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2023-04-25T05:11:41.258 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-04-25T05:11:41.259 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2023-04-25T05:11:41.260 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2023-04-25T05:11:41.294 INFO:teuthology.lock.ops:Updating [smithi122.front.sepia.ceph.com]: set os type and version on server 2023-04-25T05:11:41.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com' 2023-04-25T05:11:41.631 INFO:teuthology.orchestra.run.smithi122.stdout:x86_64 2023-04-25T05:11:41.680 INFO:teuthology.orchestra.run.smithi122.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-04-25T05:11:41.680 INFO:teuthology.orchestra.run.smithi122.stdout:NAME="Ubuntu" 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_ID="22.04" 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:VERSION_CODENAME=jammy 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:ID=ubuntu 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:ID_LIKE=debian 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:HOME_URL="https://www.ubuntu.com/" 2023-04-25T05:11:41.681 INFO:teuthology.orchestra.run.smithi122.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-04-25T05:11:41.682 INFO:teuthology.orchestra.run.smithi122.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-04-25T05:11:41.682 INFO:teuthology.orchestra.run.smithi122.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-04-25T05:11:41.682 INFO:teuthology.orchestra.run.smithi122.stdout:UBUNTU_CODENAME=jammy 2023-04-25T05:11:41.682 INFO:teuthology.lock.ops:Updating smithi122.front.sepia.ceph.com on lock server 2023-04-25T05:11:41.792 INFO:teuthology.dispatcher.supervisor:Running job 7250722 2023-04-25T05:11:41.792 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/virtualenv/bin/teuthology -v --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-04-25_04:09:41-fs-wip-vshankar-testing-20230420.132447-testing-default-smithi/7250722 --name vshankar-2023-04-25_04:09:41-fs-wip-vshankar-testing-20230420.132447-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-04-25_04:09:41-fs-wip-vshankar-testing-20230420.132447-testing-default-smithi/7250722/orig.config.yaml 2023-04-25T05:11:41.796 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/vshankar-2023-04-25_04:09:41-fs-wip-vshankar-testing-20230420.132447-testing-default-smithi/7250722 2023-04-25T05:11:41.797 INFO:teuthology.dispatcher.supervisor:Job PID: 11594 2023-04-25T05:11:41.797 INFO:teuthology.dispatcher.supervisor:Running with watchdog 2023-04-25T17:12:39.494 WARNING:teuthology.dispatcher.supervisor:Job ran longer than 43200s. Killing... 2023-04-25T17:12:39.652 INFO:teuthology.kill:Killing Pids: {11594} 2023-04-25T17:12:40.540 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-04-25T17:12:40.542 INFO:teuthology.task.internal:roles: ubuntu@smithi122.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-04-25T17:12:40.542 INFO:teuthology.misc:Compressing logs... 2023-04-25T17:12:40.542 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2023-04-25T17:12:41.017 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi122.front.sepia.ceph.com'