2024-02-01T10:16:53.407 INFO:root:teuthology version: 0.0.1.dev253+g6128cc3
2024-02-01T10:16:53.407 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:16:53.516 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2ea4135f40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2ea519bc10>, signals=[15])
2024-02-01T10:16:53.517 INFO:teuthology.lock.ops:Start node 'smithi081.front.sepia.ceph.com' reimaging
2024-02-01T10:16:53.517 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: reset os type and version on server
2024-02-01T10:16:53.517 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-02-01T10:16:53.661 DEBUG:teuthology.provision.fog.smithi081:Requesting image smithi_centos_8.stream (ID 3)
2024-02-01T10:16:53.712 INFO:teuthology.provision.fog.smithi081:Scheduling deploy of centos 8.stream
2024-02-01T10:16:53.992 INFO:teuthology.orchestra.console.smithi081:Power off
2024-02-01T10:16:53.992 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-01T10:16:54.014 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off
2024-02-01T10:16:54.015 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-01T10:16:54.036 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-02-01T10:16:54.136 INFO:teuthology.orchestra.console.smithi081:Power off completed
2024-02-01T10:16:54.237 INFO:teuthology.orchestra.console.smithi081:Power on
2024-02-01T10:16:54.237 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-01T10:16:54.260 DEBUG:teuthology.orchestra.console.smithi081:power on output: Chassis Power Control: Up/On
2024-02-01T10:16:54.260 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-01T10:16:54.282 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-02-01T10:16:58.286 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-01T10:16:58.395 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off
2024-02-01T10:17:02.399 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-01T10:17:02.507 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on
2024-02-01T10:17:02.609 INFO:teuthology.orchestra.console.smithi081:Power on completed
2024-02-01T10:17:02.709 INFO:teuthology.provision.fog.smithi081:Waiting for deploy to finish
2024-02-01T10:19:48.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:19:51.868 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:19:57.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:20:00.956 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:20:06.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:20:10.012 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:20:16.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:20:19.072 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:20:25.076 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:20:28.160 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:20:34.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:20:37.244 WARNING:teuthology.provision.fog.smithi081:[Errno None] Unable to connect to port 22 on 172.21.15.81
2024-02-01T10:20:43.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:21:43.309 WARNING:teuthology.provision.fog.smithi081:timed out
2024-02-01T10:21:49.316 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:21:49.583 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-01T10:21:49.584 DEBUG:teuthology.orchestra.run.smithi081:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-01T10:21:49.859 INFO:teuthology.provision.fog.smithi081:Node is ready
2024-02-01T10:21:49.860 DEBUG:teuthology.orchestra.run.smithi081:> hostname
2024-02-01T10:21:49.879 INFO:teuthology.orchestra.run.smithi081.stdout:smithi081.front.sepia.ceph.com
2024-02-01T10:21:49.879 DEBUG:teuthology.orchestra.run.smithi081:> grep smithi081.front.sepia.ceph.com /etc/hosts
2024-02-01T10:21:49.938 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.81 smithi081.front.sepia.ceph.com smithi081
2024-02-01T10:21:49.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-02-01T10:21:50.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hosts
2024-02-01T10:21:50.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/172.21.15.81/172.21.15.81/g' /etc/hosts
2024-02-01T10:21:50.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i -e 's/smithi081.front.sepia.ceph.com/smithi081/g' /etc/hostname
2024-02-01T10:21:50.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo hostname smithi081
2024-02-01T10:21:50.270 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-02-01T10:21:50.329 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-02-01T10:21:50.329 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-01T10:21:50.330 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-02-01T10:21:50.331 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-01T10:21:50.331 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-01T10:21:50.331 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-01T10:21:50.331 INFO:teuthology.provision.fog.smithi081:Deploy complete!
2024-02-01T10:21:50.333 DEBUG:teuthology.parallel:result is None
2024-02-01T10:21:50.445 INFO:teuthology.lock.ops:Checking smithi081.front.sepia.ceph.com
2024-02-01T10:21:50.446 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-01T10:21:50.486 INFO:teuthology.lock.ops:Updating [smithi081.front.sepia.ceph.com]: set os type and version on server
2024-02-01T10:21:50.486 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-02-01T10:21:50.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-01T10:21:50.563 DEBUG:teuthology.orchestra.run.smithi081:> true
2024-02-01T10:21:50.630 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com'
2024-02-01T10:21:50.631 DEBUG:teuthology.orchestra.run.smithi081:> uname -m
2024-02-01T10:21:50.688 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64
2024-02-01T10:21:50.688 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release
2024-02-01T10:21:50.746 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream"
2024-02-01T10:21:50.746 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="8"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="8"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el8"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 8"
2024-02-01T10:21:50.747 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31"
2024-02-01T10:21:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:8"
2024-02-01T10:21:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/"
2024-02-01T10:21:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-01T10:21:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
2024-02-01T10:21:50.748 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-01T10:21:50.749 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server
2024-02-01T10:21:50.775 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:21:50.873 INFO:teuthology.dispatcher.supervisor:Running job 7537633
2024-02-01T10:21:50.873 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_6128cc3ecb49b7d62475e3595041c19b5326ca7c/virtualenv/bin/teuthology -v --owner scheduled_yuvalif@teuthology --archive /home/teuthworker/archive/yuvalif-2024-01-30_09:23:29-fs:upgrade-wip-end2end-tracing-distro-default-smithi/7537633 --name yuvalif-2024-01-30_09:23:29-fs:upgrade-wip-end2end-tracing-distro-default-smithi --description fs:upgrade/nofs/{bluestore-bitmap centos_8.stream conf/{client mds mon osd} no-mds-cluster overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} tasks/{0-pacific 1-upgrade}} -- /home/teuthworker/archive/yuvalif-2024-01-30_09:23:29-fs:upgrade-wip-end2end-tracing-distro-default-smithi/7537633/orig.config.yaml
2024-02-01T10:21:50.877 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/yuvalif-2024-01-30_09:23:29-fs:upgrade-wip-end2end-tracing-distro-default-smithi/7537633
2024-02-01T10:21:50.877 INFO:teuthology.dispatcher.supervisor:Job PID: 70483
2024-02-01T10:21:50.877 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-01T10:23:50.977 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:25:51.156 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:27:51.336 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:29:51.508 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:31:51.677 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:33:51.841 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:35:52.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:37:52.180 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:39:52.349 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:41:52.520 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:43:52.700 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-01T10:43:52.761 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1