2024-02-22T06:41:39.853 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-22T06:41:39.854 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:41:39.987 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f31a495cf10>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f31a59bdc10>, signals=[15])
2024-02-22T06:41:39.987 INFO:teuthology.lock.ops:Start node 'smithi181.front.sepia.ceph.com' reimaging
2024-02-22T06:41:39.988 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: reset os type and version on server
2024-02-22T06:41:39.988 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-02-22T06:41:40.169 DEBUG:teuthology.provision.fog.smithi181:Requesting image smithi_centos_9.stream (ID 10)
2024-02-22T06:41:40.224 INFO:teuthology.provision.fog.smithi181:Scheduling deploy of centos 9.stream
2024-02-22T06:41:40.496 INFO:teuthology.orchestra.console.smithi181:Power off
2024-02-22T06:41:40.496 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-22T06:41:40.533 DEBUG:teuthology.orchestra.console.smithi181:power off output: Chassis Power Control: Down/Off
2024-02-22T06:41:40.534 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:41:40.570 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-02-22T06:41:40.671 INFO:teuthology.orchestra.console.smithi181:Power off completed
2024-02-22T06:41:40.771 INFO:teuthology.orchestra.console.smithi181:Power on
2024-02-22T06:41:40.772 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-22T06:41:40.805 DEBUG:teuthology.orchestra.console.smithi181:power on output: Chassis Power Control: Up/On
2024-02-22T06:41:40.805 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:41:40.840 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-02-22T06:41:44.844 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:41:44.955 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is off
2024-02-22T06:41:48.956 DEBUG:teuthology.orchestra.console.smithi181:pexpect command: ipmitool -H smithi181.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:41:49.150 DEBUG:teuthology.orchestra.console.smithi181:check power output: Chassis Power is on
2024-02-22T06:41:49.251 INFO:teuthology.orchestra.console.smithi181:Power on completed
2024-02-22T06:41:49.352 INFO:teuthology.provision.fog.smithi181:Waiting for deploy to finish
2024-02-22T06:44:20.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:44:23.356 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:44:29.363 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:44:32.480 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:44:38.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:44:41.564 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:44:47.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:44:50.652 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:44:56.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:44:59.740 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:45:05.745 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:45:08.828 WARNING:teuthology.provision.fog.smithi181:[Errno None] Unable to connect to port 22 on 172.21.15.181
2024-02-22T06:45:14.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:46:14.925 WARNING:teuthology.provision.fog.smithi181:timed out
2024-02-22T06:46:20.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:46:21.240 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-22T06:46:21.241 DEBUG:teuthology.orchestra.run.smithi181:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-22T06:46:21.554 INFO:teuthology.provision.fog.smithi181:Node is ready
2024-02-22T06:46:21.555 DEBUG:teuthology.orchestra.run.smithi181:> hostname
2024-02-22T06:46:21.610 INFO:teuthology.orchestra.run.smithi181.stdout:smithi181.front.sepia.ceph.com
2024-02-22T06:46:21.610 DEBUG:teuthology.orchestra.run.smithi181:> grep smithi181.front.sepia.ceph.com /etc/hosts
2024-02-22T06:46:21.665 INFO:teuthology.orchestra.run.smithi181.stdout:172.21.15.181 smithi181.front.sepia.ceph.com smithi181
2024-02-22T06:46:21.665 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-02-22T06:46:21.789 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hosts
2024-02-22T06:46:21.817 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/172.21.15.181/172.21.15.181/g' /etc/hosts
2024-02-22T06:46:21.884 DEBUG:teuthology.orchestra.run.smithi181:> sudo sed -i -e 's/smithi181.front.sepia.ceph.com/smithi181/g' /etc/hostname
2024-02-22T06:46:21.949 DEBUG:teuthology.orchestra.run.smithi181:> sudo hostname smithi181
2024-02-22T06:46:22.014 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-02-22T06:46:22.067 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2024-02-22T06:46:22.067 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9"
2024-02-22T06:46:22.067 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-22T06:46:22.068 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-22T06:46:22.069 INFO:teuthology.provision.fog.smithi181:Deploy complete!
2024-02-22T06:46:22.070 DEBUG:teuthology.parallel:result is None
2024-02-22T06:46:22.253 INFO:teuthology.lock.ops:Checking smithi181.front.sepia.ceph.com
2024-02-22T06:46:22.254 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-22T06:46:22.290 INFO:teuthology.lock.ops:Updating [smithi181.front.sepia.ceph.com]: set os type and version on server
2024-02-22T06:46:22.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-02-22T06:46:22.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi181.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:46:22.390 DEBUG:teuthology.orchestra.run.smithi181:> true
2024-02-22T06:46:22.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi181.front.sepia.ceph.com'
2024-02-22T06:46:22.454 DEBUG:teuthology.orchestra.run.smithi181:> uname -m
2024-02-22T06:46:22.507 INFO:teuthology.orchestra.run.smithi181.stdout:x86_64
2024-02-22T06:46:22.507 DEBUG:teuthology.orchestra.run.smithi181:> cat /etc/os-release
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:NAME="CentOS Stream"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION="9"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:ID="centos"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:ID_LIKE="rhel fedora"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:VERSION_ID="9"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:PLATFORM_ID="platform:el9"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:ANSI_COLOR="0;31"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:LOGO="fedora-logo-icon"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-22T06:46:22.560 INFO:teuthology.orchestra.run.smithi181.stdout:HOME_URL="https://centos.org/"
2024-02-22T06:46:22.561 INFO:teuthology.orchestra.run.smithi181.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-22T06:46:22.561 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-22T06:46:22.561 INFO:teuthology.orchestra.run.smithi181.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-22T06:46:22.561 INFO:teuthology.lock.ops:Updating smithi181.front.sepia.ceph.com on lock server
2024-02-22T06:46:22.597 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:46:22.712 INFO:teuthology.dispatcher.supervisor:Running job 7570722
2024-02-22T06:46:22.712 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570722 --name jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570722/orig.config.yaml
2024-02-22T06:46:22.715 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570722
2024-02-22T06:46:22.715 INFO:teuthology.dispatcher.supervisor:Job PID: 4190574
2024-02-22T06:46:22.715 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-22T06:48:22.809 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:50:22.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:52:23.190 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:54:23.377 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:56:23.566 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:58:23.747 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:00:23.965 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:02:24.148 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:04:24.296 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:06:24.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:08:24.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:10:24.838 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:12:24.991 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:14:25.157 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:16:25.333 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:18:25.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:20:25.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:22:25.886 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:24:26.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:26:26.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:28:26.398 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:30:26.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:32:26.764 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:34:26.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:36:27.115 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:38:27.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:40:27.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:42:27.650 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:44:27.830 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:46:28.009 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:48:28.193 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:50:28.381 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:52:28.678 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:54:28.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:56:29.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:58:29.223 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:00:29.406 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:02:29.587 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:04:29.757 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:06:29.898 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:08:30.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:10:30.273 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:12:30.455 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:14:30.645 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:16:30.816 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:18:30.998 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:20:31.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:22:31.342 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:24:31.513 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:26:31.691 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:26:31.763 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-22T08:26:31.878 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi181 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-02-22_02:25:13-upgrade:reef-x-main-distro-default-smithi/7570574