2024-02-22T06:26:04.450 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55
2024-02-22T06:26:04.450 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:26:04.582 DEBUG:teuthology.exit:Installing handler: Handler(exiter=<teuthology.exit.Exiter object at 0x7f2ba29dff40>, func=<function ConsoleLog.start_logging.<locals>.kill_console_loggers at 0x7f2ba3940c10>, signals=[15])
2024-02-22T06:26:04.582 INFO:teuthology.lock.ops:Start node 'smithi150.front.sepia.ceph.com' reimaging
2024-02-22T06:26:04.583 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: reset os type and version on server
2024-02-22T06:26:04.583 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-02-22T06:26:04.766 DEBUG:teuthology.provision.fog.smithi150:Requesting image smithi_centos_9.stream (ID 10)
2024-02-22T06:26:04.832 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of centos 9.stream
2024-02-22T06:26:05.119 INFO:teuthology.orchestra.console.smithi150:Power off
2024-02-22T06:26:05.120 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off
2024-02-22T06:26:05.152 DEBUG:teuthology.orchestra.console.smithi150:power off output: Chassis Power Control: Down/Off
2024-02-22T06:26:05.152 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:26:05.202 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-02-22T06:26:05.303 INFO:teuthology.orchestra.console.smithi150:Power off completed
2024-02-22T06:26:05.404 INFO:teuthology.orchestra.console.smithi150:Power on
2024-02-22T06:26:05.404 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on
2024-02-22T06:26:05.455 DEBUG:teuthology.orchestra.console.smithi150:power on output: Chassis Power Control: Up/On
2024-02-22T06:26:05.456 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:26:05.489 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-02-22T06:26:09.492 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:26:09.602 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is off
2024-02-22T06:26:13.606 DEBUG:teuthology.orchestra.console.smithi150:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status
2024-02-22T06:26:13.716 DEBUG:teuthology.orchestra.console.smithi150:check power output: Chassis Power is on
2024-02-22T06:26:13.817 INFO:teuthology.orchestra.console.smithi150:Power on completed
2024-02-22T06:26:13.917 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish
2024-02-22T06:28:59.886 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:02.972 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:08.979 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:12.064 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:18.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:21.180 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:27.184 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:30.268 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:36.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:39.360 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:45.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:29:48.444 WARNING:teuthology.provision.fog.smithi150:[Errno None] Unable to connect to port 22 on 172.21.15.150
2024-02-22T06:29:54.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:30:54.521 WARNING:teuthology.provision.fog.smithi150:timed out
2024-02-22T06:31:00.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:31:00.854 INFO:teuthology.orchestra.run:Running command with timeout 600
2024-02-22T06:31:00.855 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done
2024-02-22T06:31:01.211 INFO:teuthology.provision.fog.smithi150:Node is ready
2024-02-22T06:31:01.212 DEBUG:teuthology.orchestra.run.smithi150:> hostname
2024-02-22T06:31:01.230 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com
2024-02-22T06:31:01.230 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts
2024-02-22T06:31:01.286 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150
2024-02-22T06:31:01.286 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-02-22T06:31:01.383 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts
2024-02-22T06:31:01.411 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts
2024-02-22T06:31:01.480 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname
2024-02-22T06:31:01.547 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150
2024-02-22T06:31:01.613 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-02-22T06:31:01.667 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-22T06:31:01.668 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-22T06:31:01.669 INFO:teuthology.provision.fog.smithi150:Deploy complete!
2024-02-22T06:31:01.670 DEBUG:teuthology.parallel:result is None
2024-02-22T06:31:01.878 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com
2024-02-22T06:31:01.878 INFO:teuthology.lock.ops:New key found. Updating...
2024-02-22T06:31:01.914 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server
2024-02-22T06:31:01.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-02-22T06:31:01.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60}
2024-02-22T06:31:02.011 DEBUG:teuthology.orchestra.run.smithi150:> true
2024-02-22T06:31:02.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com'
2024-02-22T06:31:02.079 DEBUG:teuthology.orchestra.run.smithi150:> uname -m
2024-02-22T06:31:02.132 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64
2024-02-22T06:31:02.133 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release
2024-02-22T06:31:02.186 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="CentOS Stream"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="9"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:ID="centos"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE="rhel fedora"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="9"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:PLATFORM_ID="platform:el9"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="CentOS Stream 9"
2024-02-22T06:31:02.187 INFO:teuthology.orchestra.run.smithi150.stdout:ANSI_COLOR="0;31"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:LOGO="fedora-logo-icon"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:CPE_NAME="cpe:/o:centos:centos:9"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://centos.org/"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9"
2024-02-22T06:31:02.188 INFO:teuthology.orchestra.run.smithi150.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"
2024-02-22T06:31:02.189 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server
2024-02-22T06:31:02.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:31:02.317 INFO:teuthology.dispatcher.supervisor:Running job 7570717
2024-02-22T06:31:02.318 DEBUG:teuthology.dispatcher.supervisor:Running: /home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/virtualenv/bin/teuthology -v --owner scheduled_jcollin@teuthology --archive /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570717 --name jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi --description fs:mirror/{begin/{0-install 1-ceph 2-logrotate} cephfs-mirror/one-per-cluster clients/{mirror} cluster/{1-node} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health} supported-random-distros$/{centos_latest} tasks/mirror} -- /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570717/orig.config.yaml
2024-02-22T06:31:02.323 INFO:teuthology.dispatcher.supervisor:Job archive: /home/teuthworker/archive/jcollin-2024-02-22_04:20:45-fs:mirror-wip-jcollin-testing_21Feb2024_2-distro-default-smithi/7570717
2024-02-22T06:31:02.324 INFO:teuthology.dispatcher.supervisor:Job PID: 4169917
2024-02-22T06:31:02.324 INFO:teuthology.dispatcher.supervisor:Running with watchdog
2024-02-22T06:33:02.425 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:35:02.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:37:02.825 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:39:03.075 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:41:03.312 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:43:03.489 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:45:03.704 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:47:03.895 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:49:04.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:51:04.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:53:04.427 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:55:04.613 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:57:04.796 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T06:59:04.969 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:01:05.141 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:03:05.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:05:05.526 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:07:05.701 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:09:05.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:11:06.084 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:13:06.289 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:15:06.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:17:06.633 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:19:06.805 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:21:06.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:23:07.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:25:07.304 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:27:07.474 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:29:07.657 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:31:07.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:33:08.018 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:35:08.218 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:37:08.387 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:39:08.573 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:41:08.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:43:08.873 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:45:09.057 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:47:09.245 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:49:09.409 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:51:09.585 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:53:09.765 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:55:09.949 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:57:10.137 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T07:59:10.318 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:01:10.491 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:03:10.663 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:05:10.840 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:07:11.017 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:09:11.194 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:11:11.372 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:13:11.558 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:15:11.737 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:17:11.911 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:19:12.089 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:21:12.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:23:12.441 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:25:12.617 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:27:12.798 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/
2024-02-22T08:27:12.878 ERROR:teuthology.dispatcher.supervisor:Child exited with code 1
2024-02-22T08:27:12.983 WARNING:teuthology.dispatcher.supervisor:Was going to unlock smithi150 but it was locked by another job: /home/teuthworker/archive/teuthology-2024-02-22_02:25:13-upgrade:reef-x-main-distro-default-smithi/7570575