2022-07-21T20:16:01.930 INFO:root:teuthology version: 1.1.1.dev389+g8d598431 2022-07-21T20:16:01.932 DEBUG:teuthology.run:Teuthology command: teuthology --name dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi --description rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} --archive /home/teuthworker/archive/dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi/6943019 --owner scheduled_dgalloway@teuthology --verbose -- /home/teuthworker/archive/dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi/6943019/orig.config.yaml 2022-07-21T20:16:01.970 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-07-21T20:16:02.042 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi/6943019 branch: quincy description: rgw/multifs/{clusters/fixed-2 frontend/civetweb ignore-pg-availability objectstore/filestore-xfs overrides rgw_pool_type/ec tasks/rgw_ragweed} email: null first_in_suite: false job_id: '6943019' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 overrides: admin_socket: branch: quincy ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) sha1: b6e46b8939c67a6cc754abb4d0ece3c8918eccc3 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: default sha1: b6e46b8939c67a6cc754abb4d0ece3c8918eccc3 rgw: ec-data-pool: true frontend: civetweb storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true workunit: branch: pacific sha1: c1e9a288b84fe43101b2ee3898d2a85405526623 owner: scheduled_dgalloway@teuthology priority: 50 repo: git@github.com:ceph/ceph-releases.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: b6e46b8939c67a6cc754abb4d0ece3c8918eccc3 sleep_before_teardown: 0 suite: rgw suite_branch: pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph_c1e9a288b84fe43101b2ee3898d2a85405526623/qa suite_relpath: qa suite_repo: git@github.com:ceph/ceph.git suite_sha1: c1e9a288b84fe43101b2ee3898d2a85405526623 targets: smithi022.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDapbfZQZbE12VoKYQmg3FXDWXaEGFGS/Lkn224FXNRVtrP+WnoeYEyHV4vDW9fenUt8p2We9MfD00UiASnshWp1MaIvt/usWm35f28mDo2eWalw6YRW+0/Knk9022ykA366O7aCjky7kCrPa88I5CHKdbarPc1RL6hVPKWt9CQ2bLZ4H6P+MzLzoC+M5x5Fh6ww7z5mYTS9IGS9xuFCcvAnryncmLhfgqs1XkAQajDL/hq4n5dXmK7C1jAaMsbWZVrjb/9ipkVdWEgyyPKOiH4FeIysmjVkw9HaYizPYGbgQwGYb6B9SwozvdW/fp4kz0bMH04wccgplGrqFNvCnYugXGD5lvJGRiVmb30ZEXc8zngrqMSUoZM7+/qPw4UEfa+EXK1FgKiqszcTHcG0Pvn2/1HrGApnO12nWunFJwPn5KUKLHFqPM4H/D2Ehu/UBmLbgPgFmHqAapKhaI1DrSIacQ87ok7r7oICkdDHeskd/mR8xjxPGyEyAlkaidk6+s= smithi037.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDiI4YvDHL3KqL6to+uk0cEm70H8SVBCYrH7IZU9bM40zadZqBZcYO5mraOL1XEFJOFF/FA/+W4K7FS/d08YEyWLBsG6KgwB/9146zfMkDrwI9NzRAgtQNVSeDWJ/rEr1DfyWs0eA1RG5RQIoqBrJdi35HjUCgl3LMUZeYrIMVhLie8Hw1tEHiDCHBijpJGxoZdjyIxEj+r/cgPl69BYxO3ehItcfTS1HvqX4mUpWNfCiUwO+50POoGJQVgvzhtbWVuLDgRW9kKOklbV020uwlU3mdjjMgm/i9C4eqQxQXxlgijQ+tMrohfJXfPlUJV6wqk3R9H4jBFrgjV1+zvoKSzM27xnohk4feoiVCmjlC9SlAcZU1H6Nv+1MyhOJFWFesON6+CF+s107br83jW2LXzEFUHBZRB4r6b6JHpaXqqiRIVeS1xVq3mW8GvUD8BqiK60sBCJGl6FvK6o632+uoalZHc1thvXqdULMfgNDW6vd8aa5D/VMdLuI2GyId2SoM= tasks: - install: null - ceph: null - rgw: - client.0 - ragweed: client.0: default-branch: ceph-pacific rgw_server: client.0 stages: prepare - ragweed: client.0: default-branch: ceph-pacific rgw_server: client.0 stages: check teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8d598431210977f8caccec83230b4bfec7bd5d3f timestamp: 2022-07-21_20:03:26 tube: smithi user: dgalloway verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-07-21T20:16:02.043 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_c1e9a288b84fe43101b2ee3898d2a85405526623/qa; will attempt to use it 2022-07-21T20:16:02.044 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_c1e9a288b84fe43101b2ee3898d2a85405526623/qa/tasks 2022-07-21T20:16:02.044 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-07-21T20:16:02.046 INFO:teuthology.task.internal:Checking packages... 2022-07-21T20:16:02.047 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash 'b6e46b8939c67a6cc754abb4d0ece3c8918eccc3' 2022-07-21T20:16:02.047 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-07-21T20:16:02.053 INFO:teuthology.task.internal:no buildpackages task found 2022-07-21T20:16:02.054 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-07-21T20:16:02.099 INFO:teuthology.task.internal:Saving configuration 2022-07-21T20:16:02.114 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-07-21T20:16:02.124 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-07-21T20:16:02.149 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi/6943019', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-07-21 20:10:53.979111', 'locked_by': 'scheduled_dgalloway@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPthf3w9/RJrQvoOqpUHoB+HuOZvHB7ZydJNoYo6ywtA'} 2022-07-21T20:16:02.174 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/dgalloway-2022-07-21_20:03:26-rgw-quincy-distro-default-smithi/6943019', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-07-21 20:10:53.977625', 'locked_by': 'scheduled_dgalloway@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIy2U0n17vjOWosMhtetjAQ7f8vjq4I9bd4Tpo3nsI1p'} 2022-07-21T20:16:02.174 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-07-21T20:16:02.181 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2022-07-21T20:16:02.181 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2022-07-21T20:16:02.181 INFO:teuthology.run_tasks:Running task console_log... 2022-07-21T20:16:02.300 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa6cbe3f28>, signals=[15]) 2022-07-21T20:16:02.302 INFO:teuthology.run_tasks:Running task internal.connect... 2022-07-21T20:16:02.315 INFO:teuthology.task.internal:Opening connections... 2022-07-21T20:16:02.316 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2022-07-21T20:16:02.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-21T20:16:02.426 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2022-07-21T20:16:02.427 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-07-21T20:16:02.532 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-07-21T20:16:02.541 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2022-07-21T20:16:02.549 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2022-07-21T20:16:02.549 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2022-07-21T20:16:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2022-07-21T20:16:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-21T20:16:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2022-07-21T20:16:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2022-07-21T20:16:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-21T20:16:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="20.04" 2022-07-21T20:16:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-21T20:16:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-21T20:16:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-21T20:16:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-21T20:16:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=focal 2022-07-21T20:16:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=focal 2022-07-21T20:16:02.604 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2022-07-21T20:16:02.644 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2022-07-21T20:16:02.652 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2022-07-21T20:16:02.653 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2022-07-21T20:16:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2022-07-21T20:16:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-07-21T20:16:02.700 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2022-07-21T20:16:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2022-07-21T20:16:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-07-21T20:16:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="20.04" 2022-07-21T20:16:02.701 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2022-07-21T20:16:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-07-21T20:16:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-07-21T20:16:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-07-21T20:16:02.702 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=focal 2022-07-21T20:16:02.703 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=focal 2022-07-21T20:16:02.703 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2022-07-21T20:16:02.724 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-07-21T20:16:02.741 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-07-21T20:16:02.782 INFO:teuthology.task.internal:Checking for old test directory... 2022-07-21T20:16:02.783 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2022-07-21T20:16:02.786 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2022-07-21T20:16:02.792 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-07-21T20:16:02.810 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-07-21T20:16:02.810 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2022-07-21T20:16:02.835 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2022-07-21T20:16:02.857 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-07-21T20:16:02.918 INFO:teuthology.run_tasks:Running task kernel... 2022-07-21T20:16:02.936 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-07-21T20:16:02.936 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-07-21T20:16:02.937 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2022-07-21T20:16:02.938 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2022-07-21T20:16:02.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-21T20:16:02.944 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2022-07-21T20:16:02.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-07-21T20:16:02.946 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2022-07-21T20:16:02.953 INFO:teuthology.orchestra.run.smithi037.stdout:5.4.0-122-generic 2022-07-21T20:16:02.953 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.4.0-122-generic 2022-07-21T20:16:02.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get clean 2022-07-21T20:16:02.992 INFO:teuthology.orchestra.run.smithi022.stdout:5.4.0-122-generic 2022-07-21T20:16:02.992 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.4.0-122-generic 2022-07-21T20:16:02.993 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get clean 2022-07-21T20:16:03.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2022-07-21T20:16:03.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2022-07-21T20:16:03.277 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-07-21T20:16:03.341 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-07-21T20:16:03.342 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-07-21T20:16:03.385 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-07-21T20:16:03.390 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2022-07-21T20:16:03.471 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-07-21T20:16:03.565 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [471 kB] 2022-07-21T20:16:03.686 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,630 kB] 2022-07-21T20:16:03.734 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-07-21T20:16:03.809 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,630 kB] 2022-07-21T20:16:03.818 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-07-21T20:16:03.949 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [696 kB] 2022-07-21T20:16:03.957 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [277 kB] 2022-07-21T20:16:03.999 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [10.8 kB] 2022-07-21T20:16:04.000 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,091 kB] 2022-07-21T20:16:04.024 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,990 kB] 2022-07-21T20:16:04.167 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [155 kB] 2022-07-21T20:16:04.189 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [711 kB] 2022-07-21T20:16:04.308 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [556 kB] 2022-07-21T20:16:04.392 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [128 kB] 2022-07-21T20:16:04.398 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [14.7 kB] 2022-07-21T20:16:04.951 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,990 kB] 2022-07-21T20:16:06.095 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [471 kB] 2022-07-21T20:16:06.152 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [358 kB] 2022-07-21T20:16:06.191 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [15.6 kB] 2022-07-21T20:16:06.192 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,178 kB] 2022-07-21T20:16:06.326 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [167 kB] 2022-07-21T20:16:06.356 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [677 kB] 2022-07-21T20:16:06.439 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [924 kB] 2022-07-21T20:16:06.532 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [208 kB] 2022-07-21T20:16:06.572 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.9 kB] 2022-07-21T20:16:06.702 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [277 kB] 2022-07-21T20:16:06.710 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [696 kB] 2022-07-21T20:16:07.091 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [10.8 kB] 2022-07-21T20:16:07.096 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,091 kB] 2022-07-21T20:16:07.617 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [358 kB] 2022-07-21T20:16:08.107 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [15.6 kB] 2022-07-21T20:16:08.114 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,178 kB] 2022-07-21T20:16:08.578 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [155 kB] 2022-07-21T20:16:08.779 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [711 kB] 2022-07-21T20:16:09.695 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [167 kB] 2022-07-21T20:16:09.696 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [556 kB] 2022-07-21T20:16:09.967 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [924 kB] 2022-07-21T20:16:10.491 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [128 kB] 2022-07-21T20:16:10.678 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [14.7 kB] 2022-07-21T20:16:11.168 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [677 kB] 2022-07-21T20:16:12.053 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [208 kB] 2022-07-21T20:16:12.342 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [20.9 kB] 2022-07-21T20:16:13.122 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 11.6 MB in 8s (1,532 kB/s) 2022-07-21T20:16:14.372 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2022-07-21T20:16:14.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-07-21T20:16:14.470 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2022-07-21T20:16:14.655 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2022-07-21T20:16:14.655 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2022-07-21T20:16:14.829 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 11.6 MB in 9s (1,266 kB/s) 2022-07-21T20:16:14.882 INFO:teuthology.orchestra.run.smithi037.stdout:linux-image-generic is already the newest version (5.4.0.122.123). 2022-07-21T20:16:14.883 INFO:teuthology.orchestra.run.smithi037.stdout:linux-image-generic set to manually installed. 2022-07-21T20:16:14.883 INFO:teuthology.orchestra.run.smithi037.stdout:0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded. 2022-07-21T20:16:14.884 DEBUG:teuthology.orchestra.run.smithi037:> dpkg -s linux-image-generic 2022-07-21T20:16:14.906 INFO:teuthology.orchestra.run.smithi037.stdout:Package: linux-image-generic 2022-07-21T20:16:14.906 INFO:teuthology.orchestra.run.smithi037.stdout:Status: install ok installed 2022-07-21T20:16:14.906 INFO:teuthology.orchestra.run.smithi037.stdout:Priority: optional 2022-07-21T20:16:14.907 INFO:teuthology.orchestra.run.smithi037.stdout:Section: kernel 2022-07-21T20:16:14.907 INFO:teuthology.orchestra.run.smithi037.stdout:Installed-Size: 19 2022-07-21T20:16:14.907 INFO:teuthology.orchestra.run.smithi037.stdout:Maintainer: Ubuntu Kernel Team 2022-07-21T20:16:14.907 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: amd64 2022-07-21T20:16:14.907 INFO:teuthology.orchestra.run.smithi037.stdout:Source: linux-meta 2022-07-21T20:16:14.908 INFO:teuthology.orchestra.run.smithi037.stdout:Version: 5.4.0.122.123 2022-07-21T20:16:14.908 INFO:teuthology.orchestra.run.smithi037.stdout:Provides: virtualbox-guest-modules (= 6.1.32-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2022-07-21T20:16:14.908 INFO:teuthology.orchestra.run.smithi037.stdout:Depends: linux-image-5.4.0-122-generic, linux-modules-extra-5.4.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2022-07-21T20:16:14.909 INFO:teuthology.orchestra.run.smithi037.stdout:Recommends: thermald 2022-07-21T20:16:14.909 INFO:teuthology.orchestra.run.smithi037.stdout:Description: Generic Linux kernel image 2022-07-21T20:16:14.910 INFO:teuthology.orchestra.run.smithi037.stdout: This package will always depend on the latest generic kernel image 2022-07-21T20:16:14.910 INFO:teuthology.orchestra.run.smithi037.stdout: available. 2022-07-21T20:16:14.911 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-07-21T20:16:14.911 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-07-21T20:16:14.912 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-07-21T20:16:14.936 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2022-07-21T20:16:14.973 DEBUG:teuthology.parallel:result is None 2022-07-21T20:16:16.121 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2022-07-21T20:16:16.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-07-21T20:16:16.217 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2022-07-21T20:16:16.399 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2022-07-21T20:16:16.400 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2022-07-21T20:16:16.624 INFO:teuthology.orchestra.run.smithi022.stdout:linux-image-generic is already the newest version (5.4.0.122.123). 2022-07-21T20:16:16.624 INFO:teuthology.orchestra.run.smithi022.stdout:linux-image-generic set to manually installed. 2022-07-21T20:16:16.624 INFO:teuthology.orchestra.run.smithi022.stdout:0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded. 2022-07-21T20:16:16.626 DEBUG:teuthology.orchestra.run.smithi022:> dpkg -s linux-image-generic 2022-07-21T20:16:16.649 INFO:teuthology.orchestra.run.smithi022.stdout:Package: linux-image-generic 2022-07-21T20:16:16.650 INFO:teuthology.orchestra.run.smithi022.stdout:Status: install ok installed 2022-07-21T20:16:16.650 INFO:teuthology.orchestra.run.smithi022.stdout:Priority: optional 2022-07-21T20:16:16.650 INFO:teuthology.orchestra.run.smithi022.stdout:Section: kernel 2022-07-21T20:16:16.650 INFO:teuthology.orchestra.run.smithi022.stdout:Installed-Size: 19 2022-07-21T20:16:16.651 INFO:teuthology.orchestra.run.smithi022.stdout:Maintainer: Ubuntu Kernel Team 2022-07-21T20:16:16.652 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: amd64 2022-07-21T20:16:16.652 INFO:teuthology.orchestra.run.smithi022.stdout:Source: linux-meta 2022-07-21T20:16:16.652 INFO:teuthology.orchestra.run.smithi022.stdout:Version: 5.4.0.122.123 2022-07-21T20:16:16.652 INFO:teuthology.orchestra.run.smithi022.stdout:Provides: virtualbox-guest-modules (= 6.1.32-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2022-07-21T20:16:16.653 INFO:teuthology.orchestra.run.smithi022.stdout:Depends: linux-image-5.4.0-122-generic, linux-modules-extra-5.4.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2022-07-21T20:16:16.653 INFO:teuthology.orchestra.run.smithi022.stdout:Recommends: thermald 2022-07-21T20:16:16.653 INFO:teuthology.orchestra.run.smithi022.stdout:Description: Generic Linux kernel image 2022-07-21T20:16:16.653 INFO:teuthology.orchestra.run.smithi022.stdout: This package will always depend on the latest generic kernel image 2022-07-21T20:16:16.654 INFO:teuthology.orchestra.run.smithi022.stdout: available. 2022-07-21T20:16:16.654 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-07-21T20:16:16.655 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-07-21T20:16:16.655 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-07-21T20:16:16.679 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2022-07-21T20:16:16.703 DEBUG:teuthology.parallel:result is None 2022-07-21T20:16:16.703 INFO:teuthology.run_tasks:Running task internal.base... 2022-07-21T20:16:16.711 INFO:teuthology.task.internal:Creating test directory... 2022-07-21T20:16:16.712 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-07-21T20:16:16.715 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-07-21T20:16:16.724 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-07-21T20:16:16.759 INFO:teuthology.run_tasks:Running task internal.archive... 2022-07-21T20:16:16.801 INFO:teuthology.task.internal:Creating archive directory... 2022-07-21T20:16:16.802 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-07-21T20:16:16.805 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-07-21T20:16:16.820 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-07-21T20:16:16.837 INFO:teuthology.task.internal:Enabling coredump saving... 2022-07-21T20:16:16.837 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-07-21T20:16:16.841 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-07-21T20:16:16.859 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-21T20:16:16.867 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-21T20:16:16.869 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-21T20:16:16.885 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-07-21T20:16:16.885 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-07-21T20:16:16.894 INFO:teuthology.task.internal:Configuring sudo... 2022-07-21T20:16:16.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-07-21T20:16:16.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-07-21T20:16:16.947 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-07-21T20:16:16.965 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-07-21T20:16:16.968 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-07-21T20:16:16.975 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-07-21T20:16:16.984 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-21T20:16:17.028 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-21T20:16:17.038 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2022-07-21T20:16:17.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-07-21T20:16:17.068 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-07-21T20:16:17.077 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-07-21T20:16:17.085 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2022-07-21T20:16:17.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-07-21T20:16:17.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2022-07-21T20:16:17.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2022-07-21T20:16:17.205 INFO:teuthology.run_tasks:Running task internal.timer... 2022-07-21T20:16:17.214 INFO:teuthology.task.internal:Starting timer... 2022-07-21T20:16:17.214 INFO:teuthology.run_tasks:Running task pcp... 2022-07-21T20:16:17.240 INFO:teuthology.run_tasks:Running task selinux... 2022-07-21T20:16:17.277 DEBUG:teuthology.task.selinux:Excluding smithi022: OS 'ubuntu' does not support SELinux 2022-07-21T20:16:17.277 DEBUG:teuthology.task.selinux:Excluding smithi037: OS 'ubuntu' does not support SELinux 2022-07-21T20:16:17.278 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-07-21T20:16:17.278 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2022-07-21T20:16:17.278 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-07-21T20:16:17.279 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-07-21T20:16:17.326 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-07-21T20:16:17.335 INFO:teuthology.repo_utils:Fetching main from origin 2022-07-21T20:16:17.383 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-07-21T20:16:17.419 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-07-21T20:16:17.422 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi037.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-07-21T20:19:38.296 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-07-21T20:19:38.299 DEBUG:teuthology.task.console_log:Killing console logger for smithi022 2022-07-21T20:19:38.309 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2022-07-21T20:19:38.309 DEBUG:teuthology.exit:Finished running handlers