2022-08-05T15:46:05.957 INFO:root:teuthology version: 1.1.1.dev407+g9e4bf63f 2022-08-05T15:46:05.976 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547 --description rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} -- /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/orig.config.yaml 2022-08-05T15:46:06.284 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-08-05T15:46:06.565 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547 branch: wip-yuri4-testing-2022-08-04-1413 description: rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} email: ceph-qa@ceph.io first_in_suite: false job_id: '6959547' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2022-08-04-1413 ceph: conf: global: mon election default strategy: 1 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon scrub interval: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) mon_bind_msgr2: false sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2022-08-04-1413 sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - osd.0 - osd.1 - osd.2 - client.0 sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri4-testing-2022-08-04-1413 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d targets: smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDk63iqbZZAMmqVqs6ZEMFwb+WaB/QxfDLv/5OpwAFqiVauA7m+3+V6VLKsT6fYk5qfzeZjdoLVOiUZ60iEUMD46MjhDTTqjP4D935mbr/LhhfF8QoOwpdl3tZFwE8cW7xbm/hP+d34mdQvmYhIUqt5tyLml6k9rO5Qhiv6mgXkiH9qPI2rwrUhjtqLTRwsxRX358D2Rjafat01j3DykZvfSqYMe+0lhuaCAI/wWrpG3CafaqAx7DDwh0sIUB9Kjkrwp8wYRXrL93i88SzYbW0bS+ea/mbxX1ymbRQWq49t608WOOsESBHBoENTKKu4mEPhIP11Znsjuj62rLdo/lRXWU1NeK8Re51jXlp3FvRohUNib9wNpM7+hwdk/AAt8Ev3QtAiNFKYyiRzH2NpimhCzAaJMUmcID2GhQj1EfODpiVmZrCFsIN1UhZsCXGTyoa6iy15xvY97fXKese7Mfqn3yDb9l953/x5WceZdsycGejLDcfxSQy/boKyBV5iY6k= tasks: - install: null - ceph: log-ignorelist: - but it is still running - had wrong client addr - had wrong cluster addr - must scrub before tier agent can activate - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping updates - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(SMALLER_PG_NUM\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(FS_WITH_FAILED_MDS\) - \(FS_DEGRADED\) - \(POOL_BACKFILLFULL\) - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(POOL_NEARFULL\) - \(POOL_APP_NOT_ENABLED\) - \(AUTH_BAD_CAPS\) - \(FS_INLINE_DATA_DEPRECATED\) - \(MON_DOWN\) - \(SLOW_OPS\) - slow request - workunit: clients: all: - cephtool - mon/pool_ops.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53 timestamp: 2022-08-05_14:49:51 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1713 2022-08-05T15:46:06.622 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa; will attempt to use it 2022-08-05T15:46:06.623 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks 2022-08-05T15:46:06.623 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-08-05T15:46:06.636 INFO:teuthology.task.internal:Checking packages... 2022-08-05T15:46:06.981 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '4a7e6c4ac29de794744a2ce76ca2b36bc637894d' 2022-08-05T15:46:06.981 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-08-05T15:46:07.063 INFO:teuthology.packaging:ref: None 2022-08-05T15:46:07.074 INFO:teuthology.packaging:tag: None 2022-08-05T15:46:07.143 INFO:teuthology.packaging:branch: wip-yuri4-testing-2022-08-04-1413 2022-08-05T15:46:07.144 INFO:teuthology.packaging:sha1: 4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:46:07.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2022-08-04-1413 2022-08-05T15:46:07.847 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-14045-g4a7e6c4a-1focal 2022-08-05T15:46:07.905 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-08-05T15:46:08.108 INFO:teuthology.task.internal:no buildpackages task found 2022-08-05T15:46:08.138 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-08-05T15:46:08.167 INFO:teuthology.task.internal:Saving configuration 2022-08-05T15:46:08.352 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-08-05T15:46:08.369 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-05T15:46:08.515 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 15:40:15.890873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM4V7xxmp7RjhVE1Lwq1RquHg+08p1hSeZjLOfEa/gmF'} 2022-08-05T15:46:08.516 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-08-05T15:46:08.530 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2022-08-05T15:46:08.531 INFO:teuthology.run_tasks:Running task console_log... 2022-08-05T15:46:09.010 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fca71f7cb70>, signals=[15]) 2022-08-05T15:46:09.012 INFO:teuthology.run_tasks:Running task internal.connect... 2022-08-05T15:46:09.035 INFO:teuthology.task.internal:Opening connections... 2022-08-05T15:46:09.043 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:46:09.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:46:10.744 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-08-05T15:46:10.772 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2022-08-05T15:46:11.167 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2022-08-05T15:46:11.168 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2022-08-05T15:46:11.234 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2022-08-05T15:46:11.243 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2022-08-05T15:46:11.255 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2022-08-05T15:46:11.255 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2022-08-05T15:46:11.256 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2022-08-05T15:46:11.256 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="20.04" 2022-08-05T15:46:11.257 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2022-08-05T15:46:11.257 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2022-08-05T15:46:11.258 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2022-08-05T15:46:11.258 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2022-08-05T15:46:11.376 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=focal 2022-08-05T15:46:11.377 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=focal 2022-08-05T15:46:11.378 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-08-05T15:46:11.711 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-08-05T15:46:11.981 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-08-05T15:46:12.211 INFO:teuthology.task.internal:Checking for old test directory... 2022-08-05T15:46:12.216 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2022-08-05T15:46:12.363 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-08-05T15:46:12.544 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-08-05T15:46:12.629 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2022-08-05T15:46:12.819 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-08-05T15:46:13.275 INFO:teuthology.run_tasks:Running task kernel... 2022-08-05T15:46:13.336 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-08-05T15:46:13.345 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-08-05T15:46:13.346 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2022-08-05T15:46:13.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:46:13.413 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2022-08-05T15:46:13.492 INFO:teuthology.orchestra.run.smithi152.stdout:5.4.0-122-generic 2022-08-05T15:46:13.623 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.4.0-122-generic 2022-08-05T15:46:13.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get clean 2022-08-05T15:46:13.806 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2022-08-05T15:46:13.994 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-08-05T15:46:14.021 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2022-08-05T15:46:14.066 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2022-08-05T15:46:14.146 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2022-08-05T15:46:14.383 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,002 kB] 2022-08-05T15:46:14.541 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [701 kB] 2022-08-05T15:46:14.558 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [360 kB] 2022-08-05T15:46:14.559 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [15.6 kB] 2022-08-05T15:46:14.559 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [26.6 kB] 2022-08-05T15:46:14.560 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,187 kB] 2022-08-05T15:46:14.574 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [169 kB] 2022-08-05T15:46:14.574 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [584 B] 2022-08-05T15:46:14.575 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [685 kB] 2022-08-05T15:46:14.578 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [934 kB] 2022-08-05T15:46:14.578 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [210 kB] 2022-08-05T15:46:14.578 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [21.0 kB] 2022-08-05T15:46:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2022-08-05T15:46:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [24.4 kB] 2022-08-05T15:46:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [588 B] 2022-08-05T15:46:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.6 kB] 2022-08-05T15:46:14.580 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.0 kB] 2022-08-05T15:46:14.580 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [16.3 kB] 2022-08-05T15:46:14.580 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2022-08-05T15:46:14.580 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [24.0 kB] 2022-08-05T15:46:14.606 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.4 kB] 2022-08-05T15:46:14.606 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [16.0 kB] 2022-08-05T15:46:14.617 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [860 B] 2022-08-05T15:46:14.741 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [1,638 kB] 2022-08-05T15:46:15.141 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [473 kB] 2022-08-05T15:46:15.141 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [278 kB] 2022-08-05T15:46:15.142 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [10.8 kB] 2022-08-05T15:46:15.142 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,103 kB] 2022-08-05T15:46:15.196 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [25.3 kB] 2022-08-05T15:46:15.197 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [157 kB] 2022-08-05T15:46:15.252 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [588 B] 2022-08-05T15:46:15.253 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [712 kB] 2022-08-05T15:46:15.253 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [557 kB] 2022-08-05T15:46:15.254 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [129 kB] 2022-08-05T15:46:15.306 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [14.7 kB] 2022-08-05T15:46:15.307 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,192 B] 2022-08-05T15:46:15.307 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.2 kB] 2022-08-05T15:46:15.308 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [508 B] 2022-08-05T15:46:17.780 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 12.0 MB in 2s (6,203 kB/s) 2022-08-05T15:46:19.131 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2022-08-05T15:46:19.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2022-08-05T15:46:19.301 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2022-08-05T15:46:19.456 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2022-08-05T15:46:19.457 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2022-08-05T15:46:19.680 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic is already the newest version (5.4.0.122.123). 2022-08-05T15:46:19.681 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic set to manually installed. 2022-08-05T15:46:19.681 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 0 newly installed, 0 to remove and 19 not upgraded. 2022-08-05T15:46:19.683 DEBUG:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic 2022-08-05T15:46:19.772 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic 2022-08-05T15:46:19.772 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed 2022-08-05T15:46:19.773 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional 2022-08-05T15:46:19.773 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel 2022-08-05T15:46:19.773 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 19 2022-08-05T15:46:19.773 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team 2022-08-05T15:46:19.774 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64 2022-08-05T15:46:19.774 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta 2022-08-05T15:46:19.774 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 5.4.0.122.123 2022-08-05T15:46:19.774 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: virtualbox-guest-modules (= 6.1.32-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.14) 2022-08-05T15:46:19.775 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-5.4.0-122-generic, linux-modules-extra-5.4.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2022-08-05T15:46:19.775 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald 2022-08-05T15:46:19.775 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image 2022-08-05T15:46:19.775 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image 2022-08-05T15:46:19.776 INFO:teuthology.orchestra.run.smithi152.stdout: available. 2022-08-05T15:46:19.776 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-08-05T15:46:19.776 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-08-05T15:46:19.777 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-08-05T15:46:19.843 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2022-08-05T15:46:19.870 DEBUG:teuthology.parallel:result is None 2022-08-05T15:46:19.871 INFO:teuthology.run_tasks:Running task internal.base... 2022-08-05T15:46:19.915 INFO:teuthology.task.internal:Creating test directory... 2022-08-05T15:46:19.917 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-08-05T15:46:19.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-08-05T15:46:20.063 INFO:teuthology.run_tasks:Running task internal.archive... 2022-08-05T15:46:20.190 INFO:teuthology.task.internal:Creating archive directory... 2022-08-05T15:46:20.191 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-08-05T15:46:20.312 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-08-05T15:46:20.347 INFO:teuthology.task.internal:Enabling coredump saving... 2022-08-05T15:46:20.348 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-08-05T15:46:20.384 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:46:20.396 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-08-05T15:46:20.397 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-08-05T15:46:20.448 INFO:teuthology.task.internal:Configuring sudo... 2022-08-05T15:46:20.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-08-05T15:46:20.491 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-08-05T15:46:20.537 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-08-05T15:46:20.537 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-08-05T15:46:20.556 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-08-05T15:46:20.613 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-08-05T15:46:20.659 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:46:20.660 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-08-05T15:46:20.767 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2022-08-05T15:46:20.929 INFO:teuthology.run_tasks:Running task internal.timer... 2022-08-05T15:46:21.137 INFO:teuthology.task.internal:Starting timer... 2022-08-05T15:46:21.138 INFO:teuthology.run_tasks:Running task pcp... 2022-08-05T15:46:21.192 INFO:teuthology.run_tasks:Running task selinux... 2022-08-05T15:46:21.238 DEBUG:teuthology.task.selinux:Excluding smithi152: OS 'ubuntu' does not support SELinux 2022-08-05T15:46:21.265 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-08-05T15:46:21.265 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2022-08-05T15:46:21.266 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-08-05T15:46:21.266 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-08-05T15:46:21.343 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-08-05T15:46:21.366 INFO:teuthology.repo_utils:Fetching main from origin 2022-08-05T15:46:22.223 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-08-05T15:46:22.697 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-08-05T15:46:22.699 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-08-05T15:52:48.872 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com')] 2022-08-05T15:52:48.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-08-05T15:52:48.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-08-05T15:52:49.419 DEBUG:teuthology.orchestra.run.smithi152:> true 2022-08-05T15:52:49.568 INFO:teuthology.run_tasks:Running task clock... 2022-08-05T15:52:49.596 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-08-05T15:52:49.597 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-08-05T15:52:49.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:52:49.679 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: ntpd 4.2.8p12@1.3728-o (1): Starting 2022-08-05T15:52:49.679 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Command line: ntpd -gq 2022-08-05T15:52:49.680 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: proto: precision = 0.070 usec (-24) 2022-08-05T15:52:49.682 INFO:teuthology.orchestra.run.smithi152.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-08-05T15:52:49.683 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2022-08-05T15:52:49.684 INFO:teuthology.orchestra.run.smithi152.stderr:restrict ::: KOD does nothing without LIMITED. 2022-08-05T15:52:49.695 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: restrict ::: KOD does nothing without LIMITED. 2022-08-05T15:52:49.695 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen and drop on 0 v6wildcard [::]:123 2022-08-05T15:52:49.727 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2022-08-05T15:52:49.727 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen normally on 2 lo 127.0.0.1:123 2022-08-05T15:52:49.728 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen normally on 3 enp3s0f1 172.21.15.152:123 2022-08-05T15:52:49.728 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen normally on 4 lo [::1]:123 2022-08-05T15:52:49.732 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de3%5]:123 2022-08-05T15:52:49.732 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:49 ntpd[18249]: Listening on routing socket on fd #22 for interface updates 2022-08-05T15:52:50.653 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:50.653 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:50.654 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:50.654 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:50.655 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:50.655 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:50 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:52.677 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:52.677 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:52.678 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:52.679 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:52.679 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:52.680 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:52 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:53.690 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:53.706 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:53.706 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:53.707 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:53.707 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:53.708 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:53.708 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:53.709 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:53.709 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:53.709 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:53.710 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:53.711 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:53 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:54.652 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:54.677 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:54.678 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:54.679 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:54.679 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:54.680 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:54.680 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:54.680 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:54 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:55.661 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:55.661 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:55.667 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:55.668 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:55.668 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:55.669 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:55.669 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:55.669 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:55.670 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:55.671 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:55.671 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:55.672 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:55 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:56.658 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:56.658 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:56.659 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2022-08-05T15:52:56.659 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: can't open /var/log/ntpstats/rawstats.20220805: Permission denied 2022-08-05T15:52:56.660 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2022-08-05T15:52:56.660 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: can't open /var/log/ntpstats/peerstats.20220805: Permission denied 2022-08-05T15:52:56.661 INFO:teuthology.orchestra.run.smithi152.stdout: 5 Aug 15:52:56 ntpd[18249]: ntpd: time slew -0.003149 s 2022-08-05T15:52:56.669 INFO:teuthology.orchestra.run.smithi152.stdout:ntpd: time slew -0.003149s 2022-08-05T15:52:56.670 INFO:teuthology.orchestra.run.smithi152.stderr: 5 Aug 15:52:56 ntpd[18249]: can't open /var/log/ntpstats/loopstats.20220805: Permission denied 2022-08-05T15:52:56.733 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2022-08-05T15:52:56.733 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2022-08-05T15:52:56.734 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-08-05T15:52:56.734 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-08-05T15:52:56.734 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-08-05T15:52:56.735 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-08-05T15:52:56.735 INFO:teuthology.run_tasks:Running task install... 2022-08-05T15:52:56.760 DEBUG:teuthology.task.install:project ceph 2022-08-05T15:52:56.761 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}} 2022-08-05T15:52:56.761 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'} 2022-08-05T15:52:56.766 INFO:teuthology.task.install:Using flavor: default 2022-08-05T15:52:56.830 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-08-05T15:52:56.831 INFO:teuthology.task.install:extra packages: [] 2022-08-05T15:52:56.832 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T15:52:56.939 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T15:52:56.940 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T15:52:56.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-key list | grep Ceph 2022-08-05T15:52:57.050 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2022-08-05T15:52:57.101 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2022-08-05T15:52:57.102 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph.com (release key) 2022-08-05T15:52:57.105 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T15:52:57.162 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T15:52:57.163 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T15:52:57.164 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2022-08-05T15:52:57.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:52:57.476 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default/ 2022-08-05T15:52:57.476 INFO:teuthology.task.install.deb:Package version is 17.0.0-14045-g4a7e6c4a-1focal 2022-08-05T15:52:57.654 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:52:57.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2022-08-05T15:52:57.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo apt-get update 2022-08-05T15:52:57.972 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2022-08-05T15:52:57.981 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2022-08-05T15:52:57.988 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2022-08-05T15:52:57.989 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2022-08-05T15:52:58.003 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal InRelease 2022-08-05T15:52:58.035 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal Release [7,662 B] 2022-08-05T15:52:58.067 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal Release.gpg 2022-08-05T15:52:58.085 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2022-08-05T15:52:58.111 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main i386 Packages [3,435 B] 2022-08-05T15:52:58.670 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 28.5 kB in 1s (43.1 kB/s) 2022-08-05T15:52:59.521 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2022-08-05T15:52:59.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-14045-g4a7e6c4a-1focal cephadm=17.0.0-14045-g4a7e6c4a-1focal ceph-mds=17.0.0-14045-g4a7e6c4a-1focal ceph-mgr=17.0.0-14045-g4a7e6c4a-1focal ceph-common=17.0.0-14045-g4a7e6c4a-1focal ceph-fuse=17.0.0-14045-g4a7e6c4a-1focal ceph-test=17.0.0-14045-g4a7e6c4a-1focal ceph-volume=17.0.0-14045-g4a7e6c4a-1focal radosgw=17.0.0-14045-g4a7e6c4a-1focal python3-rados=17.0.0-14045-g4a7e6c4a-1focal python3-rgw=17.0.0-14045-g4a7e6c4a-1focal python3-cephfs=17.0.0-14045-g4a7e6c4a-1focal python3-rbd=17.0.0-14045-g4a7e6c4a-1focal libcephfs2=17.0.0-14045-g4a7e6c4a-1focal libcephfs-dev=17.0.0-14045-g4a7e6c4a-1focal librados2=17.0.0-14045-g4a7e6c4a-1focal librbd1=17.0.0-14045-g4a7e6c4a-1focal rbd-fuse=17.0.0-14045-g4a7e6c4a-1focal 2022-08-05T15:52:59.617 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2022-08-05T15:52:59.787 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2022-08-05T15:52:59.787 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2022-08-05T15:52:59.939 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages were automatically installed and are no longer required: 2022-08-05T15:52:59.940 INFO:teuthology.orchestra.run.smithi152.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2022-08-05T15:52:59.940 INFO:teuthology.orchestra.run.smithi152.stdout:Use 'sudo apt autoremove' to remove them. 2022-08-05T15:52:59.941 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2022-08-05T15:52:59.941 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2022-08-05T15:52:59.942 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2022-08-05T15:52:59.950 INFO:teuthology.orchestra.run.smithi152.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2022-08-05T15:52:59.950 INFO:teuthology.orchestra.run.smithi152.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2022-08-05T15:52:59.951 INFO:teuthology.orchestra.run.smithi152.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2022-08-05T15:52:59.951 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 libxslt1.1 nvme-cli 2022-08-05T15:52:59.951 INFO:teuthology.orchestra.run.smithi152.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2022-08-05T15:52:59.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2022-08-05T15:52:59.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2022-08-05T15:52:59.952 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2022-08-05T15:52:59.953 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2022-08-05T15:52:59.953 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2022-08-05T15:52:59.953 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2022-08-05T15:52:59.954 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-08-05T15:52:59.955 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-08-05T15:52:59.955 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2022-08-05T15:52:59.956 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2022-08-05T15:52:59.962 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy python3-simplegeneric python3-simplejson 2022-08-05T15:52:59.962 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2022-08-05T15:52:59.963 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2022-08-05T15:52:59.963 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2022-08-05T15:52:59.964 INFO:teuthology.orchestra.run.smithi152.stdout: qttranslations5-l10n socat xmlstarlet 2022-08-05T15:52:59.989 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2022-08-05T15:52:59.989 INFO:teuthology.orchestra.run.smithi152.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2022-08-05T15:53:00.003 INFO:teuthology.orchestra.run.smithi152.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2022-08-05T15:53:00.003 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2022-08-05T15:53:00.004 INFO:teuthology.orchestra.run.smithi152.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2022-08-05T15:53:00.004 INFO:teuthology.orchestra.run.smithi152.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2022-08-05T15:53:00.005 INFO:teuthology.orchestra.run.smithi152.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2022-08-05T15:53:00.005 INFO:teuthology.orchestra.run.smithi152.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2022-08-05T15:53:00.005 INFO:teuthology.orchestra.run.smithi152.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2022-08-05T15:53:00.012 INFO:teuthology.orchestra.run.smithi152.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2022-08-05T15:53:00.013 INFO:teuthology.orchestra.run.smithi152.stdout:Recommended packages: 2022-08-05T15:53:00.013 INFO:teuthology.orchestra.run.smithi152.stdout: btrfs-tools 2022-08-05T15:53:00.079 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2022-08-05T15:53:00.079 INFO:teuthology.orchestra.run.smithi152.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2022-08-05T15:53:00.080 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2022-08-05T15:53:00.080 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2022-08-05T15:53:00.080 INFO:teuthology.orchestra.run.smithi152.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2022-08-05T15:53:00.080 INFO:teuthology.orchestra.run.smithi152.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2022-08-05T15:53:00.080 INFO:teuthology.orchestra.run.smithi152.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2022-08-05T15:53:00.081 INFO:teuthology.orchestra.run.smithi152.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2022-08-05T15:53:00.118 INFO:teuthology.orchestra.run.smithi152.stdout: libsqlite3-mod-ceph libthrift-0.13.0 libxslt1.1 nvme-cli python-asyncssh-doc 2022-08-05T15:53:00.119 INFO:teuthology.orchestra.run.smithi152.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2022-08-05T15:53:00.119 INFO:teuthology.orchestra.run.smithi152.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2022-08-05T15:53:00.119 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2022-08-05T15:53:00.120 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2022-08-05T15:53:00.126 INFO:teuthology.orchestra.run.smithi152.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2022-08-05T15:53:00.126 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2022-08-05T15:53:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2022-08-05T15:53:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2022-08-05T15:53:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2022-08-05T15:53:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2022-08-05T15:53:00.127 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2022-08-05T15:53:00.163 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2022-08-05T15:53:00.164 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplejson python3-singledispatch python3-sklearn 2022-08-05T15:53:00.164 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2022-08-05T15:53:00.165 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2022-08-05T15:53:00.165 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2022-08-05T15:53:00.208 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet 2022-08-05T15:53:00.209 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2022-08-05T15:53:00.209 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 librbd1 2022-08-05T15:53:00.236 INFO:teuthology.orchestra.run.smithi152.stdout:2 upgraded, 111 newly installed, 0 to remove and 19 not upgraded. 2022-08-05T15:53:00.236 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 221 MB of archives. 2022-08-05T15:53:00.237 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 1,070 MB of additional disk space will be used. 2022-08-05T15:53:00.237 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-14045-g4a7e6c4a-1focal [3,446 kB] 2022-08-05T15:53:00.332 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2022-08-05T15:53:00.423 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-14045-g4a7e6c4a-1focal [3,938 kB] 2022-08-05T15:53:00.528 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-14045-g4a7e6c4a-1focal [719 kB] 2022-08-05T15:53:00.555 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-14045-g4a7e6c4a-1focal [376 kB] 2022-08-05T15:53:00.574 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-14045-g4a7e6c4a-1focal [22.4 kB] 2022-08-05T15:53:00.575 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-14045-g4a7e6c4a-1focal [185 kB] 2022-08-05T15:53:00.575 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-14045-g4a7e6c4a-1focal [43.5 kB] 2022-08-05T15:53:00.576 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-14045-g4a7e6c4a-1focal [348 kB] 2022-08-05T15:53:00.588 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-14045-g4a7e6c4a-1focal [5,779 kB] 2022-08-05T15:53:00.631 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2022-08-05T15:53:00.638 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 libpcre2-16-0 amd64 10.34-7 [181 kB] 2022-08-05T15:53:00.730 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2022-08-05T15:53:00.795 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-14045-g4a7e6c4a-1focal [104 kB] 2022-08-05T15:53:00.796 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-14045-g4a7e6c4a-1focal [466 kB] 2022-08-05T15:53:00.796 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-14045-g4a7e6c4a-1focal [29.1 MB] 2022-08-05T15:53:01.031 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2022-08-05T15:53:01.031 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2022-08-05T15:53:01.032 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2022-08-05T15:53:01.040 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2022-08-05T15:53:01.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2022-08-05T15:53:01.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2022-08-05T15:53:01.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2022-08-05T15:53:01.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2022-08-05T15:53:01.042 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2022-08-05T15:53:01.043 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2022-08-05T15:53:01.110 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2022-08-05T15:53:01.111 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2022-08-05T15:53:01.111 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2022-08-05T15:53:01.111 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2022-08-05T15:53:01.112 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2022-08-05T15:53:01.112 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2022-08-05T15:53:01.113 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2022-08-05T15:53:01.114 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2022-08-05T15:53:01.117 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2022-08-05T15:53:01.198 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2022-08-05T15:53:01.199 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2022-08-05T15:53:01.208 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2022-08-05T15:53:01.209 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2022-08-05T15:53:01.209 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2022-08-05T15:53:01.210 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2022-08-05T15:53:01.211 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2022-08-05T15:53:01.213 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2022-08-05T15:53:01.215 INFO:teuthology.orchestra.run.smithi152.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2022-08-05T15:53:01.283 INFO:teuthology.orchestra.run.smithi152.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2022-08-05T15:53:01.305 INFO:teuthology.orchestra.run.smithi152.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2022-08-05T15:53:01.323 INFO:teuthology.orchestra.run.smithi152.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2022-08-05T15:53:01.323 INFO:teuthology.orchestra.run.smithi152.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2022-08-05T15:53:01.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2022-08-05T15:53:01.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2022-08-05T15:53:01.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2022-08-05T15:53:01.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2022-08-05T15:53:01.324 INFO:teuthology.orchestra.run.smithi152.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2022-08-05T15:53:01.373 INFO:teuthology.orchestra.run.smithi152.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2022-08-05T15:53:01.385 INFO:teuthology.orchestra.run.smithi152.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2022-08-05T15:53:01.417 INFO:teuthology.orchestra.run.smithi152.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2022-08-05T15:53:01.418 INFO:teuthology.orchestra.run.smithi152.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2022-08-05T15:53:01.418 INFO:teuthology.orchestra.run.smithi152.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2022-08-05T15:53:01.418 INFO:teuthology.orchestra.run.smithi152.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2022-08-05T15:53:01.419 INFO:teuthology.orchestra.run.smithi152.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2022-08-05T15:53:01.419 INFO:teuthology.orchestra.run.smithi152.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2022-08-05T15:53:01.419 INFO:teuthology.orchestra.run.smithi152.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2022-08-05T15:53:01.671 INFO:teuthology.orchestra.run.smithi152.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2022-08-05T15:53:01.774 INFO:teuthology.orchestra.run.smithi152.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2022-08-05T15:53:01.775 INFO:teuthology.orchestra.run.smithi152.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2022-08-05T15:53:01.859 INFO:teuthology.orchestra.run.smithi152.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2022-08-05T15:53:01.860 INFO:teuthology.orchestra.run.smithi152.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2022-08-05T15:53:01.930 INFO:teuthology.orchestra.run.smithi152.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-14045-g4a7e6c4a-1focal [12.8 MB] 2022-08-05T15:53:01.958 INFO:teuthology.orchestra.run.smithi152.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2022-08-05T15:53:01.959 INFO:teuthology.orchestra.run.smithi152.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2022-08-05T15:53:01.959 INFO:teuthology.orchestra.run.smithi152.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2022-08-05T15:53:01.967 INFO:teuthology.orchestra.run.smithi152.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2022-08-05T15:53:01.967 INFO:teuthology.orchestra.run.smithi152.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2022-08-05T15:53:01.968 INFO:teuthology.orchestra.run.smithi152.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2022-08-05T15:53:01.968 INFO:teuthology.orchestra.run.smithi152.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2022-08-05T15:53:01.968 INFO:teuthology.orchestra.run.smithi152.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2022-08-05T15:53:02.011 INFO:teuthology.orchestra.run.smithi152.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2022-08-05T15:53:02.030 INFO:teuthology.orchestra.run.smithi152.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2022-08-05T15:53:02.032 INFO:teuthology.orchestra.run.smithi152.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2022-08-05T15:53:02.032 INFO:teuthology.orchestra.run.smithi152.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2022-08-05T15:53:02.037 INFO:teuthology.orchestra.run.smithi152.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2022-08-05T15:53:02.037 INFO:teuthology.orchestra.run.smithi152.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2022-08-05T15:53:02.038 INFO:teuthology.orchestra.run.smithi152.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2022-08-05T15:53:02.118 INFO:teuthology.orchestra.run.smithi152.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2022-08-05T15:53:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2022-08-05T15:53:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2022-08-05T15:53:02.233 INFO:teuthology.orchestra.run.smithi152.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-14045-g4a7e6c4a-1focal [216 kB] 2022-08-05T15:53:02.235 INFO:teuthology.orchestra.run.smithi152.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.0.0-14045-g4a7e6c4a-1focal [132 kB] 2022-08-05T15:53:02.239 INFO:teuthology.orchestra.run.smithi152.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-14045-g4a7e6c4a-1focal [1,531 kB] 2022-08-05T15:53:02.340 INFO:teuthology.orchestra.run.smithi152.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-14045-g4a7e6c4a-1focal [7,819 kB] 2022-08-05T15:53:02.342 INFO:teuthology.orchestra.run.smithi152.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2022-08-05T15:53:02.342 INFO:teuthology.orchestra.run.smithi152.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2022-08-05T15:53:02.356 INFO:teuthology.orchestra.run.smithi152.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2022-08-05T15:53:02.356 INFO:teuthology.orchestra.run.smithi152.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2022-08-05T15:53:02.357 INFO:teuthology.orchestra.run.smithi152.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2022-08-05T15:53:02.378 INFO:teuthology.orchestra.run.smithi152.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2022-08-05T15:53:02.379 INFO:teuthology.orchestra.run.smithi152.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2022-08-05T15:53:02.381 INFO:teuthology.orchestra.run.smithi152.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2022-08-05T15:53:02.382 INFO:teuthology.orchestra.run.smithi152.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2022-08-05T15:53:02.549 INFO:teuthology.orchestra.run.smithi152.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-14045-g4a7e6c4a-1focal [28.7 MB] 2022-08-05T15:53:03.573 INFO:teuthology.orchestra.run.smithi152.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-14045-g4a7e6c4a-1focal [3,816 B] 2022-08-05T15:53:03.655 INFO:teuthology.orchestra.run.smithi152.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-14045-g4a7e6c4a-1focal [827 kB] 2022-08-05T15:53:03.689 INFO:teuthology.orchestra.run.smithi152.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-14045-g4a7e6c4a-1focal [2,265 kB] 2022-08-05T15:53:03.689 INFO:teuthology.orchestra.run.smithi152.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-14045-g4a7e6c4a-1focal [79.6 kB] 2022-08-05T15:53:03.690 INFO:teuthology.orchestra.run.smithi152.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-14045-g4a7e6c4a-1focal [108 kB] 2022-08-05T15:53:03.690 INFO:teuthology.orchestra.run.smithi152.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-14045-g4a7e6c4a-1focal [1,705 kB] 2022-08-05T15:53:03.699 INFO:teuthology.orchestra.run.smithi152.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-14045-g4a7e6c4a-1focal [7,868 kB] 2022-08-05T15:53:03.958 INFO:teuthology.orchestra.run.smithi152.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-14045-g4a7e6c4a-1focal [3,936 B] 2022-08-05T15:53:03.958 INFO:teuthology.orchestra.run.smithi152.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-14045-g4a7e6c4a-1focal [58.2 MB] 2022-08-05T15:53:06.662 INFO:teuthology.orchestra.run.smithi152.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.0.0-14045-g4a7e6c4a-1focal [224 kB] 2022-08-05T15:53:06.663 INFO:teuthology.orchestra.run.smithi152.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-14045-g4a7e6c4a-1focal [27.3 kB] 2022-08-05T15:53:06.686 INFO:teuthology.orchestra.run.smithi152.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-14045-g4a7e6c4a-1focal [18.1 MB] 2022-08-05T15:53:07.414 INFO:teuthology.orchestra.run.smithi152.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2022-08-04-1413/4a7e6c4ac29de794744a2ce76ca2b36bc637894d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-14045-g4a7e6c4a-1focal [97.3 kB] 2022-08-05T15:53:08.042 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 221 MB in 7s (30.1 MB/s) 2022-08-05T15:53:08.203 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2022-08-05T15:53:08.220 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102338 files and directories currently installed.) 2022-08-05T15:53:08.220 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2022-08-05T15:53:08.325 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2022-08-05T15:53:08.683 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2022-08-05T15:53:08.684 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2022-08-05T15:53:08.722 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2022-08-05T15:53:09.026 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2022-08-05T15:53:09.035 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7_amd64.deb ... 2022-08-05T15:53:09.064 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7) ... 2022-08-05T15:53:09.553 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5core5a:amd64. 2022-08-05T15:53:09.554 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2022-08-05T15:53:09.607 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:53:10.137 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2022-08-05T15:53:10.161 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2022-08-05T15:53:10.198 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:53:10.529 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libqt5network5:amd64. 2022-08-05T15:53:10.529 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2022-08-05T15:53:10.558 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:53:10.968 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libthrift-0.13.0. 2022-08-05T15:53:10.990 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2022-08-05T15:53:11.059 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2022-08-05T15:53:11.459 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../007-librbd1_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:11.574 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librbd1 (17.0.0-14045-g4a7e6c4a-1focal) over (15.2.16-0ubuntu0.20.04.1) ... 2022-08-05T15:53:12.246 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../008-librados2_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:12.424 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librados2 (17.0.0-14045-g4a7e6c4a-1focal) over (15.2.16-0ubuntu0.20.04.1) ... 2022-08-05T15:53:13.187 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs2. 2022-08-05T15:53:13.215 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../009-libcephfs2_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:13.263 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs2 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:13.596 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rados. 2022-08-05T15:53:13.604 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../010-python3-rados_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:13.682 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rados (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:14.006 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-argparse. 2022-08-05T15:53:14.032 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../011-python3-ceph-argparse_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:14.065 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-argparse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:14.285 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cephfs. 2022-08-05T15:53:14.311 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../012-python3-cephfs_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:14.370 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cephfs (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:14.731 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-common. 2022-08-05T15:53:14.744 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../013-python3-ceph-common_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:14.790 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-common (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:15.110 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-prettytable. 2022-08-05T15:53:15.138 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2022-08-05T15:53:15.169 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2022-08-05T15:53:15.434 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rbd. 2022-08-05T15:53:15.451 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../015-python3-rbd_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:15.487 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rbd (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:15.860 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2022-08-05T15:53:15.861 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2022-08-05T15:53:15.878 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2022-08-05T15:53:16.239 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librabbitmq4:amd64. 2022-08-05T15:53:16.261 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2022-08-05T15:53:16.335 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2022-08-05T15:53:16.920 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librdkafka1:amd64. 2022-08-05T15:53:16.934 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2022-08-05T15:53:16.975 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-08-05T15:53:17.307 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librgw2. 2022-08-05T15:53:17.344 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../019-librgw2_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:17.355 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librgw2 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:18.165 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rgw. 2022-08-05T15:53:18.180 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../020-python3-rgw_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:18.224 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rgw (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:18.550 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liboath0. 2022-08-05T15:53:18.562 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2022-08-05T15:53:18.603 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2022-08-05T15:53:18.882 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libradosstriper1. 2022-08-05T15:53:18.932 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../022-libradosstriper1_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:18.935 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libradosstriper1 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:19.458 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-common. 2022-08-05T15:53:19.480 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../023-ceph-common_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:19.513 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-common (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:22.226 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-base. 2022-08-05T15:53:22.241 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../024-ceph-base_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:22.289 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-base (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:23.854 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cherrypy3. 2022-08-05T15:53:23.854 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2022-08-05T15:53:23.906 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2022-08-05T15:53:24.209 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-natsort. 2022-08-05T15:53:24.223 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2022-08-05T15:53:24.266 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-natsort (7.0.1-1) ... 2022-08-05T15:53:24.558 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-logutils. 2022-08-05T15:53:24.572 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2022-08-05T15:53:24.612 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-logutils (0.3.3-7) ... 2022-08-05T15:53:24.963 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-markupsafe. 2022-08-05T15:53:24.963 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2022-08-05T15:53:25.010 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2022-08-05T15:53:25.349 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-mako. 2022-08-05T15:53:25.370 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2022-08-05T15:53:25.439 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-08-05T15:53:25.763 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplegeneric. 2022-08-05T15:53:25.787 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2022-08-05T15:53:25.827 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2022-08-05T15:53:26.087 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-singledispatch. 2022-08-05T15:53:26.101 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2022-08-05T15:53:26.129 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2022-08-05T15:53:26.435 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webob. 2022-08-05T15:53:26.448 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2022-08-05T15:53:26.495 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2022-08-05T15:53:26.841 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-soupsieve. 2022-08-05T15:53:26.860 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2022-08-05T15:53:26.921 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2022-08-05T15:53:27.225 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bs4. 2022-08-05T15:53:27.255 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2022-08-05T15:53:27.304 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2022-08-05T15:53:27.720 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-waitress. 2022-08-05T15:53:27.720 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2022-08-05T15:53:27.760 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2022-08-05T15:53:28.120 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempita. 2022-08-05T15:53:28.135 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2022-08-05T15:53:28.174 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempita (0.5.2-6) ... 2022-08-05T15:53:28.471 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-paste. 2022-08-05T15:53:28.487 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2022-08-05T15:53:28.533 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2022-08-05T15:53:28.876 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2022-08-05T15:53:28.887 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2022-08-05T15:53:28.940 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2022-08-05T15:53:29.246 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastedeploy. 2022-08-05T15:53:29.248 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2022-08-05T15:53:29.294 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2022-08-05T15:53:29.572 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webtest. 2022-08-05T15:53:29.583 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2022-08-05T15:53:29.624 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webtest (2.0.32-2) ... 2022-08-05T15:53:29.956 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pecan. 2022-08-05T15:53:29.962 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2022-08-05T15:53:30.008 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2022-08-05T15:53:30.410 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-werkzeug. 2022-08-05T15:53:30.446 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2022-08-05T15:53:30.468 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2022-08-05T15:53:30.762 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2022-08-05T15:53:30.786 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:30.812 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-modules-core (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:31.193 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cryptography. 2022-08-05T15:53:31.223 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../044-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2022-08-05T15:53:31.267 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2022-08-05T15:53:31.620 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-openssl. 2022-08-05T15:53:31.636 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../045-python3-openssl_19.0.0-1build1_all.deb ... 2022-08-05T15:53:31.679 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2022-08-05T15:53:32.722 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2022-08-05T15:53:32.723 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../046-libsqlite3-mod-ceph_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:32.776 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libsqlite3-mod-ceph (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:33.128 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr. 2022-08-05T15:53:33.144 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../047-ceph-mgr_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:33.184 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:33.614 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mon. 2022-08-05T15:53:33.642 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../048-ceph-mon_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:33.662 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mon (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:34.773 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-osd. 2022-08-05T15:53:34.798 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../049-ceph-osd_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:34.846 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-osd (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:37.751 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph. 2022-08-05T15:53:37.791 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../050-ceph_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:37.828 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:38.072 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-fuse. 2022-08-05T15:53:38.099 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../051-ceph-fuse_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:38.155 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-fuse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:38.606 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mds. 2022-08-05T15:53:38.618 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../052-ceph-mds_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:38.657 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mds (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:39.215 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephadm. 2022-08-05T15:53:39.215 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../053-cephadm_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:39.270 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephadm (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:39.555 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-asyncssh. 2022-08-05T15:53:39.577 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2022-08-05T15:53:39.631 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2022-08-05T15:53:39.960 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jinja2. 2022-08-05T15:53:39.990 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2_all.deb ... 2022-08-05T15:53:40.018 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2022-08-05T15:53:40.352 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2022-08-05T15:53:40.353 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:40.402 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-cephadm (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:40.750 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bcrypt. 2022-08-05T15:53:40.763 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2022-08-05T15:53:40.835 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2022-08-05T15:53:41.118 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jwt. 2022-08-05T15:53:41.160 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2022-08-05T15:53:41.226 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2022-08-05T15:53:41.511 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-attr. 2022-08-05T15:53:41.512 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2022-08-05T15:53:41.560 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-attr (19.3.0-2) ... 2022-08-05T15:53:41.903 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pluggy. 2022-08-05T15:53:41.910 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2022-08-05T15:53:41.967 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2022-08-05T15:53:42.309 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-py. 2022-08-05T15:53:42.322 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2022-08-05T15:53:42.366 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2022-08-05T15:53:42.715 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-atomicwrites. 2022-08-05T15:53:42.725 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2022-08-05T15:53:42.761 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2022-08-05T15:53:43.413 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-packaging. 2022-08-05T15:53:43.425 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2022-08-05T15:53:43.492 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-packaging (20.3-1) ... 2022-08-05T15:53:43.776 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-wcwidth. 2022-08-05T15:53:43.777 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2022-08-05T15:53:43.808 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2022-08-05T15:53:44.089 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pytest. 2022-08-05T15:53:44.112 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2022-08-05T15:53:44.170 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pytest (4.6.9-1) ... 2022-08-05T15:53:44.472 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-repoze.lru. 2022-08-05T15:53:44.507 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2022-08-05T15:53:44.522 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2022-08-05T15:53:44.766 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjs-underscore. 2022-08-05T15:53:44.798 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2022-08-05T15:53:44.835 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-08-05T15:53:45.139 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjs-sphinxdoc. 2022-08-05T15:53:45.156 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2022-08-05T15:53:45.187 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-08-05T15:53:45.539 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-routes. 2022-08-05T15:53:45.543 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2022-08-05T15:53:45.602 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-routes (2.4.1-2) ... 2022-08-05T15:53:45.939 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2022-08-05T15:53:45.946 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:46.053 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-dashboard (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:46.517 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-decorator. 2022-08-05T15:53:46.531 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2022-08-05T15:53:46.569 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2022-08-05T15:53:46.854 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2022-08-05T15:53:46.875 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2022-08-05T15:53:46.938 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-08-05T15:53:47.255 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-scipy. 2022-08-05T15:53:47.265 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2022-08-05T15:53:47.318 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2022-08-05T15:53:48.726 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn-lib. 2022-08-05T15:53:48.775 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2022-08-05T15:53:48.781 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-08-05T15:53:49.369 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-joblib. 2022-08-05T15:53:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2022-08-05T15:53:49.426 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-joblib (0.14.0-3) ... 2022-08-05T15:53:49.779 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn. 2022-08-05T15:53:49.800 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2022-08-05T15:53:49.830 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-08-05T15:53:50.605 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2022-08-05T15:53:50.631 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:50.663 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:51.728 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cachetools. 2022-08-05T15:53:51.729 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2022-08-05T15:53:51.787 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2022-08-05T15:53:52.148 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1. 2022-08-05T15:53:52.177 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2022-08-05T15:53:52.199 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2022-08-05T15:53:52.544 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1-modules. 2022-08-05T15:53:52.573 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2022-08-05T15:53:52.607 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-08-05T15:53:53.014 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rsa. 2022-08-05T15:53:53.024 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2022-08-05T15:53:53.082 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rsa (4.0-3) ... 2022-08-05T15:53:53.412 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-google-auth. 2022-08-05T15:53:53.416 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2022-08-05T15:53:53.457 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2022-08-05T15:53:53.806 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-blinker. 2022-08-05T15:53:53.816 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2022-08-05T15:53:53.906 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-08-05T15:53:54.141 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-oauthlib. 2022-08-05T15:53:54.154 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2022-08-05T15:53:54.184 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2022-08-05T15:53:54.499 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-requests-oauthlib. 2022-08-05T15:53:54.501 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2022-08-05T15:53:54.562 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-08-05T15:53:54.851 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-websocket. 2022-08-05T15:53:54.875 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2022-08-05T15:53:54.938 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2022-08-05T15:53:55.276 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-kubernetes. 2022-08-05T15:53:55.292 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2022-08-05T15:53:55.344 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2022-08-05T15:53:55.913 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2022-08-05T15:53:55.944 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:53:55.971 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:53:56.298 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libonig5:amd64. 2022-08-05T15:53:56.314 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2022-08-05T15:53:56.351 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2022-08-05T15:53:56.730 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjq1:amd64. 2022-08-05T15:53:56.751 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-08-05T15:53:56.789 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-08-05T15:53:57.063 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package jq. 2022-08-05T15:53:57.085 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2022-08-05T15:53:57.128 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2022-08-05T15:53:57.393 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package socat. 2022-08-05T15:53:57.410 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2022-08-05T15:53:57.431 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking socat (1.7.3.3-2) ... 2022-08-05T15:53:57.818 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libxslt1.1:amd64. 2022-08-05T15:53:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../093-libxslt1.1_1.1.34-4_amd64.deb ... 2022-08-05T15:53:57.890 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2022-08-05T15:53:58.182 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package xmlstarlet. 2022-08-05T15:53:58.187 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../094-xmlstarlet_1.6.1-2build1_amd64.deb ... 2022-08-05T15:53:58.267 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2022-08-05T15:53:58.559 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-test. 2022-08-05T15:53:58.572 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../095-ceph-test_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:53:58.665 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-test (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:03.846 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-volume. 2022-08-05T15:54:03.863 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../096-ceph-volume_17.0.0-14045-g4a7e6c4a-1focal_all.deb ... 2022-08-05T15:54:03.902 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-volume (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:04.223 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package fonts-mathjax. 2022-08-05T15:54:04.253 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../097-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2022-08-05T15:54:04.283 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2022-08-05T15:54:04.794 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs-dev. 2022-08-05T15:54:04.812 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../098-libcephfs-dev_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:54:04.861 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs-dev (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:05.299 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package nvme-cli. 2022-08-05T15:54:05.299 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../099-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2022-08-05T15:54:05.359 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2022-08-05T15:54:05.742 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-asyncssh-doc. 2022-08-05T15:54:05.759 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../100-python-asyncssh-doc_1.12.2-1_all.deb ... 2022-08-05T15:54:05.803 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2022-08-05T15:54:06.190 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjs-mathjax. 2022-08-05T15:54:06.201 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../101-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2022-08-05T15:54:06.239 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2022-08-05T15:54:08.002 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-natsort-doc. 2022-08-05T15:54:08.014 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../102-python-natsort-doc_7.0.1-1_all.deb ... 2022-08-05T15:54:08.077 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2022-08-05T15:54:08.447 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webencodings. 2022-08-05T15:54:08.461 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../103-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2022-08-05T15:54:08.534 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2022-08-05T15:54:08.827 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-html5lib. 2022-08-05T15:54:08.833 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../104-python3-html5lib_1.0.1-2_all.deb ... 2022-08-05T15:54:08.855 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2022-08-05T15:54:09.200 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-lxml:amd64. 2022-08-05T15:54:09.235 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../105-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2022-08-05T15:54:09.249 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2022-08-05T15:54:09.754 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastescript. 2022-08-05T15:54:09.764 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2022-08-05T15:54:09.798 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2022-08-05T15:54:10.156 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-psutil. 2022-08-05T15:54:10.167 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../107-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2022-08-05T15:54:10.215 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2022-08-05T15:54:10.578 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyinotify. 2022-08-05T15:54:10.591 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2022-08-05T15:54:10.645 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-08-05T15:54:10.967 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplejson. 2022-08-05T15:54:10.973 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../109-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2022-08-05T15:54:11.018 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2022-08-05T15:54:11.300 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package qttranslations5-l10n. 2022-08-05T15:54:11.306 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../110-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2022-08-05T15:54:11.383 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2022-08-05T15:54:12.209 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package radosgw. 2022-08-05T15:54:12.210 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../111-radosgw_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:54:12.255 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking radosgw (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:14.461 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-fuse. 2022-08-05T15:54:14.471 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../112-rbd-fuse_17.0.0-14045-g4a7e6c4a-1focal_amd64.deb ... 2022-08-05T15:54:14.518 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-fuse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:14.852 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-attr (19.3.0-2) ... 2022-08-05T15:54:15.188 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2022-08-05T15:54:15.343 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2022-08-05T15:54:15.441 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2022-08-05T15:54:15.635 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephadm (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:16.273 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user cephadm....done 2022-08-05T15:54:16.424 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2022-08-05T15:54:16.528 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2022-08-05T15:54:16.937 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-repoze.lru (0.7-2) ... 2022-08-05T15:54:17.221 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2022-08-05T15:54:17.389 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liboath0 (2.6.1-1.3) ... 2022-08-05T15:54:17.525 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2022-08-05T15:54:17.899 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-joblib (0.14.0-3) ... 2022-08-05T15:54:18.326 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2022-08-05T15:54:18.611 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cachetools (4.0.0-1) ... 2022-08-05T15:54:18.927 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2022-08-05T15:54:19.218 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2022-08-05T15:54:19.671 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-argparse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:20.007 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2022-08-05T15:54:20.153 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2022-08-05T15:54:20.417 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2022-08-05T15:54:20.751 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libpcre2-16-0:amd64 (10.34-7) ... 2022-08-05T15:54:20.835 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2022-08-05T15:54:21.216 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-natsort (7.0.1-1) ... 2022-08-05T15:54:21.509 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2022-08-05T15:54:21.794 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2022-08-05T15:54:22.110 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2022-08-05T15:54:22.400 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2022-08-05T15:54:22.750 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempita (0.5.2-6) ... 2022-08-05T15:54:23.071 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-packaging (20.3-1) ... 2022-08-05T15:54:23.390 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2022-08-05T15:54:23.547 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2022-08-05T15:54:23.692 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2022-08-05T15:54:23.953 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2022-08-05T15:54:24.345 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2022-08-05T15:54:24.710 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2022-08-05T15:54:25.100 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up socat (1.7.3.3-2) ... 2022-08-05T15:54:25.219 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-common (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:25.550 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:54:25.666 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-html5lib (1.0.1-2) ... 2022-08-05T15:54:26.073 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2022-08-05T15:54:26.205 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pluggy (0.13.0-2) ... 2022-08-05T15:54:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:54:26.602 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2022-08-05T15:54:26.727 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2022-08-05T15:54:26.870 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2022-08-05T15:54:27.176 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2022-08-05T15:54:27.447 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-logutils (0.3.3-7) ... 2022-08-05T15:54:27.780 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2022-08-05T15:54:27.894 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2022-08-05T15:54:28.170 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-prettytable (0.7.2-5) ... 2022-08-05T15:54:28.500 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2022-08-05T15:54:28.809 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2022-08-05T15:54:29.123 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2022-08-05T15:54:29.413 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2022-08-05T15:54:29.537 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2022-08-05T15:54:29.890 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2022-08-05T15:54:30.243 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2022-08-05T15:54:30.364 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2022-08-05T15:54:30.517 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webob (1:1.8.5-2) ... 2022-08-05T15:54:30.864 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2022-08-05T15:54:31.134 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2022-08-05T15:54:32.613 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2022-08-05T15:54:32.738 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pytest (4.6.9-1) ... 2022-08-05T15:54:33.158 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2022-08-05T15:54:33.453 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2022-08-05T15:54:33.761 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2022-08-05T15:54:33.907 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bs4 (4.8.2-1) ... 2022-08-05T15:54:34.275 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2022-08-05T15:54:34.583 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2022-08-05T15:54:34.979 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2022-08-05T15:54:35.326 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2022-08-05T15:54:36.343 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2022-08-05T15:54:36.469 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2022-08-05T15:54:36.620 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2022-08-05T15:54:36.745 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2022-08-05T15:54:37.073 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2022-08-05T15:54:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rsa (4.0-3) ... 2022-08-05T15:54:37.522 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2022-08-05T15:54:37.673 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webtest (2.0.32-2) ... 2022-08-05T15:54:37.974 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2022-08-05T15:54:38.279 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastescript (2.0.2-4) ... 2022-08-05T15:54:38.594 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2022-08-05T15:54:38.901 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librados2 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:39.038 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2022-08-05T15:54:39.162 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librgw2 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:39.396 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libsqlite3-mod-ceph (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:39.546 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs2 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:39.647 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-routes (2.4.1-2) ... 2022-08-05T15:54:39.939 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libradosstriper1 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:40.058 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-google-auth (1.5.1-2) ... 2022-08-05T15:54:40.368 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librbd1 (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:40.490 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-modules-core (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:40.639 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-fuse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:40.893 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-08-05T15:54:40.903 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2022-08-05T15:54:41.315 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs-dev (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:41.443 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rados (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:41.594 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2022-08-05T15:54:42.503 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rbd (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:42.632 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-fuse (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:42.757 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rgw (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:42.915 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cephfs (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:43.032 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-common (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:43.595 INFO:teuthology.orchestra.run.smithi152.stdout:Adding group ceph....done 2022-08-05T15:54:44.024 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user ceph....done 2022-08-05T15:54:44.197 INFO:teuthology.orchestra.run.smithi152.stdout:Setting system user ceph properties....done 2022-08-05T15:54:44.213 INFO:teuthology.orchestra.run.smithi152.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2022-08-05T15:54:44.371 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2022-08-05T15:54:44.680 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2022-08-05T15:54:45.230 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-test (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:45.638 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up radosgw (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:45.918 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-08-05T15:54:45.919 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2022-08-05T15:54:46.562 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-base (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:46.960 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2022-08-05T15:54:47.399 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mds (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:47.637 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-08-05T15:54:47.637 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2022-08-05T15:54:48.091 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:48.323 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-08-05T15:54:48.323 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2022-08-05T15:54:48.810 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-osd (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:49.379 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-08-05T15:54:49.380 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2022-08-05T15:54:49.787 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-k8sevents (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:49.956 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:50.073 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mon (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:50.319 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-08-05T15:54:50.320 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2022-08-05T15:54:50.773 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-cephadm (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:50.982 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:51.090 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-dashboard (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:51.223 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-volume (17.0.0-14045-g4a7e6c4a-1focal) ... 2022-08-05T15:54:51.386 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2022-08-05T15:54:51.528 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2022-08-05T15:54:51.783 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.9.1-1) ... 2022-08-05T15:54:54.479 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2022-08-05T15:54:55.256 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2022-08-05T15:54:55.279 DEBUG:teuthology.parallel:result is None 2022-08-05T15:54:55.283 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T15:54:55.377 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T15:54:55.428 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T15:54:55.437 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=4a7e6c4ac29de794744a2ce76ca2b36bc637894d 2022-08-05T15:54:55.685 DEBUG:teuthology.orchestra.run.smithi152:> dpkg-query -W -f '${Version}' ceph 2022-08-05T15:54:55.724 INFO:teuthology.orchestra.run.smithi152.stdout:17.0.0-14045-g4a7e6c4a-1focal 2022-08-05T15:54:55.726 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-14045-g4a7e6c4a-1focal 2022-08-05T15:54:55.726 INFO:teuthology.task.install:The correct ceph version 17.0.0-14045-g4a7e6c4a-1focal is installed. 2022-08-05T15:54:55.727 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-08-05T15:54:55.728 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:55.729 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-08-05T15:54:55.788 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-08-05T15:54:55.788 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:55.803 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2022-08-05T15:54:55.879 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-08-05T15:54:56.018 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-08-05T15:54:56.024 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:56.026 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2022-08-05T15:54:56.178 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-08-05T15:54:56.214 INFO:teuthology.run_tasks:Running task ceph... 2022-08-05T15:54:57.078 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-08-05T15:54:57.129 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2022-08-05T15:54:57.188 INFO:tasks.ceph:Disabling ceph logrotate... 2022-08-05T15:54:57.199 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2022-08-05T15:54:57.260 INFO:tasks.ceph:Creating extra log directories... 2022-08-05T15:54:57.261 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-08-05T15:54:57.466 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-08-05T15:54:57.467 INFO:tasks.ceph:config {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['but it is still running', 'had wrong client addr', 'had wrong cluster addr', 'must scrub before tier agent can activate', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping updates', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(SMALLER_PG_NUM\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(FS_DEGRADED\\)', '\\(POOL_BACKFILLFULL\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_NEARFULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(AUTH_BAD_CAPS\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2022-08-05T15:54:57.468 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547', 'branch': 'wip-yuri4-testing-2022-08-04-1413', 'description': 'rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6959547', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2022-08-04-1413'}, 'ceph': {'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'mon_bind_msgr2': False, 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2022-08-04-1413', 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'sleep_before_teardown': 0, 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2022-08-04-1413', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'targets': {'smithi152.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDk63iqbZZAMmqVqs6ZEMFwb+WaB/QxfDLv/5OpwAFqiVauA7m+3+V6VLKsT6fYk5qfzeZjdoLVOiUZ60iEUMD46MjhDTTqjP4D935mbr/LhhfF8QoOwpdl3tZFwE8cW7xbm/hP+d34mdQvmYhIUqt5tyLml6k9rO5Qhiv6mgXkiH9qPI2rwrUhjtqLTRwsxRX358D2Rjafat01j3DykZvfSqYMe+0lhuaCAI/wWrpG3CafaqAx7DDwh0sIUB9Kjkrwp8wYRXrL93i88SzYbW0bS+ea/mbxX1ymbRQWq49t608WOOsESBHBoENTKKu4mEPhIP11Znsjuj62rLdo/lRXWU1NeK8Re51jXlp3FvRohUNib9wNpM7+hwdk/AAt8Ev3QtAiNFKYyiRzH2NpimhCzAaJMUmcID2GhQj1EfODpiVmZrCFsIN1UhZsCXGTyoa6iy15xvY97fXKese7Mfqn3yDb9l953/x5WceZdsycGejLDcfxSQy/boKyBV5iY6k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['but it is still running', 'had wrong client addr', 'had wrong cluster addr', 'must scrub before tier agent can activate', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping updates', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(SMALLER_PG_NUM\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(FS_DEGRADED\\)', '\\(POOL_BACKFILLFULL\\)', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(POOL_NEARFULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(AUTH_BAD_CAPS\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(MON_DOWN\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'conf': {'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon scrub interval': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'mon_bind_msgr2': False, 'sha1': '4a7e6c4ac29de794744a2ce76ca2b36bc637894d', 'cluster': 'ceph'}}, {'workunit': {'clients': {'all': ['cephtool', 'mon/pool_ops.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53', 'timestamp': '2022-08-05_14:49:51', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1713'} 2022-08-05T15:54:57.510 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-08-05T15:54:57.541 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2022-08-05T15:54:57.640 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:57.641 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2022-08-05T15:54:57.717 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-08-05T15:54:57.720 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-08-05T15:54:57.738 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-08-05T15:54:57.738 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:54:57.739 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 361 Links: 1 2022-08-05T15:54:57.739 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:54:57.739 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-08-05 15:52:00.326221610 +0000 2022-08-05T15:54:57.740 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-08-05 15:51:59.814221615 +0000 2022-08-05T15:54:57.740 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-08-05 15:51:59.814221615 +0000 2022-08-05T15:54:57.740 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-08-05T15:54:57.758 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-08-05T15:54:57.765 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-08-05T15:54:57.765 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000400931 s, 1.3 MB/s 2022-08-05T15:54:57.766 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-08-05T15:54:57.839 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-08-05T15:54:57.840 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:54:57.840 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 365 Links: 1 2022-08-05T15:54:57.840 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:54:57.840 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-08-05 15:52:01.022221602 +0000 2022-08-05T15:54:57.840 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-08-05 15:52:00.558221607 +0000 2022-08-05T15:54:57.841 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-08-05 15:52:00.558221607 +0000 2022-08-05T15:54:57.841 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-08-05T15:54:57.842 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-08-05T15:54:57.845 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-08-05T15:54:57.845 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000382484 s, 1.3 MB/s 2022-08-05T15:54:57.873 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-08-05T15:54:57.935 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-08-05T15:54:57.935 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:54:57.936 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 373 Links: 1 2022-08-05T15:54:57.936 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:54:57.936 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-08-05 15:52:01.754221594 +0000 2022-08-05T15:54:57.936 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-08-05 15:52:01.266221600 +0000 2022-08-05T15:54:57.937 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-08-05 15:52:01.266221600 +0000 2022-08-05T15:54:57.937 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-08-05T15:54:57.956 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-08-05T15:54:57.957 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-08-05T15:54:57.957 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000400116 s, 1.3 MB/s 2022-08-05T15:54:57.957 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-08-05T15:54:58.012 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-08-05T15:54:58.013 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-08-05T15:54:58.014 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 379 Links: 1 2022-08-05T15:54:58.014 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-08-05T15:54:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-08-05 15:52:02.438221587 +0000 2022-08-05T15:54:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-08-05 15:52:01.990221592 +0000 2022-08-05T15:54:58.015 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-08-05 15:52:01.990221592 +0000 2022-08-05T15:54:58.015 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-08-05T15:54:58.043 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-08-05T15:54:58.043 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-08-05T15:54:58.043 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000394533 s, 1.3 MB/s 2022-08-05T15:54:58.044 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2022-08-05T15:54:58.044 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2022-08-05T15:54:58.045 INFO:tasks.ceph:Generating config... 2022-08-05T15:54:58.053 INFO:tasks.ceph:[global] mon election default strategy = 1 2022-08-05T15:54:58.054 INFO:tasks.ceph:[global] ms bind msgr2 = False 2022-08-05T15:54:58.054 INFO:tasks.ceph:[global] ms type = async 2022-08-05T15:54:58.054 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-08-05T15:54:58.055 INFO:tasks.ceph:[mgr] debug ms = 1 2022-08-05T15:54:58.055 INFO:tasks.ceph:[mon] debug mon = 20 2022-08-05T15:54:58.055 INFO:tasks.ceph:[mon] debug ms = 1 2022-08-05T15:54:58.056 INFO:tasks.ceph:[mon] debug paxos = 20 2022-08-05T15:54:58.056 INFO:tasks.ceph:[mon] mon scrub interval = 300 2022-08-05T15:54:58.056 INFO:tasks.ceph:[osd] bdev async discard = True 2022-08-05T15:54:58.090 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-08-05T15:54:58.091 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-08-05T15:54:58.091 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-08-05T15:54:58.092 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-08-05T15:54:58.092 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2022-08-05T15:54:58.093 INFO:tasks.ceph:[osd] debug bluefs = 20 2022-08-05T15:54:58.093 INFO:tasks.ceph:[osd] debug bluestore = 20 2022-08-05T15:54:58.111 INFO:tasks.ceph:[osd] debug ms = 1 2022-08-05T15:54:58.112 INFO:tasks.ceph:[osd] debug osd = 20 2022-08-05T15:54:58.112 INFO:tasks.ceph:[osd] debug rocksdb = 10 2022-08-05T15:54:58.113 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-08-05T15:54:58.113 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-08-05T15:54:58.175 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-08-05T15:54:58.175 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2022-08-05T15:54:58.175 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2022-08-05T15:54:58.176 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-08-05T15:54:58.176 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-08-05T15:54:58.177 INFO:tasks.ceph:[osd] osd op queue = debug_random 2022-08-05T15:54:58.177 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2022-08-05T15:54:58.177 INFO:tasks.ceph:Setting up mon.a... 2022-08-05T15:54:58.218 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-08-05T15:54:58.282 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2022-08-05T15:54:58.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-08-05T15:54:58.483 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-05T15:54:58.524 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.152:6789]'), ('mon.b', '[v1:172.21.15.152:6790]'), ('mon.c', '[v1:172.21.15.152:6791]')] 2022-08-05T15:54:58.525 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.152:6789],[v1:172.21.15.152:6790],[v1:172.21.15.152:6791]', 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon scrub interval': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}} 2022-08-05T15:54:58.590 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:58.590 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-08-05T15:54:58.619 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.152:6789]' --addv b '[v1:172.21.15.152:6790]' --addv c '[v1:172.21.15.152:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:54:58.757 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:54:58.784 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid 7334a693-03a4-4efd-b3c1-1eb109cc2665 2022-08-05T15:54:58.785 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = octopus 2022-08-05T15:54:58.785 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2022-08-05T15:54:58.786 INFO:teuthology.orchestra.run.smithi152.stdout:fsid 7334a693-03a4-4efd-b3c1-1eb109cc2665 2022-08-05T15:54:58.786 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2022-08-05T15:54:58.716332+0000 2022-08-05T15:54:58.787 INFO:teuthology.orchestra.run.smithi152.stdout:created 2022-08-05T15:54:58.716332+0000 2022-08-05T15:54:58.787 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 15 (octopus) 2022-08-05T15:54:58.788 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2022-08-05T15:54:58.788 INFO:teuthology.orchestra.run.smithi152.stdout:0: v1:172.21.15.152:6789/0 mon.a 2022-08-05T15:54:58.789 INFO:teuthology.orchestra.run.smithi152.stdout:1: v1:172.21.15.152:6790/0 mon.b 2022-08-05T15:54:58.795 INFO:teuthology.orchestra.run.smithi152.stdout:2: v1:172.21.15.152:6791/0 mon.c 2022-08-05T15:54:58.795 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-08-05T15:54:58.814 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-08-05T15:54:58.879 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7334a693-03a4-4efd-b3c1-1eb109cc2665... 2022-08-05T15:54:58.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-08-05T15:54:58.945 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2022-08-05T15:54:58.946 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2022-08-05T15:54:58.946 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-08-05T15:54:58.946 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2022-08-05T15:54:58.947 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.947 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2022-08-05T15:54:58.947 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2022-08-05T15:54:58.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.949 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2022-08-05T15:54:58.949 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2022-08-05T15:54:58.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.950 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2022-08-05T15:54:58.950 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2022-08-05T15:54:58.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.950 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2022-08-05T15:54:58.951 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2022-08-05T15:54:58.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.951 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2022-08-05T15:54:58.951 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2022-08-05T15:54:58.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.952 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2022-08-05T15:54:58.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.983 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2022-08-05T15:54:58.984 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2022-08-05T15:54:58.984 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2022-08-05T15:54:58.984 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2022-08-05T15:54:58.984 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2022-08-05T15:54:58.985 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2022-08-05T15:54:58.985 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2022-08-05T15:54:58.985 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-08-05T15:54:58.985 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2022-08-05T15:54:58.986 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2022-08-05T15:54:58.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:58.986 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-08-05T15:54:58.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.003 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2022-08-05T15:54:59.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.004 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2022-08-05T15:54:59.004 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.004 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2022-08-05T15:54:59.005 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2022-08-05T15:54:59.006 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2022-08-05T15:54:59.006 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "[v1:172.21.15.152:6789],[v1:172.21.15.152:6790],[v1:172.21.15.152:6791]" 2022-08-05T15:54:59.007 INFO:teuthology.orchestra.run.smithi152.stdout: mon election default strategy = 1 2022-08-05T15:54:59.007 INFO:teuthology.orchestra.run.smithi152.stdout: ms bind msgr2 = False 2022-08-05T15:54:59.007 INFO:teuthology.orchestra.run.smithi152.stdout: ms type = async 2022-08-05T15:54:59.007 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 7334a693-03a4-4efd-b3c1-1eb109cc2665 2022-08-05T15:54:59.008 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.008 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2022-08-05T15:54:59.008 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2022-08-05T15:54:59.008 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.025 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2022-08-05T15:54:59.027 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2022-08-05T15:54:59.027 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.027 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2022-08-05T15:54:59.027 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2022-08-05T15:54:59.028 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.028 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2022-08-05T15:54:59.028 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2022-08-05T15:54:59.028 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2022-08-05T15:54:59.029 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.029 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2022-08-05T15:54:59.029 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2022-08-05T15:54:59.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2022-08-05T15:54:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2022-08-05T15:54:59.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2022-08-05T15:54:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.045 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2022-08-05T15:54:59.058 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2022-08-05T15:54:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2022-08-05T15:54:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2022-08-05T15:54:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2022-08-05T15:54:59.060 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2022-08-05T15:54:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2022-08-05T15:54:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2022-08-05T15:54:59.061 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2022-08-05T15:54:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore zero block detection = True 2022-08-05T15:54:59.062 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2022-08-05T15:54:59.087 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2022-08-05T15:54:59.088 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-08-05T15:54:59.088 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2022-08-05T15:54:59.089 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2022-08-05T15:54:59.089 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2022-08-05T15:54:59.137 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2022-08-05T15:54:59.139 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2022-08-05T15:54:59.139 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify cached snaps = True 2022-08-05T15:54:59.142 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify missing on start = True 2022-08-05T15:54:59.143 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2022-08-05T15:54:59.154 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2022-08-05T15:54:59.154 INFO:teuthology.orchestra.run.smithi152.stdout: osd op queue = debug_random 2022-08-05T15:54:59.154 INFO:teuthology.orchestra.run.smithi152.stdout: osd op queue cut off = debug_random 2022-08-05T15:54:59.154 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.155 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2022-08-05T15:54:59.155 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-08-05T15:54:59.155 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2022-08-05T15:54:59.155 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2022-08-05T15:54:59.156 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2022-08-05T15:54:59.156 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:54:59.156 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:54:59.156 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2022-08-05T15:54:59.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.160 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2022-08-05T15:54:59.160 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-08-05T15:54:59.171 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2022-08-05T15:54:59.171 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2022-08-05T15:54:59.172 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2022-08-05T15:54:59.173 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2022-08-05T15:54:59.173 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2022-08-05T15:54:59.173 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2022-08-05T15:54:59.173 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2022-08-05T15:54:59.174 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2022-08-05T15:54:59.174 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2022-08-05T15:54:59.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.174 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-08-05T15:54:59.175 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2022-08-05T15:54:59.210 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2022-08-05T15:54:59.210 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.211 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2022-08-05T15:54:59.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-08-05T15:54:59.211 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-08-05T15:54:59.216 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.217 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2022-08-05T15:54:59.217 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2022-08-05T15:54:59.218 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.218 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2022-08-05T15:54:59.219 INFO:teuthology.orchestra.run.smithi152.stdout: mon scrub interval = 300 2022-08-05T15:54:59.220 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:54:59.220 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2022-08-05T15:54:59.220 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2022-08-05T15:54:59.221 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2022-08-05T15:54:59.221 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2022-08-05T15:54:59.221 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-08-05T15:54:59.221 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-08-05T15:54:59.222 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2022-08-05T15:54:59.222 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2022-08-05T15:54:59.222 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2022-08-05T15:54:59.224 INFO:tasks.ceph:Creating admin key on mon.a... 2022-08-05T15:54:59.224 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-08-05T15:54:59.335 INFO:tasks.ceph:Copying monmap to all nodes... 2022-08-05T15:54:59.346 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:59.347 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-08-05T15:54:59.433 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:59.437 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-08-05T15:54:59.449 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:54:59.450 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:59.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2022-08-05T15:54:59.451 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-08-05T15:54:59.566 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:54:59.566 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:54:59.633 INFO:tasks.ceph:Setting up mon nodes... 2022-08-05T15:54:59.666 INFO:tasks.ceph:Setting up mgr nodes... 2022-08-05T15:54:59.723 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-08-05T15:54:59.847 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-08-05T15:54:59.848 INFO:tasks.ceph:Setting up mds nodes... 2022-08-05T15:54:59.848 INFO:tasks.ceph_client:Setting up client nodes... 2022-08-05T15:54:59.891 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-08-05T15:54:59.942 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-08-05T15:54:59.952 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-08-05T15:54:59.973 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2022-08-05T15:54:59.973 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-08-05T15:55:00.022 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2022-08-05T15:55:00.041 INFO:tasks.ceph:role: osd.0 2022-08-05T15:55:00.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:00.044 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-08-05T15:55:00.599 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:55:00.600 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:55:00.601 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:55:00.601 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2022-08-05T15:55:00.601 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:55:00.602 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:55:00.602 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:55:00.603 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:55:00.603 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:55:00.605 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:55:00.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-08-05T15:55:00.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-08-05T15:55:00.752 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-08-05T15:55:00.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:00.775 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2022-08-05T15:55:00.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-08-05T15:55:00.841 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2022-08-05T15:55:00.843 INFO:tasks.ceph:role: osd.1 2022-08-05T15:55:00.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:00.845 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-08-05T15:55:01.364 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:55:01.365 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:55:01.365 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:55:01.396 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2022-08-05T15:55:01.397 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:55:01.397 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:55:01.397 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:55:01.398 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:55:01.398 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:55:01.398 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:55:01.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-08-05T15:55:01.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-08-05T15:55:01.462 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-08-05T15:55:01.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:01.593 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2022-08-05T15:55:01.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-08-05T15:55:01.648 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2022-08-05T15:55:01.648 INFO:tasks.ceph:role: osd.2 2022-08-05T15:55:01.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:01.652 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-08-05T15:55:02.289 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-08-05T15:55:02.290 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-08-05T15:55:02.292 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-08-05T15:55:02.292 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 2022-08-05T15:55:02.293 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-08-05T15:55:02.293 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-08-05T15:55:02.293 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-08-05T15:55:02.318 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-08-05T15:55:02.319 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-08-05T15:55:02.319 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-08-05T15:55:02.320 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-08-05T15:55:02.321 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-08-05T15:55:02.457 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-08-05T15:55:02.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:02.483 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: /sbin/restorecon: command not found 2022-08-05T15:55:02.484 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:55:02.592 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.559+0000 7f1c572c5500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-08-05T15:55:02.593 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.563+0000 7f1c572c5500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-08-05T15:55:02.593 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.563+0000 7f1c572c5500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:55:02.593 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.563+0000 7f1c572c5500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:55:02.594 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.563+0000 7f1c572c5500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-08-05T15:55:02.594 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:02.571+0000 7f1c572c5500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-08-05T15:55:05.589 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-08-05T15:55:05.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:55:05.765 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-08-05T15:55:05.765 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-08-05T15:55:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:55:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:55:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-08-05T15:55:05.766 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:05.759+0000 7fb874ed5500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-08-05T15:55:08.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-08-05T15:55:08.770 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:55:08.868 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-08-05T15:55:08.868 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-08-05T15:55:08.868 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:55:08.869 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:55:08.869 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-08-05T15:55:08.869 INFO:teuthology.orchestra.run.smithi152.stderr:2022-08-05T15:55:08.855+0000 7fc704c57500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-08-05T15:55:11.851 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-08-05T15:55:11.902 INFO:tasks.ceph:Reading keys from all nodes... 2022-08-05T15:55:11.914 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:11.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-08-05T15:55:11.968 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:11.969 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-08-05T15:55:11.986 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:11.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-08-05T15:55:12.047 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:12.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-08-05T15:55:12.100 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:12.100 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-08-05T15:55:12.171 INFO:tasks.ceph:Adding keys to all mons... 2022-08-05T15:55:12.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2022-08-05T15:55:12.226 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2022-08-05T15:55:12.226 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBTPe1i+0X3MBAAFd8dVebeF9xxbhMZMUUCgA== 2022-08-05T15:55:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2022-08-05T15:55:12.227 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBWPe1inISnIRAAq7X0qTkPmLL4RyjpKM7SIg== 2022-08-05T15:55:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2022-08-05T15:55:12.227 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBZPe1iWiduLRAAZ6Ex1XfZXEbbDuuvZTn5zg== 2022-08-05T15:55:12.239 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2022-08-05T15:55:12.239 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBcPe1i/Mk8MxAALw93+fWZiKgCtzdvaYlOig== 2022-08-05T15:55:12.240 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2022-08-05T15:55:12.240 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQBTPe1iXUf3NxAAKNuopaEpxLz5s7rLg+lfGw== 2022-08-05T15:55:12.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-08-05T15:55:12.327 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:55:12.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:55:12.491 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-08-05T15:55:12.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-08-05T15:55:12.703 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-08-05T15:55:12.703 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-08-05T15:55:12.732 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:55:12.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-08-05T15:55:12.901 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-08-05T15:55:12.929 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:55:13.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-08-05T15:55:13.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-08-05T15:55:13.198 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-08-05T15:55:13.343 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-08-05T15:55:13.399 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-08-05T15:55:13.463 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-08-05T15:55:13.464 INFO:tasks.ceph.mon.a:Restarting daemon 2022-08-05T15:55:13.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-08-05T15:55:13.488 INFO:tasks.ceph.mon.a:Started 2022-08-05T15:55:13.489 INFO:tasks.ceph.mon.b:Restarting daemon 2022-08-05T15:55:13.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-08-05T15:55:13.521 INFO:tasks.ceph.mon.b:Started 2022-08-05T15:55:13.522 INFO:tasks.ceph.mon.c:Restarting daemon 2022-08-05T15:55:13.523 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-08-05T15:55:13.566 INFO:tasks.ceph.mon.c:Started 2022-08-05T15:55:13.567 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-08-05T15:55:13.567 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-08-05T15:55:13.581 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-08-05T15:55:13.607 INFO:tasks.ceph.mgr.x:Started 2022-08-05T15:55:13.609 INFO:tasks.ceph:Setting crush tunables to default 2022-08-05T15:55:13.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2022-08-05T15:55:13.972 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2022-08-05T15:55:13.995 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-08-05T15:55:14.034 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:14.035 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-08-05T15:55:14.075 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:14.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-08-05T15:55:14.144 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-08-05T15:55:14.147 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-08-05T15:55:14.169 INFO:tasks.ceph.mgr.x.smithi152.stderr:2022-08-05T15:55:14.163+0000 7fe818862140 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-08-05T15:55:14.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 567980e5-318e-4faa-8946-cb6d9aedcbd3 0 2022-08-05T15:55:14.437 INFO:teuthology.orchestra.run.smithi152.stdout:0 2022-08-05T15:55:14.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 7d65b011-a5de-4c8f-bbe9-2bda7c7834a8 1 2022-08-05T15:55:14.722 INFO:teuthology.orchestra.run.smithi152.stdout:1 2022-08-05T15:55:14.726 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd new 53b9be67-05cc-4873-89d3-4a2f1f3c5bf8 2 2022-08-05T15:55:14.992 INFO:teuthology.orchestra.run.smithi152.stdout:2 2022-08-05T15:55:15.003 INFO:tasks.ceph.osd.0:Restarting daemon 2022-08-05T15:55:15.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-08-05T15:55:15.023 INFO:tasks.ceph.osd.0:Started 2022-08-05T15:55:15.023 INFO:tasks.ceph.osd.1:Restarting daemon 2022-08-05T15:55:15.025 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-08-05T15:55:15.070 INFO:tasks.ceph.osd.1:Started 2022-08-05T15:55:15.071 INFO:tasks.ceph.osd.2:Restarting daemon 2022-08-05T15:55:15.072 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-08-05T15:55:15.100 INFO:tasks.ceph.mgr.x.smithi152.stderr:2022-08-05T15:55:15.051+0000 7fe818862140 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-08-05T15:55:15.120 INFO:tasks.ceph.osd.0.smithi152.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:55:15.121 INFO:tasks.ceph.osd.0.smithi152.stderr: in thread 7f5f627da500 thread_name:ceph-osd 2022-08-05T15:55:15.177 INFO:tasks.ceph.osd.2:Started 2022-08-05T15:55:15.178 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-08-05T15:55:15.184 INFO:tasks.ceph.osd.1.smithi152.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:55:15.186 INFO:tasks.ceph.osd.1.smithi152.stderr: in thread 7f1d47165500 thread_name:ceph-osd 2022-08-05T15:55:15.212 INFO:tasks.ceph.osd.2.smithi152.stderr:*** Caught signal (Segmentation fault) ** 2022-08-05T15:55:15.213 INFO:tasks.ceph.osd.2.smithi152.stderr: in thread 7f59e0efd500 thread_name:ceph-osd 2022-08-05T15:55:15.307 INFO:tasks.ceph.osd.0.smithi152.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:55:15.308 INFO:tasks.ceph.osd.1.smithi152.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:55:15.368 INFO:tasks.ceph.mgr.x.smithi152.stderr:2022-08-05T15:55:15.355+0000 7fe818862140 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-08-05T15:55:15.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-08-05T15:55:15.402 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":5,"fsid":"7334a693-03a4-4efd-b3c1-1eb109cc2665","created":"2022-08-05T15:55:13.844202+0000","modified":"2022-08-05T15:55:14.976278+0000","last_up_change":"0.000000","last_in_change":"2022-08-05T15:55:14.976278+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"567980e5-318e-4faa-8946-cb6d9aedcbd3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7d65b011-a5de-4c8f-bbe9-2bda7c7834a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"53b9be67-05cc-4873-89d3-4a2f1f3c5bf8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-08-05T15:55:15.403 INFO:tasks.ceph.osd.2.smithi152.stderr:daemon-helper: command crashed with signal 11 2022-08-05T15:55:15.428 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-08-05T15:55:15.430 INFO:tasks.ceph:Waiting for OSDs to come up 2022-08-05T15:55:15.459 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:55:15.460 INFO:teuthology.misc:Shutting down osd daemons... 2022-08-05T15:55:15.464 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2022-08-05T15:55:15.466 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:15.498 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:55:15.501 INFO:tasks.ceph.osd.0:Stopped 2022-08-05T15:55:15.501 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2022-08-05T15:55:15.502 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:15.504 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1' 2022-08-05T15:55:15.506 INFO:tasks.ceph.osd.1:Stopped 2022-08-05T15:55:15.510 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2022-08-05T15:55:15.512 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.513 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-08-05T15:55:15.514 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1441, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2' 2022-08-05T15:55:15.515 INFO:tasks.ceph.osd.2:Stopped 2022-08-05T15:55:15.522 INFO:teuthology.misc:Shutting down mgr daemons... 2022-08-05T15:55:15.524 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2022-08-05T15:55:15.531 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.532 INFO:tasks.ceph.mgr.x.smithi152.stderr:2022-08-05T15:55:15.475+0000 7fe818862140 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-08-05T15:55:15.563 INFO:tasks.ceph.mgr.x:Stopped 2022-08-05T15:55:15.564 INFO:teuthology.misc:Shutting down mon daemons... 2022-08-05T15:55:15.571 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2022-08-05T15:55:15.574 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.589 INFO:tasks.ceph.mon.a:Stopped 2022-08-05T15:55:15.591 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2022-08-05T15:55:15.598 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.650 INFO:tasks.ceph.mon.b:Stopped 2022-08-05T15:55:15.651 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2022-08-05T15:55:15.653 INFO:teuthology.orchestra.run:waiting for 300 2022-08-05T15:55:15.668 INFO:tasks.ceph.mon.c:Stopped 2022-08-05T15:55:15.669 INFO:tasks.ceph:Checking cluster log for badness... 2022-08-05T15:55:15.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'had wrong client addr' | egrep -v 'had wrong cluster addr' | egrep -v 'must scrub before tier agent can activate' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping updates' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PG_NUM\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(POOL_BACKFILLFULL\)' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(POOL_NEARFULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(AUTH_BAD_CAPS\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2022-08-05T15:55:15.706 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:15.708 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2022-08-05T15:55:16.667 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:16.669 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2022-08-05T15:55:17.112 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:17.113 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2022-08-05T15:55:17.299 INFO:tasks.ceph:Archiving mon data... 2022-08-05T15:55:17.302 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/data/mon.a.tgz 2022-08-05T15:55:17.302 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T15:55:17.320 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.qN0JZS7RLK 2022-08-05T15:55:17.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qN0JZS7RLK 2022-08-05T15:55:17.405 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.qN0JZS7RLK 2022-08-05T15:55:17.617 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.qN0JZS7RLK is 16KB 2022-08-05T15:55:17.643 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.qN0JZS7RLK 2022-08-05T15:55:17.654 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/data/mon.b.tgz 2022-08-05T15:55:17.655 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T15:55:17.703 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.o3gqxnWjWX 2022-08-05T15:55:17.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.o3gqxnWjWX 2022-08-05T15:55:17.759 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.o3gqxnWjWX 2022-08-05T15:55:17.845 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.o3gqxnWjWX is 17KB 2022-08-05T15:55:17.871 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.o3gqxnWjWX 2022-08-05T15:55:17.887 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/data/mon.c.tgz 2022-08-05T15:55:17.888 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T15:55:17.947 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.ThfHNuDx71 2022-08-05T15:55:17.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ThfHNuDx71 2022-08-05T15:55:17.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.ThfHNuDx71 2022-08-05T15:55:18.097 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.ThfHNuDx71 is 17KB 2022-08-05T15:55:18.233 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.ThfHNuDx71 2022-08-05T15:55:18.273 INFO:tasks.ceph:Cleaning ceph cluster... 2022-08-05T15:55:18.300 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2022-08-05T15:55:18.356 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2022-08-05T15:55:18.357 DEBUG:teuthology.orchestra.run.smithi152:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2022-08-05T15:55:18.439 INFO:teuthology.orchestra.run.smithi152.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2022-08-05T15:55:18.440 INFO:tasks.ceph:Archiving crash dumps... 2022-08-05T15:55:18.451 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152/crash 2022-08-05T15:55:18.464 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2022-08-05T15:55:18.528 INFO:tasks.ceph:Compressing logs... 2022-08-05T15:55:18.530 DEBUG:teuthology.orchestra.run.smithi152:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:55:18.696 INFO:tasks.ceph:Archiving logs... 2022-08-05T15:55:18.697 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152/log 2022-08-05T15:55:18.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/log/ceph -- . 2022-08-05T15:55:18.965 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:55:19.700 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3912035da01b4742a1159826ad2df41a Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 55, in nested raise exc[1] File "/usr/lib/python3.6/contextlib.py", line 99, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/contextutil.py", line 31, in nested vars.append(enter()) File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_4a7e6c4ac29de794744a2ce76ca2b36bc637894d/qa/tasks/ceph.py", line 403, in create_rbd_pool ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/misc.py", line 866, in wait_until_osds_up daemon.check_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/daemon/state.py", line 43, in check_status return self.proc.poll() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 211, in poll self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status node=self.hostname, label=self.label teuthology.exceptions.CommandFailedError: Command failed on smithi152 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0' 2022-08-05T15:55:19.707 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2022-08-05T15:55:19.761 DEBUG:teuthology.run_tasks:Unwinding manager install 2022-08-05T15:55:19.814 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2022-08-05T15:55:19.816 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2022-08-05T15:55:20.036 DEBUG:teuthology.run_tasks:Unwinding manager clock 2022-08-05T15:55:20.068 INFO:teuthology.task.clock:Checking final clock skew... 2022-08-05T15:55:20.069 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-08-05T15:55:20.104 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2022-08-05T15:55:20.104 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2022-08-05T15:55:20.105 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi 216.240.36.24 3 u 10 64 7 0.091 -1.062 0.949 2022-08-05T15:55:20.105 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi 163.237.218.18 2 u 11 64 7 0.070 -1.535 0.783 2022-08-05T15:55:20.105 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi 216.229.4.69 3 u 11 64 7 0.191 -2.802 1.032 2022-08-05T15:55:20.110 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2022-08-05T15:55:20.111 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2022-08-05T15:55:20.123 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2022-08-05T15:55:20.140 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2022-08-05T15:55:20.156 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2022-08-05T15:55:20.230 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2022-08-05T15:55:20.271 INFO:teuthology.task.internal:Duration was 539.132948 seconds 2022-08-05T15:55:20.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2022-08-05T15:55:20.333 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2022-08-05T15:55:20.334 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2022-08-05T15:55:20.391 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2022-08-05T15:55:20.391 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2022-08-05T15:55:20.410 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2022-08-05T15:55:20.463 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2022-08-05T15:55:20.465 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2022-08-05T15:55:20.523 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2022-08-05T15:55:20.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2022-08-05T15:55:20.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2022-08-05T15:55:20.778 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2022-08-05T15:55:20.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2022-08-05T15:55:20.807 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2022-08-05T15:55:20.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:55:20.862 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2022-08-05T15:55:20.923 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2022-08-05T15:55:20.951 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi152.front.sepia.ceph.com, flagging run as failed 2022-08-05T15:55:20.952 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2022-08-05T15:55:21.005 INFO:teuthology.task.internal:Transferring archived files... 2022-08-05T15:55:21.121 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152 2022-08-05T15:55:21.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2022-08-05T15:58:36.151 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2022-08-05T15:58:36.500 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152/coredump/1659714915.25772.core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 1', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-osd', platform: 'x86_64' 2022-08-05T15:58:36.562 DEBUG:teuthology.orchestra.run.smithi152:> which ceph-osd 2022-08-05T15:58:36.737 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-osd 2022-08-05T15:58:36.881 DEBUG:teuthology.orchestra.remote:smithi152:/usr/bin/ceph-osd is 39MB 2022-08-05T15:59:01.721 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T15:59:01.795 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T15:59:01.843 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T15:59:01.845 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T15:59:02.016 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.vVgCIz7uiH 2022-08-05T15:59:02.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /usr/bin/ceph-osd /tmp/tmp.vVgCIz7uiH 2022-08-05T15:59:02.401 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.vVgCIz7uiH 2022-08-05T15:59:02.658 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.vVgCIz7uiH is 39MB 2022-08-05T15:59:32.255 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.vVgCIz7uiH 2022-08-05T15:59:32.585 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152/coredump/1659714915.25787.core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 2', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-osd', platform: 'x86_64' 2022-08-05T15:59:32.587 DEBUG:teuthology.orchestra.run.smithi152:> which ceph-osd 2022-08-05T15:59:32.653 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-osd 2022-08-05T15:59:32.889 DEBUG:teuthology.orchestra.remote:smithi152:/usr/bin/ceph-osd is 39MB 2022-08-05T15:59:53.221 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T15:59:53.423 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T15:59:53.424 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T15:59:53.425 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T15:59:53.465 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.5IyHj8WpaC 2022-08-05T15:59:53.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /usr/bin/ceph-osd /tmp/tmp.5IyHj8WpaC 2022-08-05T15:59:53.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.5IyHj8WpaC 2022-08-05T15:59:54.318 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.5IyHj8WpaC is 39MB 2022-08-05T16:00:18.815 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.5IyHj8WpaC 2022-08-05T16:00:19.282 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547/remote/smithi152/coredump/1659714915.25759.core: ELF 64-bit LSB core file x86-64, version 1 (SYSV), SVR4-style, from 'ceph-osd -f --cluster ceph -i 0', real uid: 0, effective uid: 0, real gid: 0, effective gid: 0, execfn: '/usr/bin/ceph-osd', platform: 'x86_64' 2022-08-05T16:00:19.284 DEBUG:teuthology.orchestra.run.smithi152:> which ceph-osd 2022-08-05T16:00:19.357 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/ceph-osd 2022-08-05T16:00:19.643 DEBUG:teuthology.orchestra.remote:smithi152:/usr/bin/ceph-osd is 39MB 2022-08-05T16:00:46.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-08-05T16:00:46.300 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2022-08-05T16:00:46.301 DEBUG:teuthology.misc:System to be installed: Ubuntu 2022-08-05T16:00:46.302 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2022-08-05T16:00:46.431 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.LN9t59pqCT 2022-08-05T16:00:46.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /usr/bin/ceph-osd /tmp/tmp.LN9t59pqCT 2022-08-05T16:00:46.825 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.LN9t59pqCT 2022-08-05T16:00:47.369 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.LN9t59pqCT is 39MB 2022-08-05T16:01:14.467 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.LN9t59pqCT 2022-08-05T16:01:14.704 INFO:teuthology.task.internal:Removing archive directory... 2022-08-05T16:01:14.705 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2022-08-05T16:01:14.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2022-08-05T16:01:14.999 INFO:teuthology.task.internal:Not uploading archives. 2022-08-05T16:01:15.008 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2022-08-05T16:01:15.208 INFO:teuthology.task.internal:Tidying up after the test... 2022-08-05T16:01:15.209 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2022-08-05T16:01:15.421 INFO:teuthology.orchestra.run.smithi152.stdout: 524316 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 5 16:01 /home/ubuntu/cephtest 2022-08-05T16:01:15.422 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2022-08-05T16:01:16.112 INFO:teuthology.nuke:Checking targets against current locks 2022-08-05T16:01:16.322 DEBUG:teuthology.nuke:shortname: smithi152 2022-08-05T16:01:16.324 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-08-05T16:01:16.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-08-05_14:49:51-rados-wip-yuri4-testing-2022-08-04-1413-distro-default-smithi/6959547', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-08-05 15:40:15.890873', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDk63iqbZZAMmqVqs6ZEMFwb+WaB/QxfDLv/5OpwAFqiVauA7m+3+V6VLKsT6fYk5qfzeZjdoLVOiUZ60iEUMD46MjhDTTqjP4D935mbr/LhhfF8QoOwpdl3tZFwE8cW7xbm/hP+d34mdQvmYhIUqt5tyLml6k9rO5Qhiv6mgXkiH9qPI2rwrUhjtqLTRwsxRX358D2Rjafat01j3DykZvfSqYMe+0lhuaCAI/wWrpG3CafaqAx7DDwh0sIUB9Kjkrwp8wYRXrL93i88SzYbW0bS+ea/mbxX1ymbRQWq49t608WOOsESBHBoENTKKu4mEPhIP11Znsjuj62rLdo/lRXWU1NeK8Re51jXlp3FvRohUNib9wNpM7+hwdk/AAt8Ev3QtAiNFKYyiRzH2NpimhCzAaJMUmcID2GhQj1EfODpiVmZrCFsIN1UhZsCXGTyoa6iy15xvY97fXKese7Mfqn3yDb9l953/x5WceZdsycGejLDcfxSQy/boKyBV5iY6k='} 2022-08-05T16:01:17.125 INFO:teuthology.orchestra.console:Power off smithi152 2022-08-05T16:01:17.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2022-08-05T16:01:17.364 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T16:01:21.446 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T16:01:25.697 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2022-08-05T16:01:26.052 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2022-08-05T16:01:26.245 INFO:teuthology.run:Summary data: description: rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} duration: 539.1329479217529 failure_reason: 'Command failed on smithi152 with status 1: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3912035da01b4742a1159826ad2df41a status: fail success: false 2022-08-05T16:01:26.261 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-08-05T16:01:26.583 INFO:teuthology.run:FAIL