2023-06-23T01:09:24.421 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-23T01:09:24.422 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949 --verbose --owner scheduled_yuriw@teuthology --description fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} --name yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi -- /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/orig.config.yaml 2023-06-23T01:09:24.461 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:09:24.555 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949 branch: wip-yuri4-testing-2023-06-21-0846-quincy description: fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} email: yweinste@redhat.com first_in_suite: false job_id: '7311949' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-06-21-0846-quincy ceph: conf: client: client acl type: posix_acl client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-06-21-0846-quincy sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 seed: 9037 sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri4-testing-2023-06-21-0846-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi192.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - workunit: clients: all: - fs/misc/acl.sh - fs/misc/chmod.sh - fs/misc/dac_override.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 076bbebc42a14f7d568aaa78eabb0038327bcb23 timestamp: 2023-06-22_15:25:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-23T01:09:24.555 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa; will attempt to use it 2023-06-23T01:09:24.556 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks 2023-06-23T01:09:24.557 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-23T01:09:24.559 INFO:teuthology.task.internal:Checking packages... 2023-06-23T01:09:24.589 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '42ddc46e6e6582d8e29a5a982a81886fe028be2c' 2023-06-23T01:09:24.589 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-23T01:09:24.590 INFO:teuthology.packaging:ref: None 2023-06-23T01:09:24.590 INFO:teuthology.packaging:tag: None 2023-06-23T01:09:24.590 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-23T01:09:24.590 INFO:teuthology.packaging:sha1: 42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T01:09:24.591 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-06-21-0846-quincy 2023-06-23T01:09:24.813 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-719-g42ddc46e-1focal 2023-06-23T01:09:24.814 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-23T01:09:24.821 INFO:teuthology.task.internal:no buildpackages task found 2023-06-23T01:09:24.821 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-23T01:09:24.868 INFO:teuthology.task.internal:Saving configuration 2023-06-23T01:09:24.887 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-23T01:09:24.959 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:09:24.989 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:03:33.189921', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-23T01:09:25.009 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:03:33.187711', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-23T01:09:25.009 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-23T01:09:25.016 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-06-23T01:09:25.016 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-06-23T01:09:25.016 INFO:teuthology.run_tasks:Running task console_log... 2023-06-23T01:09:25.151 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdb10207ee0>, signals=[15]) 2023-06-23T01:09:25.153 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-23T01:09:25.165 INFO:teuthology.task.internal:Opening connections... 2023-06-23T01:09:25.165 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:09:25.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:09:25.223 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:09:25.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:09:25.274 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-23T01:09:25.281 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-06-23T01:09:25.310 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-06-23T01:09:25.311 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-06-23T01:09:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-06-23T01:09:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T01:09:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-06-23T01:09:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-06-23T01:09:25.358 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="20.04" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=focal 2023-06-23T01:09:25.359 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=focal 2023-06-23T01:09:25.360 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-06-23T01:09:25.386 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2023-06-23T01:09:25.393 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2023-06-23T01:09:25.393 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2023-06-23T01:09:25.441 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="Ubuntu" 2023-06-23T01:09:25.441 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-23T01:09:25.441 INFO:teuthology.orchestra.run.smithi192.stdout:ID=ubuntu 2023-06-23T01:09:25.441 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE=debian 2023-06-23T01:09:25.441 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="20.04" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-23T01:09:25.442 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_CODENAME=focal 2023-06-23T01:09:25.443 INFO:teuthology.orchestra.run.smithi192.stdout:UBUNTU_CODENAME=focal 2023-06-23T01:09:25.443 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2023-06-23T01:09:25.461 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-23T01:09:25.470 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-23T01:09:25.525 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-23T01:09:25.525 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-06-23T01:09:25.528 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2023-06-23T01:09:25.533 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-23T01:09:25.539 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-23T01:09:25.539 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-06-23T01:09:25.574 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2023-06-23T01:09:25.592 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-23T01:09:25.659 INFO:teuthology.run_tasks:Running task kernel... 2023-06-23T01:09:25.674 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-23T01:09:25.675 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-23T01:09:25.676 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T01:09:25.676 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-23T01:09:25.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:09:25.682 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-06-23T01:09:25.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:09:25.683 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-06-23T01:09:25.689 INFO:teuthology.orchestra.run.smithi045.stdout:5.4.0-124-generic 2023-06-23T01:09:25.689 INFO:teuthology.task.kernel:Running kernel on smithi045: 5.4.0-124-generic 2023-06-23T01:09:25.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get clean 2023-06-23T01:09:25.690 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-124-generic 2023-06-23T01:09:25.691 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.4.0-124-generic 2023-06-23T01:09:25.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-06-23T01:09:25.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-06-23T01:09:25.840 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T01:09:26.115 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:09:26.115 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T01:09:26.139 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:09:26.140 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-06-23T01:09:26.169 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T01:09:26.187 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-06-23T01:09:26.513 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T01:09:26.530 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-06-23T01:09:26.588 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-23T01:09:26.610 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [613 kB] 2023-06-23T01:09:26.735 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-23T01:09:26.748 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [844 kB] 2023-06-23T01:09:26.928 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-23T01:09:26.956 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,267 kB] 2023-06-23T01:09:27.059 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,648 kB] 2023-06-23T01:09:27.072 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,648 kB] 2023-06-23T01:09:27.112 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-23T01:09:27.127 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-23T01:09:27.128 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-23T01:09:27.141 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [362 kB] 2023-06-23T01:09:27.155 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-06-23T01:09:27.156 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [1,885 kB] 2023-06-23T01:09:27.190 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-23T01:09:27.191 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-23T01:09:27.197 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-23T01:09:27.197 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-23T01:09:27.209 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-23T01:09:27.219 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [30.3 kB] 2023-06-23T01:09:27.220 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [264 kB] 2023-06-23T01:09:27.226 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [640 B] 2023-06-23T01:09:27.226 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [603 kB] 2023-06-23T01:09:27.233 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-23T01:09:27.238 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [849 kB] 2023-06-23T01:09:27.244 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [444 kB] 2023-06-23T01:09:27.246 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-23T01:09:27.246 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-23T01:09:27.247 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-23T01:09:27.257 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [16.9 kB] 2023-06-23T01:09:27.257 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [1,994 kB] 2023-06-23T01:09:27.316 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [31.6 kB] 2023-06-23T01:09:27.316 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-23T01:09:27.324 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-23T01:09:27.331 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [280 kB] 2023-06-23T01:09:27.336 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [636 B] 2023-06-23T01:09:27.408 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-23T01:09:27.435 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [176 kB] 2023-06-23T01:09:27.488 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-23T01:09:27.499 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-23T01:09:27.817 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-23T01:09:27.823 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-23T01:09:27.831 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-23T01:09:27.833 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-23T01:09:27.835 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-23T01:09:27.843 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [18.6 kB] 2023-06-23T01:09:27.849 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,204 B] 2023-06-23T01:09:27.852 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [22.9 kB] 2023-06-23T01:09:27.860 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,488 B] 2023-06-23T01:09:27.862 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [540 B] 2023-06-23T01:09:28.073 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,074 kB] 2023-06-23T01:09:28.126 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [733 kB] 2023-06-23T01:09:28.166 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-23T01:09:28.179 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-23T01:09:28.180 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-23T01:09:28.181 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-23T01:09:28.182 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [256 kB] 2023-06-23T01:09:28.183 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-23T01:09:28.183 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-23T01:09:28.183 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-23T01:09:28.201 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.1 kB] 2023-06-23T01:09:28.202 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-06-23T01:09:28.204 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.2 kB] 2023-06-23T01:09:28.205 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,408 B] 2023-06-23T01:09:28.206 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [612 B] 2023-06-23T01:09:28.206 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-06-23T01:09:28.208 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-23T01:09:28.208 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-06-23T01:09:28.210 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-23T01:09:28.211 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-06-23T01:09:28.374 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-23T01:09:28.375 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-23T01:09:28.539 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-06-23T01:09:28.558 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-06-23T01:09:28.580 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-23T01:09:28.590 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-06-23T01:09:30.668 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 16.0 MB in 3s (5,548 kB/s) 2023-06-23T01:09:30.782 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 16.0 MB in 3s (5,472 kB/s) 2023-06-23T01:09:32.129 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:09:32.150 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T01:09:32.171 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:09:32.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T01:09:32.224 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:09:32.282 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:09:32.421 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T01:09:32.421 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T01:09:32.483 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-06-23T01:09:32.483 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-06-23T01:09:32.598 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T01:09:32.598 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T01:09:32.598 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-23T01:09:32.599 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-23T01:09:32.599 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T01:09:32.599 INFO:teuthology.orchestra.run.smithi192.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-23T01:09:32.599 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-06-23T01:09:32.599 INFO:teuthology.orchestra.run.smithi192.stdout: thermald 2023-06-23T01:09:32.657 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T01:09:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T01:09:32.657 INFO:teuthology.orchestra.run.smithi192.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-23T01:09:32.658 INFO:teuthology.orchestra.run.smithi192.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-23T01:09:32.658 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-06-23T01:09:32.659 INFO:teuthology.orchestra.run.smithi192.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T01:09:32.667 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-06-23T01:09:32.667 INFO:teuthology.orchestra.run.smithi045.stdout: linux-generic linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T01:09:32.668 INFO:teuthology.orchestra.run.smithi045.stdout: linux-headers-generic linux-image-5.4.0-152-generic 2023-06-23T01:09:32.668 INFO:teuthology.orchestra.run.smithi045.stdout: linux-modules-5.4.0-152-generic linux-modules-extra-5.4.0-152-generic 2023-06-23T01:09:32.669 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-06-23T01:09:32.669 INFO:teuthology.orchestra.run.smithi045.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-06-23T01:09:32.669 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-06-23T01:09:32.669 INFO:teuthology.orchestra.run.smithi045.stdout: thermald 2023-06-23T01:09:32.721 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-06-23T01:09:32.722 INFO:teuthology.orchestra.run.smithi045.stdout: linux-headers-5.4.0-152 linux-headers-5.4.0-152-generic 2023-06-23T01:09:32.722 INFO:teuthology.orchestra.run.smithi045.stdout: linux-image-5.4.0-152-generic linux-modules-5.4.0-152-generic 2023-06-23T01:09:32.722 INFO:teuthology.orchestra.run.smithi045.stdout: linux-modules-extra-5.4.0-152-generic 2023-06-23T01:09:32.723 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-06-23T01:09:32.723 INFO:teuthology.orchestra.run.smithi045.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-23T01:09:32.776 INFO:teuthology.orchestra.run.smithi045.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T01:09:32.776 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 77.1 MB of archives. 2023-06-23T01:09:32.777 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-23T01:09:32.777 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-23T01:09:32.840 INFO:teuthology.orchestra.run.smithi192.stdout:3 upgraded, 5 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T01:09:32.840 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 77.1 MB of archives. 2023-06-23T01:09:32.841 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 380 MB of additional disk space will be used. 2023-06-23T01:09:32.841 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-152-generic amd64 5.4.0-152.169 [15.0 MB] 2023-06-23T01:09:33.070 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-23T01:09:33.162 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-23T01:09:33.674 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-23T01:09:33.674 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-23T01:09:33.675 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-23T01:09:33.770 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-23T01:09:33.781 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-23T01:09:33.966 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-152-generic amd64 5.4.0-152.169 [10.5 MB] 2023-06-23T01:09:34.235 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-152-generic amd64 5.4.0-152.169 [39.2 MB] 2023-06-23T01:09:34.469 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 77.1 MB in 1s (73.4 MB/s) 2023-06-23T01:09:34.637 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-23T01:09:35.546 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.152.149 [1,900 B] 2023-06-23T01:09:35.547 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.152.149 [2,596 B] 2023-06-23T01:09:35.547 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152 all 5.4.0-152.169 [11.0 MB] 2023-06-23T01:09:35.816 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-152-generic amd64 5.4.0-152.169 [1,362 kB] 2023-06-23T01:09:35.881 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.152.149 [2,464 B] 2023-06-23T01:09:36.354 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-23T01:09:36.360 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:36.434 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:36.611 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 77.1 MB in 3s (24.0 MB/s) 2023-06-23T01:09:36.936 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-5.4.0-152-generic. 2023-06-23T01:09:38.293 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-23T01:09:38.308 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:38.414 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:38.634 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-06-23T01:09:38.639 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../0-linux-modules-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:38.774 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:39.463 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-23T01:09:39.476 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:39.541 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:40.774 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-image-5.4.0-152-generic. 2023-06-23T01:09:40.790 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../1-linux-image-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:40.881 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:41.977 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-152-generic. 2023-06-23T01:09:41.991 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:42.035 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:44.720 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:44.847 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:45.200 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:45.326 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:45.670 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-23T01:09:45.686 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-23T01:09:45.729 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T01:09:46.944 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../3-linux-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:47.072 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:47.455 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:47.583 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-image-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:47.919 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-152. 2023-06-23T01:09:47.933 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../5-linux-headers-5.4.0-152_5.4.0-152.169_all.deb ... 2023-06-23T01:09:47.994 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T01:09:51.131 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-23T01:09:51.154 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:51.197 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:53.583 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package linux-headers-5.4.0-152-generic. 2023-06-23T01:09:53.605 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../6-linux-headers-5.4.0-152-generic_5.4.0-152.169_amd64.deb ... 2023-06-23T01:09:53.648 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:54.050 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:54.171 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:54.495 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T01:09:54.609 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:54.735 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:55.978 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:56.474 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.152.149_amd64.deb ... 2023-06-23T01:09:56.604 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking linux-headers-generic (5.4.0.152.149) over (5.4.0.124.125) ... 2023-06-23T01:09:56.938 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-152 (5.4.0-152.169) ... 2023-06-23T01:09:57.159 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:57.163 INFO:teuthology.orchestra.run.smithi045.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:09:57.164 INFO:teuthology.orchestra.run.smithi045.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-23T01:09:57.306 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-23T01:09:57.310 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:57.432 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:58.555 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:58.658 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-23T01:09:58.784 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-23T01:09:58.928 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:09:59.009 INFO:teuthology.orchestra.run.smithi045.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T01:09:59.010 INFO:teuthology.orchestra.run.smithi045.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:09:59.708 INFO:teuthology.orchestra.run.smithi192.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:09:59.708 INFO:teuthology.orchestra.run.smithi192.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-152-generic 2023-06-23T01:09:59.840 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-headers-generic (5.4.0.152.149) ... 2023-06-23T01:09:59.983 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-modules-extra-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:10:01.176 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-image-generic (5.4.0.152.149) ... 2023-06-23T01:10:01.302 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up linux-generic (5.4.0.152.149) ... 2023-06-23T01:10:01.445 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for linux-image-5.4.0-152-generic (5.4.0-152.169) ... 2023-06-23T01:10:01.512 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-23T01:10:01.512 INFO:teuthology.orchestra.run.smithi192.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:10:22.253 INFO:teuthology.orchestra.run.smithi045.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T01:10:22.254 INFO:teuthology.orchestra.run.smithi045.stdout:Sourcing file `/etc/default/grub' 2023-06-23T01:10:22.284 INFO:teuthology.orchestra.run.smithi045.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T01:10:22.310 INFO:teuthology.orchestra.run.smithi045.stdout:Generating grub configuration file ... 2023-06-23T01:10:22.577 INFO:teuthology.orchestra.run.smithi045.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:10:22.594 INFO:teuthology.orchestra.run.smithi045.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:10:22.948 INFO:teuthology.orchestra.run.smithi045.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T01:10:22.960 INFO:teuthology.orchestra.run.smithi045.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T01:10:23.632 INFO:teuthology.orchestra.run.smithi192.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-23T01:10:23.632 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub' 2023-06-23T01:10:23.639 INFO:teuthology.orchestra.run.smithi192.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T01:10:23.658 INFO:teuthology.orchestra.run.smithi192.stdout:Generating grub configuration file ... 2023-06-23T01:10:24.019 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:10:24.039 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:10:24.441 INFO:teuthology.orchestra.run.smithi192.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T01:10:24.451 INFO:teuthology.orchestra.run.smithi192.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T01:10:25.700 INFO:teuthology.orchestra.run.smithi045.stdout:done 2023-06-23T01:10:26.107 DEBUG:teuthology.orchestra.run.smithi045:> dpkg -s linux-image-generic 2023-06-23T01:10:26.151 INFO:teuthology.orchestra.run.smithi045.stdout:Package: linux-image-generic 2023-06-23T01:10:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Status: install ok installed 2023-06-23T01:10:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Priority: optional 2023-06-23T01:10:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Section: kernel 2023-06-23T01:10:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Installed-Size: 19 2023-06-23T01:10:26.152 INFO:teuthology.orchestra.run.smithi045.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: amd64 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Source: linux-meta 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Version: 5.4.0.152.149 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Recommends: thermald 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout:Description: Generic Linux kernel image 2023-06-23T01:10:26.153 INFO:teuthology.orchestra.run.smithi045.stdout: This package will always depend on the latest generic kernel image 2023-06-23T01:10:26.154 INFO:teuthology.orchestra.run.smithi045.stdout: available. 2023-06-23T01:10:26.154 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-23T01:10:26.154 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T01:10:26.154 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T01:10:26.154 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-23T01:10:26.155 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T01:10:26.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get clean 2023-06-23T01:10:26.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-06-23T01:10:26.418 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:10:26.418 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-23T01:10:26.425 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T01:10:26.491 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-23T01:10:27.049 INFO:teuthology.orchestra.run.smithi192.stdout:done 2023-06-23T01:10:27.492 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-06-23T01:10:27.545 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-06-23T01:10:27.545 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 19 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-06-23T01:10:27.546 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.152.149 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-06-23T01:10:27.547 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-06-23T01:10:27.547 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-152-generic 2023-06-23T01:10:27.548 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-23T01:10:27.548 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-23T01:10:27.548 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-23T01:10:27.548 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2023-06-23T01:10:27.548 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get clean 2023-06-23T01:10:27.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T01:10:27.752 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-23T01:10:27.870 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:10:27.952 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T01:10:28.037 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-23T01:10:28.183 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:10:28.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T01:10:28.280 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:10:28.458 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-06-23T01:10:28.459 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-06-23T01:10:28.666 INFO:teuthology.orchestra.run.smithi045.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-23T01:10:28.667 INFO:teuthology.orchestra.run.smithi045.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T01:10:28.668 DEBUG:teuthology.orchestra.run.smithi045:> dpkg -s linux-image-generic 2023-06-23T01:10:28.689 INFO:teuthology.orchestra.run.smithi045.stdout:Package: linux-image-generic 2023-06-23T01:10:28.690 INFO:teuthology.orchestra.run.smithi045.stdout:Status: install ok installed 2023-06-23T01:10:28.690 INFO:teuthology.orchestra.run.smithi045.stdout:Priority: optional 2023-06-23T01:10:28.690 INFO:teuthology.orchestra.run.smithi045.stdout:Section: kernel 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Installed-Size: 19 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: amd64 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Source: linux-meta 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Version: 5.4.0.152.149 2023-06-23T01:10:28.691 INFO:teuthology.orchestra.run.smithi045.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T01:10:28.692 INFO:teuthology.orchestra.run.smithi045.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T01:10:28.692 INFO:teuthology.orchestra.run.smithi045.stdout:Recommends: thermald 2023-06-23T01:10:28.692 INFO:teuthology.orchestra.run.smithi045.stdout:Description: Generic Linux kernel image 2023-06-23T01:10:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: This package will always depend on the latest generic kernel image 2023-06-23T01:10:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: available. 2023-06-23T01:10:28.693 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-06-23T01:10:28.739 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.uHCF09KZs1 2023-06-23T01:10:28.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub/grub.cfg /tmp/tmp.uHCF09KZs1 2023-06-23T01:10:28.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.uHCF09KZs1 2023-06-23T01:10:28.842 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.uHCF09KZs1 is 9KB 2023-06-23T01:10:28.855 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.uHCF09KZs1 2023-06-23T01:10:28.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T01:10:28.918 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:10:28.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T01:10:28.918 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T01:10:28.955 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-23T01:10:28.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo update-grub 2023-06-23T01:10:29.447 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:10:29.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-23T01:10:29.539 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:10:29.710 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T01:10:29.711 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T01:10:29.912 INFO:teuthology.orchestra.run.smithi192.stdout:linux-image-generic is already the newest version (5.4.0.152.149). 2023-06-23T01:10:29.912 INFO:teuthology.orchestra.run.smithi192.stdout:0 upgraded, 0 newly installed, 0 to remove and 223 not upgraded. 2023-06-23T01:10:29.913 DEBUG:teuthology.orchestra.run.smithi192:> dpkg -s linux-image-generic 2023-06-23T01:10:29.935 INFO:teuthology.orchestra.run.smithi192.stdout:Package: linux-image-generic 2023-06-23T01:10:29.935 INFO:teuthology.orchestra.run.smithi192.stdout:Status: install ok installed 2023-06-23T01:10:29.935 INFO:teuthology.orchestra.run.smithi192.stdout:Priority: optional 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Section: kernel 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Installed-Size: 19 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Maintainer: Ubuntu Kernel Team 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: amd64 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Source: linux-meta 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Version: 5.4.0.152.149 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-06-23T01:10:29.936 INFO:teuthology.orchestra.run.smithi192.stdout:Depends: linux-image-5.4.0-152-generic, linux-modules-extra-5.4.0-152-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-23T01:10:29.937 INFO:teuthology.orchestra.run.smithi192.stdout:Recommends: thermald 2023-06-23T01:10:29.937 INFO:teuthology.orchestra.run.smithi192.stdout:Description: Generic Linux kernel image 2023-06-23T01:10:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: This package will always depend on the latest generic kernel image 2023-06-23T01:10:29.937 INFO:teuthology.orchestra.run.smithi192.stdout: available. 2023-06-23T01:10:29.937 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-06-23T01:10:29.942 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.synB8YQr2I 2023-06-23T01:10:29.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub/grub.cfg /tmp/tmp.synB8YQr2I 2023-06-23T01:10:29.999 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.synB8YQr2I 2023-06-23T01:10:30.047 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.synB8YQr2I is 9KB 2023-06-23T01:10:30.060 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.synB8YQr2I 2023-06-23T01:10:30.066 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-23T01:10:30.121 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:10:30.121 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-23T01:10:30.121 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-23T01:10:30.158 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-152-generic 2023-06-23T01:10:30.158 DEBUG:teuthology.orchestra.run.smithi192:> sudo update-grub 2023-06-23T01:10:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-06-23T01:10:30.216 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T01:10:30.234 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-06-23T01:10:30.491 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:10:30.503 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:10:30.895 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T01:10:30.907 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T01:10:31.488 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub' 2023-06-23T01:10:31.499 INFO:teuthology.orchestra.run.smithi192.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-23T01:10:31.515 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2023-06-23T01:10:31.794 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-152-generic 2023-06-23T01:10:31.806 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-152-generic 2023-06-23T01:10:32.168 INFO:teuthology.orchestra.run.smithi192.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-23T01:10:32.179 INFO:teuthology.orchestra.run.smithi192.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-23T01:10:32.504 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-06-23T01:10:32.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2023-06-23T01:10:33.848 INFO:teuthology.orchestra.run.smithi192.stderr:done 2023-06-23T01:10:33.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2023-06-23T01:11:02.536 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-23T01:11:02.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-23T01:11:02.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:11:03.855 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-23T01:11:03.855 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T01:11:03.856 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:11:20.944 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-06-23T01:11:22.228 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-23T01:11:50.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-23T01:11:50.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:11:52.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T01:11:52.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:12:09.328 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-06-23T01:12:09.584 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2023-06-23T01:12:39.356 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-23T01:12:39.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:12:39.557 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-06-23T01:12:39.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T01:12:39.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:12:39.799 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-23T01:12:40.170 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-23T01:12:40.170 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-152-generic"... 2023-06-23T01:12:40.170 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-06-23T01:12:40.176 INFO:teuthology.orchestra.run.smithi045.stdout:5.4.0-152-generic 2023-06-23T01:12:40.177 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-23T01:12:40.177 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T01:12:40.177 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T01:12:40.383 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T01:12:40.384 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-152-generic"... 2023-06-23T01:12:40.384 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2023-06-23T01:12:40.390 INFO:teuthology.orchestra.run.smithi192.stdout:5.4.0-152-generic 2023-06-23T01:12:40.391 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-152-generic vs 5.4.0-152-generic 2023-06-23T01:12:40.391 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-23T01:12:40.391 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-23T01:12:41.178 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-23T01:12:41.179 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T01:12:41.255 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2023-06-23T01:12:41.281 DEBUG:teuthology.parallel:result is None 2023-06-23T01:12:41.391 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-23T01:12:41.392 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-23T01:12:41.473 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2023-06-23T01:12:41.512 DEBUG:teuthology.parallel:result is None 2023-06-23T01:12:41.512 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-23T01:12:41.522 INFO:teuthology.task.internal:Creating test directory... 2023-06-23T01:12:41.522 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T01:12:41.524 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-23T01:12:41.531 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-23T01:12:41.571 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-23T01:12:41.607 INFO:teuthology.task.internal:Creating archive directory... 2023-06-23T01:12:41.608 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T01:12:41.610 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-23T01:12:41.637 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-23T01:12:41.650 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-23T01:12:41.650 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T01:12:41.668 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-23T01:12:41.684 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T01:12:41.686 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T01:12:41.695 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T01:12:41.696 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-23T01:12:41.697 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-23T01:12:41.705 INFO:teuthology.task.internal:Configuring sudo... 2023-06-23T01:12:41.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T01:12:41.707 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-23T01:12:41.756 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-23T01:12:41.765 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-23T01:12:41.766 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T01:12:41.768 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-23T01:12:41.773 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T01:12:41.821 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T01:12:41.828 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:12:41.828 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T01:12:41.849 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-23T01:12:41.856 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-23T01:12:41.904 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:12:41.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-23T01:12:41.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-06-23T01:12:41.930 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2023-06-23T01:12:41.985 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-23T01:12:41.998 INFO:teuthology.task.internal:Starting timer... 2023-06-23T01:12:41.999 INFO:teuthology.run_tasks:Running task pcp... 2023-06-23T01:12:42.016 INFO:teuthology.run_tasks:Running task selinux... 2023-06-23T01:12:42.048 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-06-23T01:12:42.048 DEBUG:teuthology.task.selinux:Excluding smithi192: OS 'ubuntu' does not support SELinux 2023-06-23T01:12:42.049 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-23T01:12:42.049 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-23T01:12:42.050 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-23T01:12:42.050 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-23T01:12:42.082 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-23T01:12:42.083 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-23T01:12:42.105 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-23T01:12:42.106 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-23T01:18:21.436 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2023-06-23T01:18:21.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-06-23T01:18:21.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:18:21.494 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-06-23T01:18:21.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2023-06-23T01:18:21.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-23T01:18:21.664 DEBUG:teuthology.orchestra.run.smithi192:> true 2023-06-23T01:18:21.786 INFO:teuthology.run_tasks:Running task clock... 2023-06-23T01:18:21.800 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-23T01:18:21.801 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T01:18:21.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T01:18:21.804 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-23T01:18:21.804 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T01:18:21.838 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-23T01:18:21.838 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Command line: ntpd -gq 2023-06-23T01:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-23T01:18:21.839 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Command line: ntpd -gq 2023-06-23T01:18:21.839 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: proto: precision = 0.070 usec (-24) 2023-06-23T01:18:21.840 INFO:teuthology.orchestra.run.smithi192.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T01:18:21.840 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T01:18:21.840 INFO:teuthology.orchestra.run.smithi192.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T01:18:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T01:18:21.841 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T01:18:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T01:18:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T01:18:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen normally on 3 enp3s0f1 172.21.15.192:123 2023-06-23T01:18:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen normally on 4 lo [::1]:123 2023-06-23T01:18:21.842 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8049%5]:123 2023-06-23T01:18:21.843 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:21 ntpd[22235]: Listening on routing socket on fd #22 for interface updates 2023-06-23T01:18:21.844 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: proto: precision = 0.092 usec (-23) 2023-06-23T01:18:21.845 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T01:18:21.845 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-23T01:18:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: restrict ::: KOD does nothing without LIMITED. 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen and drop on 0 v6wildcard [::]:123 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen normally on 2 lo 127.0.0.1:123 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-06-23T01:18:21.847 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen normally on 4 lo [::1]:123 2023-06-23T01:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%4]:123 2023-06-23T01:18:21.848 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:21 ntpd[22186]: Listening on routing socket on fd #22 for interface updates 2023-06-23T01:18:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:22.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:22 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:22.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:22.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:22 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:24 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:24.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:24 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.842 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:26 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.846 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.847 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:26.848 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:26.849 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:26 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.839 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:28.840 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:28.840 INFO:teuthology.orchestra.run.smithi192.stdout:23 Jun 01:18:28 ntpd[22235]: ntpd: time slew +0.002879 s 2023-06-23T01:18:28.841 INFO:teuthology.orchestra.run.smithi192.stdout:ntpd: time slew +0.002879s 2023-06-23T01:18:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T01:18:28.841 INFO:teuthology.orchestra.run.smithi192.stderr:23 Jun 01:18:28 ntpd[22235]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T01:18:28.842 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.843 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/rawstats.20230623: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-23T01:18:28.844 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/peerstats.20230623: Permission denied 2023-06-23T01:18:28.845 INFO:teuthology.orchestra.run.smithi045.stdout:23 Jun 01:18:28 ntpd[22186]: ntpd: time slew +0.005149 s 2023-06-23T01:18:28.845 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew +0.005149s 2023-06-23T01:18:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-23T01:18:28.845 INFO:teuthology.orchestra.run.smithi045.stderr:23 Jun 01:18:28 ntpd[22186]: can't open /var/log/ntpstats/loopstats.20230623: Permission denied 2023-06-23T01:18:28.909 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T01:18:28.909 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-06-23T01:18:28.910 INFO:teuthology.orchestra.run.smithi192.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.911 INFO:teuthology.orchestra.run.smithi192.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.911 INFO:teuthology.orchestra.run.smithi192.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.911 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.912 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T01:18:28.912 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-06-23T01:18:28.912 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.913 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.913 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.913 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:18:28.913 INFO:teuthology.run_tasks:Running task install... 2023-06-23T01:18:28.928 DEBUG:teuthology.task.install:project ceph 2023-06-23T01:18:28.928 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}} 2023-06-23T01:18:28.929 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'} 2023-06-23T01:18:28.929 INFO:teuthology.task.install:Using flavor: default 2023-06-23T01:18:28.935 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-23T01:18:28.935 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-23T01:18:28.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-06-23T01:18:28.936 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-key list | grep Ceph 2023-06-23T01:18:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-23T01:18:29.047 INFO:teuthology.orchestra.run.smithi192.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-23T01:18:29.100 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T01:18:29.100 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T01:18:29.101 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T01:18:29.102 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-23T01:18:29.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T01:18:29.106 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-23T01:18:29.106 INFO:teuthology.orchestra.run.smithi192.stdout:uid [ unknown] Ceph.com (release key) 2023-06-23T01:18:29.106 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-23T01:18:29.107 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2023-06-23T01:18:29.107 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T01:18:29.238 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-23T01:18:29.239 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-23T01:18:29.253 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default/ 2023-06-23T01:18:29.253 INFO:teuthology.task.install.deb:Package version is 17.2.6-719-g42ddc46e-1focal 2023-06-23T01:18:29.408 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:18:29.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T01:18:29.423 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:18:29.424 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-23T01:18:29.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-06-23T01:18:29.441 DEBUG:teuthology.orchestra.run.smithi192:> sudo apt-get update 2023-06-23T01:18:29.587 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:18:29.591 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T01:18:29.609 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-23T01:18:29.679 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-23T01:18:29.702 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal InRelease 2023-06-23T01:18:29.704 INFO:teuthology.orchestra.run.smithi192.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-23T01:18:29.714 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-23T01:18:29.715 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-23T01:18:29.716 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-23T01:18:29.738 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-23T01:18:29.753 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-23T01:18:29.777 INFO:teuthology.orchestra.run.smithi192.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal Release.gpg 2023-06-23T01:18:29.785 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-23T01:18:29.789 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-23T01:18:29.814 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-06-23T01:18:29.839 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-23T01:18:29.866 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main i386 Packages [3,385 B] 2023-06-23T01:18:29.867 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-23T01:18:30.247 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 28.4 kB in 1s (44.9 kB/s) 2023-06-23T01:18:30.371 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 28.4 kB in 1s (36.5 kB/s) 2023-06-23T01:18:31.242 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:18:31.266 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-23T01:18:31.333 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:18:31.408 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:18:31.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-719-g42ddc46e-1focal cephadm=17.2.6-719-g42ddc46e-1focal ceph-mds=17.2.6-719-g42ddc46e-1focal ceph-mgr=17.2.6-719-g42ddc46e-1focal ceph-common=17.2.6-719-g42ddc46e-1focal ceph-fuse=17.2.6-719-g42ddc46e-1focal ceph-test=17.2.6-719-g42ddc46e-1focal ceph-volume=17.2.6-719-g42ddc46e-1focal radosgw=17.2.6-719-g42ddc46e-1focal python3-rados=17.2.6-719-g42ddc46e-1focal python3-rgw=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal python3-rbd=17.2.6-719-g42ddc46e-1focal libcephfs2=17.2.6-719-g42ddc46e-1focal libcephfs-dev=17.2.6-719-g42ddc46e-1focal librados2=17.2.6-719-g42ddc46e-1focal librbd1=17.2.6-719-g42ddc46e-1focal rbd-fuse=17.2.6-719-g42ddc46e-1focal python3-cephfs=17.2.6-719-g42ddc46e-1focal cephfs-shell=17.2.6-719-g42ddc46e-1focal cephfs-top=17.2.6-719-g42ddc46e-1focal cephfs-mirror=17.2.6-719-g42ddc46e-1focal 2023-06-23T01:18:31.503 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:18:31.526 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T01:18:31.527 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T01:18:31.691 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T01:18:31.692 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T01:18:31.693 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T01:18:31.693 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T01:18:31.693 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T01:18:31.694 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-23T01:18:31.695 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T01:18:31.696 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T01:18:31.697 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T01:18:31.698 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T01:18:31.698 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T01:18:31.698 INFO:teuthology.orchestra.run.smithi192.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-23T01:18:31.698 INFO:teuthology.orchestra.run.smithi192.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-23T01:18:31.699 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-23T01:18:31.699 INFO:teuthology.orchestra.run.smithi192.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-23T01:18:31.699 INFO:teuthology.orchestra.run.smithi192.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-23T01:18:31.699 INFO:teuthology.orchestra.run.smithi192.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-23T01:18:31.699 INFO:teuthology.orchestra.run.smithi192.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-23T01:18:31.700 INFO:teuthology.orchestra.run.smithi192.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-23T01:18:31.700 INFO:teuthology.orchestra.run.smithi192.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-23T01:18:31.700 INFO:teuthology.orchestra.run.smithi192.stdout:Recommended packages: 2023-06-23T01:18:31.700 INFO:teuthology.orchestra.run.smithi192.stdout: btrfs-tools 2023-06-23T01:18:31.701 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-06-23T01:18:31.702 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-06-23T01:18:31.812 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-23T01:18:31.813 INFO:teuthology.orchestra.run.smithi192.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-23T01:18:31.814 INFO:teuthology.orchestra.run.smithi192.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-23T01:18:31.815 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-23T01:18:31.816 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T01:18:31.817 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-06-23T01:18:31.818 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 librbd1 2023-06-23T01:18:31.885 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-23T01:18:31.886 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-23T01:18:31.887 INFO:teuthology.orchestra.run.smithi045.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-23T01:18:31.887 INFO:teuthology.orchestra.run.smithi045.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-23T01:18:31.887 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-23T01:18:31.887 INFO:teuthology.orchestra.run.smithi045.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 python3-cmd2 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T01:18:31.888 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T01:18:31.889 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-23T01:18:31.890 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-06-23T01:18:31.890 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-23T01:18:31.890 INFO:teuthology.orchestra.run.smithi045.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-23T01:18:31.890 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-23T01:18:31.890 INFO:teuthology.orchestra.run.smithi045.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-23T01:18:31.891 INFO:teuthology.orchestra.run.smithi045.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-23T01:18:31.891 INFO:teuthology.orchestra.run.smithi045.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-23T01:18:31.891 INFO:teuthology.orchestra.run.smithi045.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-23T01:18:31.891 INFO:teuthology.orchestra.run.smithi045.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-23T01:18:31.892 INFO:teuthology.orchestra.run.smithi045.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-23T01:18:31.892 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-06-23T01:18:31.893 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-06-23T01:18:32.006 INFO:teuthology.orchestra.run.smithi192.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-23T01:18:32.006 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 209 MB of archives. 2023-06-23T01:18:32.006 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-23T01:18:32.007 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-23T01:18:32.011 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-06-23T01:18:32.011 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-23T01:18:32.011 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-23T01:18:32.012 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-23T01:18:32.012 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: nvme-cli python-natsort-doc python-pastedeploy-tpl python3-atomicwrites 2023-06-23T01:18:32.013 INFO:teuthology.orchestra.run.smithi045.stdout: python3-attr python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cmd2 python3-colorama python3-cryptography python3-decorator 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-23T01:18:32.014 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-23T01:18:32.015 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-23T01:18:32.016 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-06-23T01:18:32.016 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 librbd1 2023-06-23T01:18:32.076 INFO:teuthology.orchestra.run.smithi045.stdout:2 upgraded, 114 newly installed, 0 to remove and 205 not upgraded. 2023-06-23T01:18:32.076 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 209 MB of archives. 2023-06-23T01:18:32.076 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 981 MB of additional disk space will be used. 2023-06-23T01:18:32.076 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-23T01:18:32.089 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-23T01:18:32.094 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-23T01:18:32.101 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-23T01:18:32.124 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-23T01:18:32.126 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-23T01:18:32.129 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-23T01:18:32.155 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-23T01:18:32.157 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-23T01:18:32.160 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-719-g42ddc46e-1focal [3,504 kB] 2023-06-23T01:18:32.166 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-23T01:18:32.169 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-23T01:18:32.186 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-23T01:18:32.187 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-23T01:18:32.192 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-23T01:18:32.247 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-23T01:18:32.254 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-23T01:18:32.345 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-23T01:18:32.383 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-23T01:18:32.385 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-23T01:18:32.389 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-23T01:18:32.390 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-23T01:18:32.395 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-23T01:18:32.396 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-23T01:18:32.396 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-23T01:18:32.397 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-23T01:18:32.400 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-23T01:18:32.400 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-23T01:18:32.401 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-23T01:18:32.417 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-23T01:18:32.436 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-23T01:18:32.440 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-23T01:18:32.451 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-23T01:18:32.471 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-23T01:18:32.502 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T01:18:32.504 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-23T01:18:32.506 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-23T01:18:32.523 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-23T01:18:32.527 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-23T01:18:32.533 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-23T01:18:32.535 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-23T01:18:32.538 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-23T01:18:32.542 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-23T01:18:32.543 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-23T01:18:32.561 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-23T01:18:32.563 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-23T01:18:32.575 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-23T01:18:32.576 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-719-g42ddc46e-1focal [3,559 kB] 2023-06-23T01:18:32.598 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-23T01:18:32.600 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-23T01:18:32.620 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-23T01:18:32.621 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-23T01:18:32.632 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-23T01:18:32.635 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-23T01:18:32.637 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-23T01:18:32.647 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-23T01:18:32.654 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-23T01:18:32.674 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-23T01:18:32.696 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-23T01:18:32.702 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T01:18:32.702 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-23T01:18:32.707 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-23T01:18:32.711 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-23T01:18:32.715 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-23T01:18:32.716 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-23T01:18:32.751 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-23T01:18:32.853 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-23T01:18:32.887 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-719-g42ddc46e-1focal [757 kB] 2023-06-23T01:18:32.939 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-23T01:18:32.958 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-719-g42ddc46e-1focal [414 kB] 2023-06-23T01:18:32.997 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-719-g42ddc46e-1focal [22.5 kB] 2023-06-23T01:18:32.998 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-719-g42ddc46e-1focal [200 kB] 2023-06-23T01:18:33.008 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-23T01:18:33.015 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-719-g42ddc46e-1focal [47.1 kB] 2023-06-23T01:18:33.018 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-719-g42ddc46e-1focal [384 kB] 2023-06-23T01:18:33.018 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-23T01:18:33.027 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-23T01:18:33.049 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-23T01:18:33.050 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-23T01:18:33.052 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-719-g42ddc46e-1focal [5,565 kB] 2023-06-23T01:18:33.062 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-23T01:18:33.063 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-23T01:18:33.063 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-23T01:18:33.064 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-23T01:18:33.064 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-23T01:18:33.065 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-23T01:18:33.066 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-23T01:18:33.100 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-23T01:18:33.136 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-23T01:18:33.153 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-23T01:18:33.202 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-23T01:18:33.211 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-23T01:18:33.217 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-23T01:18:33.219 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-23T01:18:33.230 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-23T01:18:33.235 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-23T01:18:33.236 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-23T01:18:33.262 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-23T01:18:33.286 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-23T01:18:33.298 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-23T01:18:33.468 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-23T01:18:33.473 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-23T01:18:33.474 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-23T01:18:33.475 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-23T01:18:33.475 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-23T01:18:33.476 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-23T01:18:33.477 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-23T01:18:33.494 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-23T01:18:33.495 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T01:18:33.495 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-23T01:18:33.495 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-23T01:18:33.502 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-23T01:18:33.504 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-23T01:18:33.530 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-23T01:18:33.531 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-23T01:18:33.534 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-23T01:18:33.537 INFO:teuthology.orchestra.run.smithi192.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-23T01:18:33.550 INFO:teuthology.orchestra.run.smithi192.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-23T01:18:33.552 INFO:teuthology.orchestra.run.smithi192.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-23T01:18:33.554 INFO:teuthology.orchestra.run.smithi192.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-23T01:18:33.591 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-23T01:18:33.595 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-23T01:18:33.623 INFO:teuthology.orchestra.run.smithi192.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-719-g42ddc46e-1focal [116 kB] 2023-06-23T01:18:33.625 INFO:teuthology.orchestra.run.smithi192.stdout:Get:33 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-719-g42ddc46e-1focal [479 kB] 2023-06-23T01:18:33.627 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-23T01:18:33.631 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-23T01:18:33.669 INFO:teuthology.orchestra.run.smithi192.stdout:Get:34 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-719-g42ddc46e-1focal [27.3 MB] 2023-06-23T01:18:33.719 INFO:teuthology.orchestra.run.smithi192.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-23T01:18:33.883 INFO:teuthology.orchestra.run.smithi192.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-23T01:18:34.024 INFO:teuthology.orchestra.run.smithi192.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-23T01:18:34.043 INFO:teuthology.orchestra.run.smithi192.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-23T01:18:34.055 INFO:teuthology.orchestra.run.smithi192.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-23T01:18:34.131 INFO:teuthology.orchestra.run.smithi192.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-23T01:18:34.153 INFO:teuthology.orchestra.run.smithi192.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-23T01:18:34.194 INFO:teuthology.orchestra.run.smithi192.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-23T01:18:34.223 INFO:teuthology.orchestra.run.smithi192.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-23T01:18:34.228 INFO:teuthology.orchestra.run.smithi192.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-23T01:18:34.323 INFO:teuthology.orchestra.run.smithi192.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-23T01:18:34.460 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-23T01:18:34.487 INFO:teuthology.orchestra.run.smithi192.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-23T01:18:34.672 INFO:teuthology.orchestra.run.smithi192.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-23T01:18:34.706 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-23T01:18:34.718 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-23T01:18:34.722 INFO:teuthology.orchestra.run.smithi192.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-23T01:18:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-23T01:18:34.808 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-23T01:18:34.853 INFO:teuthology.orchestra.run.smithi192.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-23T01:18:34.958 INFO:teuthology.orchestra.run.smithi192.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-23T01:18:34.987 INFO:teuthology.orchestra.run.smithi192.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-23T01:18:34.991 INFO:teuthology.orchestra.run.smithi192.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-23T01:18:35.015 INFO:teuthology.orchestra.run.smithi192.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-23T01:18:35.036 INFO:teuthology.orchestra.run.smithi192.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-23T01:18:35.053 INFO:teuthology.orchestra.run.smithi192.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-23T01:18:35.054 INFO:teuthology.orchestra.run.smithi192.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-23T01:18:35.209 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-23T01:18:35.223 INFO:teuthology.orchestra.run.smithi192.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-23T01:18:36.230 INFO:teuthology.orchestra.run.smithi192.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-719-g42ddc46e-1focal [6,447 kB] 2023-06-23T01:18:36.313 INFO:teuthology.orchestra.run.smithi192.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-23T01:18:36.340 INFO:teuthology.orchestra.run.smithi192.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-23T01:18:36.341 INFO:teuthology.orchestra.run.smithi192.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-23T01:18:36.412 INFO:teuthology.orchestra.run.smithi192.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-23T01:18:36.413 INFO:teuthology.orchestra.run.smithi192.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-23T01:18:36.413 INFO:teuthology.orchestra.run.smithi192.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-23T01:18:36.414 INFO:teuthology.orchestra.run.smithi192.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-23T01:18:36.414 INFO:teuthology.orchestra.run.smithi192.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-23T01:18:36.414 INFO:teuthology.orchestra.run.smithi192.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-23T01:18:36.415 INFO:teuthology.orchestra.run.smithi192.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-23T01:18:36.583 INFO:teuthology.orchestra.run.smithi192.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-23T01:18:36.635 INFO:teuthology.orchestra.run.smithi192.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-719-g42ddc46e-1focal [221 kB] 2023-06-23T01:18:36.652 INFO:teuthology.orchestra.run.smithi192.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-719-g42ddc46e-1focal [152 kB] 2023-06-23T01:18:36.662 INFO:teuthology.orchestra.run.smithi192.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-719-g42ddc46e-1focal [1,588 kB] 2023-06-23T01:18:36.750 INFO:teuthology.orchestra.run.smithi192.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-23T01:18:36.781 INFO:teuthology.orchestra.run.smithi192.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-719-g42ddc46e-1focal [7,843 kB] 2023-06-23T01:18:36.831 INFO:teuthology.orchestra.run.smithi192.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-23T01:18:36.842 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-23T01:18:36.843 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-23T01:18:36.859 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-23T01:18:36.924 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-23T01:18:36.928 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-23T01:18:36.936 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-23T01:18:37.041 INFO:teuthology.orchestra.run.smithi045.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-23T01:18:37.064 INFO:teuthology.orchestra.run.smithi192.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-23T01:18:37.108 INFO:teuthology.orchestra.run.smithi192.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-23T01:18:37.138 INFO:teuthology.orchestra.run.smithi192.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-23T01:18:37.148 INFO:teuthology.orchestra.run.smithi192.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-23T01:18:37.196 INFO:teuthology.orchestra.run.smithi192.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-23T01:18:37.225 INFO:teuthology.orchestra.run.smithi192.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-23T01:18:37.227 INFO:teuthology.orchestra.run.smithi192.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-23T01:18:37.344 INFO:teuthology.orchestra.run.smithi192.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-719-g42ddc46e-1focal [28.7 MB] 2023-06-23T01:18:37.346 INFO:teuthology.orchestra.run.smithi192.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-23T01:18:37.503 INFO:teuthology.orchestra.run.smithi045.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-23T01:18:37.503 INFO:teuthology.orchestra.run.smithi045.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-23T01:18:37.520 INFO:teuthology.orchestra.run.smithi192.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-23T01:18:38.345 INFO:teuthology.orchestra.run.smithi192.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-23T01:18:38.348 INFO:teuthology.orchestra.run.smithi192.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-23T01:18:38.348 INFO:teuthology.orchestra.run.smithi192.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-23T01:18:38.349 INFO:teuthology.orchestra.run.smithi192.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-23T01:18:38.350 INFO:teuthology.orchestra.run.smithi192.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-23T01:18:38.352 INFO:teuthology.orchestra.run.smithi192.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-23T01:18:38.370 INFO:teuthology.orchestra.run.smithi192.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-23T01:18:38.370 INFO:teuthology.orchestra.run.smithi192.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-23T01:18:38.371 INFO:teuthology.orchestra.run.smithi192.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-23T01:18:38.427 INFO:teuthology.orchestra.run.smithi192.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-23T01:18:38.594 INFO:teuthology.orchestra.run.smithi192.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-23T01:18:38.878 INFO:teuthology.orchestra.run.smithi192.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-23T01:18:38.901 INFO:teuthology.orchestra.run.smithi192.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-23T01:18:39.051 INFO:teuthology.orchestra.run.smithi192.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-23T01:18:39.068 INFO:teuthology.orchestra.run.smithi192.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-23T01:18:39.647 INFO:teuthology.orchestra.run.smithi192.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-719-g42ddc46e-1focal [3,920 B] 2023-06-23T01:18:39.647 INFO:teuthology.orchestra.run.smithi192.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-719-g42ddc46e-1focal [867 kB] 2023-06-23T01:18:39.658 INFO:teuthology.orchestra.run.smithi192.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-719-g42ddc46e-1focal [2,399 kB] 2023-06-23T01:18:39.770 INFO:teuthology.orchestra.run.smithi192.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-719-g42ddc46e-1focal [78.9 kB] 2023-06-23T01:18:39.780 INFO:teuthology.orchestra.run.smithi192.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-719-g42ddc46e-1focal [117 kB] 2023-06-23T01:18:39.788 INFO:teuthology.orchestra.run.smithi192.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-719-g42ddc46e-1focal [1,759 kB] 2023-06-23T01:18:39.919 INFO:teuthology.orchestra.run.smithi192.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-719-g42ddc46e-1focal [7,886 kB] 2023-06-23T01:18:40.519 INFO:teuthology.orchestra.run.smithi192.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-719-g42ddc46e-1focal [4,036 B] 2023-06-23T01:18:40.519 INFO:teuthology.orchestra.run.smithi192.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-719-g42ddc46e-1focal [56.2 MB] 2023-06-23T01:18:41.002 INFO:teuthology.orchestra.run.smithi045.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-23T01:18:41.007 INFO:teuthology.orchestra.run.smithi045.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-23T01:18:41.012 INFO:teuthology.orchestra.run.smithi045.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-23T01:18:41.013 INFO:teuthology.orchestra.run.smithi045.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-23T01:18:41.013 INFO:teuthology.orchestra.run.smithi045.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-23T01:18:41.014 INFO:teuthology.orchestra.run.smithi045.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-23T01:18:41.817 INFO:teuthology.orchestra.run.smithi045.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-23T01:18:42.536 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 209 MB in 10s (21.2 MB/s) 2023-06-23T01:18:42.708 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T01:18:42.765 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-23T01:18:42.769 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-23T01:18:42.814 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-23T01:18:43.142 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T01:18:43.158 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-23T01:18:43.200 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T01:18:43.339 INFO:teuthology.orchestra.run.smithi192.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-719-g42ddc46e-1focal [226 kB] 2023-06-23T01:18:43.394 INFO:teuthology.orchestra.run.smithi192.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 17.2.6-719-g42ddc46e-1focal [238 kB] 2023-06-23T01:18:43.399 INFO:teuthology.orchestra.run.smithi192.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 17.2.6-719-g42ddc46e-1focal [22.0 kB] 2023-06-23T01:18:43.400 INFO:teuthology.orchestra.run.smithi192.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 17.2.6-719-g42ddc46e-1focal [12.8 kB] 2023-06-23T01:18:43.400 INFO:teuthology.orchestra.run.smithi192.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-719-g42ddc46e-1focal [21.9 kB] 2023-06-23T01:18:43.404 INFO:teuthology.orchestra.run.smithi192.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-719-g42ddc46e-1focal [17.0 MB] 2023-06-23T01:18:43.478 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T01:18:43.498 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-23T01:18:43.561 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-23T01:18:43.898 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-23T01:18:43.913 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-23T01:18:43.941 INFO:teuthology.orchestra.run.smithi192.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-06-21-0846-quincy/42ddc46e6e6582d8e29a5a982a81886fe028be2c/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-719-g42ddc46e-1focal [79.4 kB] 2023-06-23T01:18:44.014 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T01:18:44.315 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:44.465 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T01:18:44.567 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 209 MB in 12s (17.3 MB/s) 2023-06-23T01:18:44.716 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-23T01:18:44.773 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-06-23T01:18:44.778 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-23T01:18:44.814 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-23T01:18:45.083 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-23T01:18:45.100 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-23T01:18:45.136 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:45.142 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T01:18:45.262 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T01:18:45.469 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cmd2. 2023-06-23T01:18:45.486 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-23T01:18:45.528 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-23T01:18:45.889 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-23T01:18:45.907 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-23T01:18:45.966 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T01:18:45.986 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:45.997 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T01:18:46.024 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:46.319 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../004-librbd1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:46.352 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-06-23T01:18:46.368 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:46.402 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:46.434 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librbd1 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T01:18:46.789 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T01:18:46.810 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:18:46.848 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:47.123 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T01:18:47.142 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:47.156 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../005-librados2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:47.191 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:47.267 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librados2 (17.2.6-719-g42ddc46e-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-23T01:18:47.505 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T01:18:47.523 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:18:47.579 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T01:18:47.892 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-23T01:18:47.932 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-23T01:18:47.998 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs2. 2023-06-23T01:18:48.018 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../006-libcephfs2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:48.056 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:48.219 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T01:18:48.236 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:48.277 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:48.367 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rados. 2023-06-23T01:18:48.383 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../007-python3-rados_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:48.417 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:48.639 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-23T01:18:48.658 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-23T01:18:48.699 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T01:18:48.769 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-23T01:18:48.785 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../008-python3-ceph-argparse_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:18:48.828 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:49.085 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-23T01:18:49.088 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cephfs. 2023-06-23T01:18:49.102 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-23T01:18:49.106 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../009-python3-cephfs_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:49.143 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T01:18:49.146 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:49.417 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-23T01:18:49.433 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../010-python3-ceph-common_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:18:49.467 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:49.488 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T01:18:49.507 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-23T01:18:49.546 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T01:18:49.823 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-prettytable. 2023-06-23T01:18:49.842 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../011-python3-prettytable_0.7.2-5_all.deb ... 2023-06-23T01:18:49.891 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T01:18:49.908 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-23T01:18:49.941 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T01:18:50.028 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-23T01:18:50.317 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rbd. 2023-06-23T01:18:50.335 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../012-python3-rbd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:50.375 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:50.511 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T01:18:50.530 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-23T01:18:50.569 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T01:18:50.711 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-23T01:18:50.727 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../013-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-23T01:18:50.779 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T01:18:51.065 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T01:18:51.081 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:51.131 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-23T01:18:51.133 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:51.148 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../014-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-23T01:18:51.189 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T01:18:51.559 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-23T01:18:51.576 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../015-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-23T01:18:51.605 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T01:18:51.617 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T01:18:51.623 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:51.668 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:51.961 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-23T01:18:51.980 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../016-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-23T01:18:52.036 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T01:18:52.079 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T01:18:52.099 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:52.137 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:52.347 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-23T01:18:52.364 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../017-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-23T01:18:52.405 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T01:18:52.583 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-23T01:18:52.602 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-23T01:18:52.641 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T01:18:52.892 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-23T01:18:52.908 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../018-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:52.961 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-06-23T01:18:52.961 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:52.979 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:53.019 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:53.495 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-23T01:18:53.512 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../019-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:53.553 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:53.788 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T01:18:53.806 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:53.871 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:53.931 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-23T01:18:53.949 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../020-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-23T01:18:53.989 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:18:54.221 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0. 2023-06-23T01:18:54.239 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-23T01:18:54.306 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-23T01:18:54.384 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-23T01:18:54.400 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../021-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-23T01:18:54.467 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T01:18:54.605 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T01:18:54.621 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:54.663 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:54.804 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package librgw2. 2023-06-23T01:18:54.820 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../022-librgw2_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:54.862 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:55.114 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-06-23T01:18:55.130 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:55.197 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:55.647 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rgw. 2023-06-23T01:18:55.666 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../023-python3-rgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:55.714 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:56.067 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liboath0. 2023-06-23T01:18:56.083 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-23T01:18:56.125 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-23T01:18:56.453 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libradosstriper1. 2023-06-23T01:18:56.468 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../025-libradosstriper1_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:56.503 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:56.962 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-common. 2023-06-23T01:18:56.980 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../026-ceph-common_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:57.014 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:57.778 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-06-23T01:18:57.798 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:57.839 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:58.942 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cryptography. 2023-06-23T01:18:59.021 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-23T01:18:59.021 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T01:18:59.371 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T01:18:59.390 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-23T01:18:59.429 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-23T01:18:59.585 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-base. 2023-06-23T01:18:59.600 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../027-ceph-base_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:18:59.653 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:18:59.715 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T01:18:59.734 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:18:59.765 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:00.162 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T01:19:00.179 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-23T01:19:00.220 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T01:19:00.540 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T01:19:00.558 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-23T01:19:00.623 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-23T01:19:00.697 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cryptography. 2023-06-23T01:19:00.715 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../028-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-23T01:19:00.755 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T01:19:00.960 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T01:19:00.977 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-23T01:19:01.043 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-23T01:19:01.126 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-openssl. 2023-06-23T01:19:01.143 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../029-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-23T01:19:01.184 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-23T01:19:01.355 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jwt. 2023-06-23T01:19:01.372 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-23T01:19:01.413 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T01:19:01.479 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-23T01:19:01.494 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../030-ceph-mgr-modules-core_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:01.536 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:01.733 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T01:19:01.752 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-23T01:19:01.792 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-23T01:19:01.942 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-23T01:19:01.957 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../031-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-23T01:19:02.000 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T01:19:02.129 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T01:19:02.145 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-23T01:19:02.187 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-23T01:19:02.286 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-23T01:19:02.306 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../032-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-23T01:19:02.344 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-23T01:19:02.524 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-06-23T01:19:02.540 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-23T01:19:02.582 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T01:19:02.714 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-natsort. 2023-06-23T01:19:02.731 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../033-python3-natsort_7.0.1-1_all.deb ... 2023-06-23T01:19:02.772 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-23T01:19:02.919 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T01:19:02.938 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T01:19:02.969 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T01:19:03.117 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jwt. 2023-06-23T01:19:03.138 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../034-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-23T01:19:03.175 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T01:19:03.355 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T01:19:03.372 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-23T01:19:03.413 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T01:19:03.470 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-logutils. 2023-06-23T01:19:03.490 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../035-python3-logutils_0.3.3-7_all.deb ... 2023-06-23T01:19:03.528 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-23T01:19:03.716 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-06-23T01:19:03.733 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-23T01:19:03.791 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-23T01:19:03.848 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-23T01:19:03.864 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../036-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-23T01:19:03.906 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-23T01:19:04.136 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-23T01:19:04.153 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-23T01:19:04.209 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-mako. 2023-06-23T01:19:04.219 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T01:19:04.227 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../037-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-23T01:19:04.267 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T01:19:04.506 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bs4. 2023-06-23T01:19:04.525 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-23T01:19:04.555 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-23T01:19:04.613 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-23T01:19:04.631 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../038-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-23T01:19:04.671 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-23T01:19:04.942 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T01:19:04.960 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-23T01:19:04.999 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-23T01:19:05.003 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T01:19:05.016 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../039-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-23T01:19:05.057 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T01:19:05.363 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T01:19:05.382 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-23T01:19:05.421 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-23T01:19:05.635 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webob. 2023-06-23T01:19:05.654 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../040-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-23T01:19:06.077 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-23T01:19:06.438 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-23T01:19:06.453 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../041-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-23T01:19:06.474 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-06-23T01:19:06.495 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-23T01:19:06.496 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T01:19:06.532 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T01:19:06.824 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-bs4. 2023-06-23T01:19:06.836 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T01:19:06.840 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../042-python3-bs4_4.8.2-1_all.deb ... 2023-06-23T01:19:06.855 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-23T01:19:06.890 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-23T01:19:06.927 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T01:19:07.230 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T01:19:07.248 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-23T01:19:07.251 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-waitress. 2023-06-23T01:19:07.268 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../043-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-23T01:19:07.288 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-23T01:19:07.313 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T01:19:07.625 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T01:19:07.642 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-23T01:19:07.646 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-tempita. 2023-06-23T01:19:07.666 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6_all.deb ... 2023-06-23T01:19:07.692 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-23T01:19:07.704 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-23T01:19:07.957 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-paste. 2023-06-23T01:19:07.975 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../045-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-23T01:19:08.028 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T01:19:08.045 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-23T01:19:08.048 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T01:19:08.086 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T01:19:08.352 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-23T01:19:08.371 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-23T01:19:08.410 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T01:19:08.475 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T01:19:08.492 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-23T01:19:08.533 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T01:19:08.721 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-23T01:19:08.741 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-23T01:19:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-23T01:19:08.886 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T01:19:08.904 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:08.944 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:09.091 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webtest. 2023-06-23T01:19:09.110 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../048-python3-webtest_2.0.32-2_all.deb ... 2023-06-23T01:19:09.149 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-23T01:19:09.348 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T01:19:09.365 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:09.406 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:09.485 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pecan. 2023-06-23T01:19:09.505 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-23T01:19:09.543 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T01:19:09.898 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-23T01:19:09.915 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../050-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-23T01:19:09.943 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T01:19:09.956 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T01:19:09.960 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:10.001 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:10.293 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-23T01:19:10.311 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../051-libsqlite3-mod-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:10.351 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:10.729 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr. 2023-06-23T01:19:10.747 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../052-ceph-mgr_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:10.787 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:11.196 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T01:19:11.213 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:11.254 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:11.265 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mon. 2023-06-23T01:19:11.283 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../053-ceph-mon_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:11.315 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:12.519 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-osd. 2023-06-23T01:19:12.536 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../054-ceph-osd_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:12.576 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:14.207 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-06-23T01:19:14.224 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:14.265 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:14.613 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T01:19:14.631 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:14.668 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:15.105 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T01:19:15.123 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:15.163 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:15.379 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph. 2023-06-23T01:19:15.396 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../055-ceph_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:15.437 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:15.699 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-06-23T01:19:15.716 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:15.757 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:15.765 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-fuse. 2023-06-23T01:19:15.781 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../056-ceph-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:15.823 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:16.077 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T01:19:16.093 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-23T01:19:16.135 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-23T01:19:16.268 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mds. 2023-06-23T01:19:16.284 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../057-ceph-mds_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:16.378 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:16.489 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T01:19:16.507 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:16.547 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:16.937 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephadm. 2023-06-23T01:19:16.955 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../058-cephadm_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:16.967 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T01:19:16.984 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T01:19:16.995 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:17.025 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T01:19:17.297 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-underscore. 2023-06-23T01:19:17.307 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-jinja2. 2023-06-23T01:19:17.315 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-23T01:19:17.324 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../059-python3-jinja2_2.10.1-2_all.deb ... 2023-06-23T01:19:17.361 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T01:19:17.364 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-23T01:19:17.639 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-23T01:19:17.655 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-23T01:19:17.697 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T01:19:17.709 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-23T01:19:17.730 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../060-ceph-mgr-cephadm_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:17.768 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:18.050 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-06-23T01:19:18.070 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-23T01:19:18.108 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-23T01:19:18.129 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-23T01:19:18.147 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../061-python3-repoze.lru_0.7-2_all.deb ... 2023-06-23T01:19:18.187 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-23T01:19:18.440 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-underscore. 2023-06-23T01:19:18.456 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../062-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-23T01:19:18.461 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T01:19:18.478 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:18.490 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T01:19:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:18.776 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-23T01:19:18.792 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../063-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-23T01:19:18.825 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T01:19:18.998 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-decorator. 2023-06-23T01:19:19.018 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-23T01:19:19.056 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T01:19:19.094 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-routes. 2023-06-23T01:19:19.114 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../064-python3-routes_2.4.1-2_all.deb ... 2023-06-23T01:19:19.152 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-23T01:19:19.367 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-23T01:19:19.387 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-23T01:19:19.425 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T01:19:19.514 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-23T01:19:19.530 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../065-ceph-mgr-dashboard_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:19.564 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:19.770 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-scipy. 2023-06-23T01:19:19.786 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-23T01:19:19.828 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-23T01:19:20.034 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-decorator. 2023-06-23T01:19:20.052 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../066-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-23T01:19:20.084 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T01:19:20.362 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-23T01:19:20.382 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../067-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-23T01:19:20.420 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T01:19:20.756 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-scipy. 2023-06-23T01:19:20.774 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../068-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-23T01:19:20.813 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-23T01:19:21.204 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-23T01:19:21.221 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-23T01:19:21.263 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:21.749 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T01:19:21.769 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-23T01:19:21.816 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-23T01:19:22.178 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T01:19:22.196 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-23T01:19:22.253 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:22.506 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-23T01:19:22.522 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../069-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-23T01:19:22.564 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:22.870 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T01:19:22.891 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:22.928 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:23.136 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-joblib. 2023-06-23T01:19:23.152 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../070-python3-joblib_0.14.0-3_all.deb ... 2023-06-23T01:19:23.194 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-23T01:19:23.589 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-sklearn. 2023-06-23T01:19:23.605 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../071-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-23T01:19:23.647 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:24.090 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T01:19:24.108 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-23T01:19:24.148 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-23T01:19:24.372 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-23T01:19:24.389 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../072-ceph-mgr-diskprediction-local_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:24.430 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:24.476 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T01:19:24.495 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-23T01:19:24.534 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T01:19:24.862 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T01:19:24.883 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-23T01:19:24.946 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T01:19:25.249 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T01:19:25.267 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-23T01:19:25.306 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-23T01:19:25.574 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-cachetools. 2023-06-23T01:19:25.590 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../073-python3-cachetools_4.0.0-1_all.deb ... 2023-06-23T01:19:25.632 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-23T01:19:25.652 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T01:19:25.669 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-23T01:19:25.710 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-23T01:19:25.952 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-23T01:19:25.971 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../074-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-23T01:19:26.002 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T01:19:26.063 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-blinker. 2023-06-23T01:19:26.080 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-23T01:19:26.121 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T01:19:26.272 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-23T01:19:26.291 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../075-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-23T01:19:26.321 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T01:19:26.424 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-23T01:19:26.442 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-23T01:19:26.474 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T01:19:26.616 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-rsa. 2023-06-23T01:19:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../076-python3-rsa_4.0-3_all.deb ... 2023-06-23T01:19:26.666 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-23T01:19:26.795 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T01:19:26.812 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-23T01:19:26.853 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T01:19:26.977 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-google-auth. 2023-06-23T01:19:26.995 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../077-python3-google-auth_1.5.1-2_all.deb ... 2023-06-23T01:19:27.037 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-23T01:19:27.283 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T01:19:27.303 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-23T01:19:27.341 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T01:19:27.388 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-blinker. 2023-06-23T01:19:27.405 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../078-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-23T01:19:27.447 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T01:19:27.678 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T01:19:27.698 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-23T01:19:27.736 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T01:19:27.771 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-23T01:19:27.791 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../079-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-23T01:19:27.832 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T01:19:28.186 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-23T01:19:28.206 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../080-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-23T01:19:28.244 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T01:19:28.334 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T01:19:28.351 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:28.384 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:28.649 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-websocket. 2023-06-23T01:19:28.667 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../081-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-23T01:19:28.707 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T01:19:28.712 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T01:19:28.732 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-23T01:19:28.770 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-23T01:19:29.052 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-23T01:19:29.071 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../082-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-23T01:19:29.110 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T01:19:29.148 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T01:19:29.166 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T01:19:29.206 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:19:29.501 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-06-23T01:19:29.518 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T01:19:29.551 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:19:29.641 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-23T01:19:29.660 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../083-ceph-mgr-k8sevents_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:29.699 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:29.789 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-06-23T01:19:29.808 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-23T01:19:29.880 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-23T01:19:30.001 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-23T01:19:30.020 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../084-libonig5_6.9.4-1_amd64.deb ... 2023-06-23T01:19:30.068 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-23T01:19:30.175 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T01:19:30.195 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-23T01:19:30.233 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-23T01:19:30.454 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-23T01:19:30.474 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../085-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T01:19:30.512 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:19:30.597 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-06-23T01:19:30.616 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:30.654 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:30.782 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package jq. 2023-06-23T01:19:30.802 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../086-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-23T01:19:30.856 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:19:31.084 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package socat. 2023-06-23T01:19:31.103 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../087-socat_1.7.3.3-2_amd64.deb ... 2023-06-23T01:19:31.134 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-23T01:19:31.471 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package xmlstarlet. 2023-06-23T01:19:31.487 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-23T01:19:31.529 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-23T01:19:31.841 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-test. 2023-06-23T01:19:31.859 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../089-ceph-test_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:31.891 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:35.750 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T01:19:35.769 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:35.808 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:36.089 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T01:19:36.108 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:36.147 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:36.458 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T01:19:36.477 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-23T01:19:36.508 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-23T01:19:36.810 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T01:19:36.828 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:36.868 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:36.920 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ceph-volume. 2023-06-23T01:19:36.936 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../090-ceph-volume_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:37.011 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:37.130 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T01:19:37.150 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:37.188 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:37.316 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-23T01:19:37.332 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../091-cephfs-mirror_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:37.365 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:37.442 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-23T01:19:37.457 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T01:19:37.529 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:37.710 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-colorama. 2023-06-23T01:19:37.726 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../092-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-23T01:19:37.785 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-23T01:19:38.046 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-shell. 2023-06-23T01:19:38.061 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T01:19:38.062 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../093-cephfs-shell_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:38.078 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:38.104 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:38.119 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:38.365 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package cephfs-top. 2023-06-23T01:19:38.383 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../094-cephfs-top_17.2.6-719-g42ddc46e-1focal_all.deb ... 2023-06-23T01:19:38.423 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:38.539 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T01:19:38.557 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-23T01:19:38.615 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T01:19:38.675 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-23T01:19:38.695 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../095-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T01:19:38.733 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:38.935 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-23T01:19:38.955 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T01:19:38.985 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:39.246 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-23T01:19:39.264 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../096-libcephfs-dev_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:39.304 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:39.682 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package nvme-cli. 2023-06-23T01:19:39.700 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../097-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-23T01:19:39.757 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T01:19:40.120 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-23T01:19:40.137 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../098-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-23T01:19:40.178 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:40.688 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-23T01:19:40.709 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-23T01:19:40.746 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-23T01:19:41.049 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-23T01:19:41.068 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-23T01:19:41.140 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T01:19:41.427 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-attr. 2023-06-23T01:19:41.447 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-23T01:19:41.485 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-23T01:19:41.846 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webencodings. 2023-06-23T01:19:41.863 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-23T01:19:41.878 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-23T01:19:41.897 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../099-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-23T01:19:41.904 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T01:19:41.936 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-23T01:19:42.225 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-html5lib. 2023-06-23T01:19:42.244 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-23T01:19:42.272 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-23T01:19:42.275 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-23T01:19:42.290 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../100-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-23T01:19:42.330 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T01:19:42.645 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-23T01:19:42.662 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-23T01:19:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-attr. 2023-06-23T01:19:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../101-python3-attr_19.3.0-2_all.deb ... 2023-06-23T01:19:42.703 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T01:19:42.724 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-23T01:19:43.075 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-webencodings. 2023-06-23T01:19:43.095 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-23T01:19:43.143 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T01:19:43.182 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-packaging. 2023-06-23T01:19:43.202 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-23T01:19:43.240 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-23T01:19:43.446 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-html5lib. 2023-06-23T01:19:43.464 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2023-06-23T01:19:43.504 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-23T01:19:43.551 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T01:19:43.572 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T01:19:43.610 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T01:19:43.874 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-23T01:19:43.893 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-23T01:19:43.932 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T01:19:43.954 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T01:19:43.972 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-23T01:19:44.012 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-23T01:19:44.358 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T01:19:44.376 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-23T01:19:44.403 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-packaging. 2023-06-23T01:19:44.415 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T01:19:44.423 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../105-python3-packaging_20.3-1_all.deb ... 2023-06-23T01:19:44.461 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-23T01:19:44.756 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pastescript. 2023-06-23T01:19:44.760 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-06-23T01:19:44.776 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2023-06-23T01:19:44.780 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-23T01:19:44.806 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-23T01:19:44.818 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T01:19:45.151 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pluggy. 2023-06-23T01:19:45.163 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T01:19:45.171 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-2_all.deb ... 2023-06-23T01:19:45.183 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-23T01:19:45.209 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-23T01:19:45.221 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T01:19:45.520 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-psutil. 2023-06-23T01:19:45.537 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../108-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-23T01:19:45.541 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T01:19:45.558 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-23T01:19:45.603 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T01:19:45.616 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-23T01:19:45.906 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-py. 2023-06-23T01:19:45.926 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../109-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-23T01:19:45.953 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T01:19:45.964 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T01:19:45.970 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-23T01:19:46.035 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T01:19:46.314 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T01:19:46.317 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-23T01:19:46.332 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-23T01:19:46.334 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-23T01:19:46.372 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T01:19:46.375 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T01:19:46.678 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-pytest. 2023-06-23T01:19:46.699 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../111-python3-pytest_4.6.9-1_all.deb ... 2023-06-23T01:19:46.736 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-23T01:19:47.106 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package python3-simplejson. 2023-06-23T01:19:47.125 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../112-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-23T01:19:47.164 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T01:19:47.168 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-06-23T01:19:47.186 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:47.218 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:47.484 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-23T01:19:47.501 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../113-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-23T01:19:47.542 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T01:19:48.271 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package radosgw. 2023-06-23T01:19:48.291 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../114-radosgw_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:48.328 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:49.005 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T01:19:49.024 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:49.062 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:49.384 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-23T01:19:49.693 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T01:19:49.820 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T01:19:49.929 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T01:19:50.122 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:50.134 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package rbd-fuse. 2023-06-23T01:19:50.221 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../115-rbd-fuse_17.2.6-719-g42ddc46e-1focal_amd64.deb ... 2023-06-23T01:19:50.221 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:50.508 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-23T01:19:50.784 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-06-23T01:19:50.831 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-23T01:19:50.946 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:50.957 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-23T01:19:51.073 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T01:19:51.074 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-23T01:19:51.301 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:51.447 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T01:19:51.750 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:51.902 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-23T01:19:51.947 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user cephadm....done 2023-06-23T01:19:52.028 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T01:19:52.109 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:52.235 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-23T01:19:52.371 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-23T01:19:52.937 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-23T01:19:52.952 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T01:19:53.238 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-23T01:19:53.270 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-23T01:19:53.364 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-23T01:19:53.491 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-23T01:19:53.546 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-23T01:19:53.814 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T01:19:53.817 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-23T01:19:54.099 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T01:19:54.203 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-23T01:19:54.425 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:54.496 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-23T01:19:54.726 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:54.780 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-23T01:19:54.852 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-23T01:19:55.065 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-23T01:19:55.137 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-23T01:19:55.353 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-23T01:19:55.424 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T01:19:55.646 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-argparse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:19:55.722 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T01:19:55.832 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T01:19:55.947 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-23T01:19:56.082 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-23T01:19:56.259 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-23T01:19:56.383 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-23T01:19:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T01:19:56.659 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-23T01:19:56.861 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T01:19:56.960 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-23T01:19:57.086 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-23T01:19:57.171 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T01:19:57.439 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-23T01:19:57.470 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-23T01:19:57.771 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-23T01:19:57.772 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-23T01:19:58.056 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-23T01:19:58.064 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-23T01:19:58.340 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T01:19:58.424 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-23T01:19:58.467 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T01:19:58.614 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T01:19:58.708 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-23T01:19:58.903 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T01:19:59.044 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-23T01:19:59.296 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-23T01:19:59.336 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-23T01:19:59.580 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T01:19:59.621 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-23T01:19:59.763 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-23T01:19:59.923 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-23T01:19:59.967 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T01:20:00.179 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-23T01:20:00.336 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-23T01:20:00.487 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:00.580 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-23T01:20:00.805 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:00.873 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-23T01:20:00.948 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-23T01:20:01.242 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-23T01:20:01.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T01:20:01.425 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-23T01:20:01.551 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-23T01:20:01.602 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-23T01:20:01.755 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:01.844 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T01:20:02.063 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:02.162 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:02.200 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-23T01:20:02.305 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T01:20:02.406 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T01:20:02.543 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-23T01:20:02.669 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-23T01:20:02.724 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T01:20:02.795 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-23T01:20:03.008 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-23T01:20:03.088 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-23T01:20:03.402 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T01:20:03.406 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:03.532 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-23T01:20:03.561 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T01:20:03.683 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-23T01:20:03.845 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-23T01:20:04.001 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-23T01:20:04.146 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T01:20:04.277 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-23T01:20:04.464 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T01:20:04.570 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-23T01:20:04.696 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-23T01:20:04.819 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-23T01:20:04.997 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-23T01:20:05.068 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-23T01:20:05.194 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T01:20:05.290 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-23T01:20:05.521 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-23T01:20:05.591 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-23T01:20:05.866 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T01:20:05.992 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T01:20:05.994 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-23T01:20:06.126 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-23T01:20:06.252 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-23T01:20:06.378 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-23T01:20:06.477 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T01:20:06.705 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-23T01:20:06.770 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:06.896 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-23T01:20:07.056 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-23T01:20:07.182 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-23T01:20:07.341 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-23T01:20:07.659 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-23T01:20:07.928 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librados2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:08.079 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-23T01:20:08.422 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:08.581 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:20:08.707 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-23T01:20:09.084 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-23T01:20:09.404 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-23T01:20:09.546 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libsqlite3-mod-ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:09.672 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:20:09.696 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:09.823 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-23T01:20:09.848 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-23T01:20:10.173 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:10.211 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-23T01:20:10.333 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T01:20:10.521 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-23T01:20:10.660 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:10.819 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T01:20:10.822 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-23T01:20:10.964 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-23T01:20:11.187 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T01:20:11.308 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:11.434 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-23T01:20:11.744 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libradosstriper1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:11.874 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-23T01:20:12.215 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-23T01:20:12.259 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:12.393 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T01:20:12.544 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-23T01:20:12.670 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:20:12.796 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-23T01:20:13.097 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T01:20:13.215 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-23T01:20:13.262 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librbd1 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:13.422 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-23T01:20:13.548 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-23T01:20:13.627 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:13.674 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-23T01:20:13.753 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:13.800 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-23T01:20:14.007 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T01:20:14.007 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T01:20:14.085 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-23T01:20:14.210 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-23T01:20:14.463 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:14.589 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T01:20:14.597 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-modules-core (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:14.748 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:14.890 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T01:20:14.978 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T01:20:14.978 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-23T01:20:15.225 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T01:20:15.425 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libcephfs-dev (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:15.535 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-23T01:20:15.577 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:15.728 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:15.828 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-23T01:20:15.854 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:15.980 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.132 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.163 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-23T01:20:16.249 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-23T01:20:16.540 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rados (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.559 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-23T01:20:16.675 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up librgw2 (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.801 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-top (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.860 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:16.902 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rbd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:17.003 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up rbd-fuse (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:17.011 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:17.137 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:17.154 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-23T01:20:17.263 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T01:20:17.455 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-23T01:20:17.774 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-rgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:17.909 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-cephfs (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:18.034 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-shell (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:18.144 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-23T01:20:18.217 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:18.803 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-06-23T01:20:19.048 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-common (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:19.188 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-06-23T01:20:19.389 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-06-23T01:20:19.415 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T01:20:19.575 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T01:20:19.617 INFO:teuthology.orchestra.run.smithi192.stdout:Adding group ceph....done 2023-06-23T01:20:19.885 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T01:20:19.994 INFO:teuthology.orchestra.run.smithi192.stdout:Adding system user ceph....done 2023-06-23T01:20:20.187 INFO:teuthology.orchestra.run.smithi192.stdout:Setting system user ceph properties....done 2023-06-23T01:20:20.214 INFO:teuthology.orchestra.run.smithi192.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-23T01:20:20.360 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:20.361 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-23T01:20:20.570 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:20.658 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-23T01:20:20.712 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:21.008 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T01:20:21.008 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T01:20:21.091 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up cephfs-mirror (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:21.218 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-test (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:21.344 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up radosgw (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:21.643 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T01:20:21.643 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-23T01:20:21.732 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:22.122 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T01:20:22.254 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-base (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:22.575 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:22.637 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-23T01:20:22.805 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T01:20:22.805 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T01:20:23.081 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mds (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:23.269 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:23.314 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T01:20:23.315 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-23T01:20:23.504 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T01:20:23.505 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T01:20:23.741 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:23.946 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:23.979 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T01:20:23.979 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-23T01:20:24.401 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-osd (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:24.453 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T01:20:24.453 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T01:20:24.889 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T01:20:24.890 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-23T01:20:24.897 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.006 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.183 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.311 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-k8sevents (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.411 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T01:20:25.411 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T01:20:25.437 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.580 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mon (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:25.810 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T01:20:25.811 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-23T01:20:25.875 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.052 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.172 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.239 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-cephadm (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.315 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.407 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.467 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T01:20:26.525 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-mgr-dashboard (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.627 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T01:20:26.659 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ceph-volume (17.2.6-719-g42ddc46e-1focal) ... 2023-06-23T01:20:26.786 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T01:20:26.903 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T01:20:26.944 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T01:20:27.214 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T01:20:29.831 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-23T01:20:30.104 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-23T01:20:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T01:20:30.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-23T01:20:30.532 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-06-23T01:20:30.679 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T01:20:30.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2023-06-23T01:20:30.735 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-06-23T01:20:30.735 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-06-23T01:20:30.754 INFO:teuthology.orchestra.run.smithi192.stdout:Reading package lists... 2023-06-23T01:20:30.926 INFO:teuthology.orchestra.run.smithi045.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-23T01:20:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-23T01:20:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-23T01:20:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-23T01:20:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-23T01:20:30.927 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T01:20:30.928 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T01:20:30.928 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T01:20:30.928 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-06-23T01:20:30.928 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-23T01:20:30.929 INFO:teuthology.orchestra.run.smithi045.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-23T01:20:30.929 INFO:teuthology.orchestra.run.smithi045.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-23T01:20:30.929 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch-data wpasupplicant 2023-06-23T01:20:30.930 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-06-23T01:20:30.930 INFO:teuthology.orchestra.run.smithi045.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-23T01:20:30.930 INFO:teuthology.orchestra.run.smithi045.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-23T01:20:30.951 INFO:teuthology.orchestra.run.smithi192.stdout:Building dependency tree... 2023-06-23T01:20:30.952 INFO:teuthology.orchestra.run.smithi192.stdout:Reading state information... 2023-06-23T01:20:30.977 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-06-23T01:20:30.977 INFO:teuthology.orchestra.run.smithi045.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-23T01:20:30.978 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-23T01:20:30.978 INFO:teuthology.orchestra.run.smithi045.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-23T01:20:30.978 INFO:teuthology.orchestra.run.smithi045.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T01:20:30.979 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-06-23T01:20:30.980 INFO:teuthology.orchestra.run.smithi045.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-23T01:20:31.033 INFO:teuthology.orchestra.run.smithi045.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-23T01:20:31.034 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 10.2 MB of archives. 2023-06-23T01:20:31.034 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-23T01:20:31.034 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-23T01:20:31.132 INFO:teuthology.orchestra.run.smithi192.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-23T01:20:31.147 INFO:teuthology.orchestra.run.smithi192.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-23T01:20:31.147 INFO:teuthology.orchestra.run.smithi192.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-23T01:20:31.147 INFO:teuthology.orchestra.run.smithi192.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-23T01:20:31.148 INFO:teuthology.orchestra.run.smithi192.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-23T01:20:31.148 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages were automatically installed and are no longer required: 2023-06-23T01:20:31.149 INFO:teuthology.orchestra.run.smithi192.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-23T01:20:31.149 INFO:teuthology.orchestra.run.smithi192.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-23T01:20:31.149 INFO:teuthology.orchestra.run.smithi192.stdout:The following additional packages will be installed: 2023-06-23T01:20:31.149 INFO:teuthology.orchestra.run.smithi192.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-23T01:20:31.149 INFO:teuthology.orchestra.run.smithi192.stdout: libnm0 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 libuuid1 2023-06-23T01:20:31.150 INFO:teuthology.orchestra.run.smithi192.stdout: modemmanager network-manager-pptp ppp pptp-linux usb-modeswitch 2023-06-23T01:20:31.150 INFO:teuthology.orchestra.run.smithi192.stdout: usb-modeswitch-data wpasupplicant 2023-06-23T01:20:31.150 INFO:teuthology.orchestra.run.smithi192.stdout:Suggested packages: 2023-06-23T01:20:31.150 INFO:teuthology.orchestra.run.smithi192.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils comgt wvdial 2023-06-23T01:20:31.150 INFO:teuthology.orchestra.run.smithi192.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2023-06-23T01:20:31.163 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-23T01:20:31.164 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-23T01:20:31.164 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-23T01:20:31.182 INFO:teuthology.orchestra.run.smithi192.stdout:The following NEW packages will be installed: 2023-06-23T01:20:31.183 INFO:teuthology.orchestra.run.smithi192.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-23T01:20:31.183 INFO:teuthology.orchestra.run.smithi192.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libqmi-glib5 libqmi-proxy 2023-06-23T01:20:31.183 INFO:teuthology.orchestra.run.smithi192.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-23T01:20:31.184 INFO:teuthology.orchestra.run.smithi192.stdout: ppp pptp-linux usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-23T01:20:31.184 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-23T01:20:31.184 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-23T01:20:31.185 INFO:teuthology.orchestra.run.smithi192.stdout:The following packages will be upgraded: 2023-06-23T01:20:31.186 INFO:teuthology.orchestra.run.smithi192.stdout: libssl1.1 libuuid1 util-linux uuid-dev 2023-06-23T01:20:31.186 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-23T01:20:31.187 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-23T01:20:31.187 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-23T01:20:31.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-23T01:20:31.188 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-23T01:20:31.225 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-23T01:20:31.241 INFO:teuthology.orchestra.run.smithi192.stdout:4 upgraded, 23 newly installed, 0 to remove and 201 not upgraded. 2023-06-23T01:20:31.242 INFO:teuthology.orchestra.run.smithi192.stdout:Need to get 10.2 MB of archives. 2023-06-23T01:20:31.242 INFO:teuthology.orchestra.run.smithi192.stdout:After this operation, 33.5 MB of additional disk space will be used. 2023-06-23T01:20:31.242 INFO:teuthology.orchestra.run.smithi192.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-06-23T01:20:31.244 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-23T01:20:31.304 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-23T01:20:31.305 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-23T01:20:31.330 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-23T01:20:31.348 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-23T01:20:31.348 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-23T01:20:31.369 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-23T01:20:31.369 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-23T01:20:31.375 INFO:teuthology.orchestra.run.smithi192.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-06-23T01:20:31.376 INFO:teuthology.orchestra.run.smithi192.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-06-23T01:20:31.377 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-23T01:20:31.378 INFO:teuthology.orchestra.run.smithi192.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-23T01:20:31.388 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-23T01:20:31.396 INFO:teuthology.orchestra.run.smithi192.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-23T01:20:31.396 INFO:teuthology.orchestra.run.smithi192.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-23T01:20:31.398 INFO:teuthology.orchestra.run.smithi192.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-23T01:20:31.398 INFO:teuthology.orchestra.run.smithi192.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-23T01:20:31.399 INFO:teuthology.orchestra.run.smithi192.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-23T01:20:31.400 INFO:teuthology.orchestra.run.smithi192.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-23T01:20:31.400 INFO:teuthology.orchestra.run.smithi192.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-23T01:20:31.437 INFO:teuthology.orchestra.run.smithi192.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-23T01:20:31.438 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-23T01:20:31.456 INFO:teuthology.orchestra.run.smithi192.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-23T01:20:31.516 INFO:teuthology.orchestra.run.smithi192.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-23T01:20:31.517 INFO:teuthology.orchestra.run.smithi192.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-23T01:20:31.539 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-23T01:20:31.540 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-23T01:20:31.541 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-23T01:20:31.542 INFO:teuthology.orchestra.run.smithi192.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-23T01:20:31.542 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-23T01:20:31.561 INFO:teuthology.orchestra.run.smithi192.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-23T01:20:31.561 INFO:teuthology.orchestra.run.smithi192.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-23T01:20:31.580 INFO:teuthology.orchestra.run.smithi192.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-23T01:20:31.581 INFO:teuthology.orchestra.run.smithi192.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-23T01:20:31.588 INFO:teuthology.orchestra.run.smithi192.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-23T01:20:31.598 INFO:teuthology.orchestra.run.smithi192.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-23T01:20:31.648 INFO:teuthology.orchestra.run.smithi192.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-23T01:20:31.750 INFO:teuthology.orchestra.run.smithi192.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-23T01:20:31.754 INFO:teuthology.orchestra.run.smithi192.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-23T01:20:31.754 INFO:teuthology.orchestra.run.smithi192.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-23T01:20:31.754 INFO:teuthology.orchestra.run.smithi192.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-23T01:20:31.879 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-06-23T01:20:32.010 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 10.2 MB in 1s (18.3 MB/s) 2023-06-23T01:20:32.082 INFO:teuthology.orchestra.run.smithi192.stdout:Preconfiguring packages ... 2023-06-23T01:20:32.219 INFO:teuthology.orchestra.run.smithi192.stdout:Fetched 10.2 MB in 1s (18.1 MB/s) 2023-06-23T01:20:32.301 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:32.306 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:32.467 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:32.481 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:32.486 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:32.656 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:33.626 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:33.776 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:35.249 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:35.254 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:35.420 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:35.595 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:35.599 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:35.743 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:35.845 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:36.016 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:36.141 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-06-23T01:20:36.343 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-06-23T01:20:36.385 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:36.680 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:36.945 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T01:20:37.083 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-23T01:20:37.222 INFO:teuthology.orchestra.run.smithi192.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 152683 files and directories currently installed.) 2023-06-23T01:20:37.227 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T01:20:37.376 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-23T01:20:37.620 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T01:20:37.638 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-23T01:20:37.678 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-23T01:20:37.914 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-23T01:20:37.931 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-23T01:20:37.972 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-23T01:20:37.981 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-06-23T01:20:37.998 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-23T01:20:38.065 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b46-6) ... 2023-06-23T01:20:38.350 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package dump. 2023-06-23T01:20:38.360 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-06-23T01:20:38.367 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-23T01:20:38.378 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-23T01:20:38.408 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking dump (0.4b46-6) ... 2023-06-23T01:20:38.418 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1) ... 2023-06-23T01:20:38.712 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package indent. 2023-06-23T01:20:38.729 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-23T01:20:38.771 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T01:20:38.789 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-23T01:20:38.795 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking indent (2.2.12-1) ... 2023-06-23T01:20:38.829 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T01:20:39.106 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-23T01:20:39.125 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-23T01:20:39.164 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T01:20:39.518 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T01:20:39.535 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-23T01:20:39.735 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-23T01:20:39.756 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-23T01:20:39.771 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T01:20:40.011 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T01:20:40.164 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T01:20:40.183 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-23T01:20:40.222 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T01:20:40.567 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T01:20:40.588 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:40.625 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:40.755 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-23T01:20:40.773 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-23T01:20:40.846 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T01:20:40.928 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T01:20:40.947 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:40.986 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:41.176 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-23T01:20:41.194 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:41.232 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:41.339 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T01:20:41.357 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:41.397 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:41.477 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-23T01:20:41.496 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:41.535 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:41.750 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T01:20:41.768 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-23T01:20:41.808 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T01:20:41.896 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-23T01:20:41.913 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:41.954 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:42.170 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T01:20:42.187 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T01:20:42.228 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:42.324 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-23T01:20:42.344 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-23T01:20:42.382 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T01:20:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T01:20:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:42.689 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:42.702 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-23T01:20:42.719 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T01:20:42.752 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:43.000 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T01:20:43.020 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:43.058 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:43.172 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-23T01:20:43.193 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:43.230 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:43.344 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T01:20:43.364 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T01:20:43.403 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:43.557 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-23T01:20:43.577 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:43.615 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:43.868 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-23T01:20:43.885 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-23T01:20:43.931 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T01:20:43.949 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-23T01:20:43.958 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:43.989 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-23T01:20:44.392 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package modemmanager. 2023-06-23T01:20:44.412 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:44.463 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:44.505 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-23T01:20:44.522 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libteamdctl0_1.30-1_amd64.deb ... 2023-06-23T01:20:44.563 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-23T01:20:44.974 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-06-23T01:20:44.992 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-23T01:20:45.043 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:45.360 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T01:20:45.377 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-23T01:20:45.483 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T01:20:45.641 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-06-23T01:20:45.660 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-23T01:20:45.867 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T01:20:46.005 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager. 2023-06-23T01:20:46.023 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T01:20:46.088 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:46.822 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-06-23T01:20:46.842 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package ppp. 2023-06-23T01:20:46.843 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-23T01:20:46.863 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-23T01:20:46.905 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:47.131 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T01:20:47.484 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T01:20:47.501 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-23T01:20:47.542 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-23T01:20:47.671 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-06-23T01:20:47.692 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-23T01:20:47.887 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T01:20:47.904 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-23T01:20:47.963 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-23T01:20:47.970 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T01:20:48.240 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T01:20:48.258 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-23T01:20:48.298 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-23T01:20:48.325 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-06-23T01:20:48.344 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-23T01:20:48.383 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-23T01:20:48.701 INFO:teuthology.orchestra.run.smithi192.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T01:20:48.719 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-23T01:20:48.719 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-23T01:20:48.740 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-23T01:20:48.770 INFO:teuthology.orchestra.run.smithi192.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T01:20:48.795 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-23T01:20:49.061 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:49.072 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-23T01:20:49.091 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-23T01:20:49.130 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-23T01:20:49.399 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-23T01:20:49.508 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T01:20:49.534 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-23T01:20:49.554 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-23T01:20:49.602 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T01:20:49.608 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T01:20:49.921 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:49.976 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T01:20:49.976 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T01:20:50.222 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-23T01:20:50.365 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-23T01:20:50.437 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:50.490 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-23T01:20:50.805 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-23T01:20:50.879 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T01:20:50.880 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-23T01:20:51.225 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:51.351 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-23T01:20:51.476 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T01:20:51.564 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-06-23T01:20:51.612 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:51.762 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T01:20:52.037 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-23T01:20:52.455 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-23T01:20:52.606 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-23T01:20:52.698 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-23T01:20:52.732 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-23T01:20:52.833 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:52.918 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up dump (0.4b46-6) ... 2023-06-23T01:20:52.934 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-23T01:20:53.047 INFO:teuthology.orchestra.run.smithi192.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T01:20:53.112 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:53.237 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T01:20:53.364 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up indent (2.2.12-1) ... 2023-06-23T01:20:53.490 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T01:20:53.691 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T01:20:53.817 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:53.928 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-23T01:20:53.943 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-23T01:20:54.111 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:54.164 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b46-6) ... 2023-06-23T01:20:54.259 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-23T01:20:54.324 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:54.475 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-23T01:20:54.585 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1) ... 2023-06-23T01:20:54.710 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-23T01:20:54.783 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:20:54.783 INFO:teuthology.orchestra.run.smithi192.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T01:20:54.784 INFO:teuthology.orchestra.run.smithi192.stdout:which means they are currently configured by ifupdown: 2023-06-23T01:20:54.784 INFO:teuthology.orchestra.run.smithi192.stdout:- enp3s0f1 2023-06-23T01:20:54.784 INFO:teuthology.orchestra.run.smithi192.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T01:20:54.784 INFO:teuthology.orchestra.run.smithi192.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T01:20:54.784 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:20:54.929 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-23T01:20:54.939 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T01:20:55.055 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:55.181 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-23T01:20:55.246 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T01:20:55.374 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-23T01:20:55.747 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T01:20:56.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-23T01:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-06-23T01:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-06-23T01:20:56.076 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-23T01:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-06-23T01:20:56.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:20:56.240 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-23T01:20:56.479 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-23T01:20:56.757 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-23T01:20:56.900 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:57.026 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:57.105 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-23T01:20:57.153 INFO:teuthology.orchestra.run.smithi192.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:57.454 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T01:20:57.455 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T01:20:57.610 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-23T01:20:57.737 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-23T01:20:57.879 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:57.980 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-23T01:20:58.039 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-23T01:20:58.089 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T01:20:58.164 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-23T01:20:58.207 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T01:20:58.358 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T01:20:58.437 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T01:20:58.437 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-23T01:20:58.642 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T01:20:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-06-23T01:20:59.059 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-23T01:20:59.185 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-23T01:20:59.361 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-23T01:20:59.696 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-23T01:21:02.470 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-23T01:21:02.570 INFO:teuthology.orchestra.run.smithi192.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-23T01:21:03.425 INFO:teuthology.orchestra.run.smithi192.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T01:21:03.429 DEBUG:teuthology.parallel:result is None 2023-06-23T01:21:03.732 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-23T01:21:03.832 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-23T01:21:04.706 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-23T01:21:04.708 DEBUG:teuthology.parallel:result is None 2023-06-23T01:21:04.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T01:21:04.853 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-06-23T01:21:04.878 INFO:teuthology.orchestra.run.smithi045.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-23T01:21:04.879 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-23T01:21:04.880 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-23T01:21:04.881 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=42ddc46e6e6582d8e29a5a982a81886fe028be2c 2023-06-23T01:21:05.028 DEBUG:teuthology.orchestra.run.smithi192:> dpkg-query -W -f '${Version}' ceph 2023-06-23T01:21:05.054 INFO:teuthology.orchestra.run.smithi192.stdout:17.2.6-719-g42ddc46e-1focal 2023-06-23T01:21:05.054 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-719-g42ddc46e-1focal 2023-06-23T01:21:05.055 INFO:teuthology.task.install:The correct ceph version 17.2.6-719-g42ddc46e-1focal is installed. 2023-06-23T01:21:05.055 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-23T01:21:05.055 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T01:21:05.073 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:05.073 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-23T01:21:05.090 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-23T01:21:05.090 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.091 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T01:21:05.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T01:21:05.166 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:05.167 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2023-06-23T01:21:05.183 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-23T01:21:05.193 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-23T01:21:05.194 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.194 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T01:21:05.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T01:21:05.269 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:05.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-23T01:21:05.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-23T01:21:05.302 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-23T01:21:05.302 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.302 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T01:21:05.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T01:21:05.379 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:05.379 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2023-06-23T01:21:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-23T01:21:05.451 INFO:teuthology.run_tasks:Running task ceph... 2023-06-23T01:21:05.522 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-23T01:21:05.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-06-23T01:21:05.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2023-06-23T01:21:05.541 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-23T01:21:05.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T01:21:05.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-23T01:21:05.598 INFO:tasks.ceph:Creating extra log directories... 2023-06-23T01:21:05.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T01:21:05.601 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-23T01:21:05.664 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-23T01:21:05.664 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-23T01:21:05.664 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-23T01:21:05.665 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.665 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T01:21:05.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T01:21:05.753 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:05.754 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-23T01:21:05.761 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-23T01:21:05.850 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-23T01:21:05.850 INFO:tasks.ceph:config {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-23T01:21:05.851 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949', 'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'description': 'fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7311949', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy'}, 'ceph': {'conf': {'client': {'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 9037, 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri4-testing-2023-06-21-0846-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c', 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi192.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '42ddc46e6e6582d8e29a5a982a81886fe028be2c'}}, {'ceph': None}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/acl.sh', 'fs/misc/chmod.sh', 'fs/misc/dac_override.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '076bbebc42a14f7d568aaa78eabb0038327bcb23', 'timestamp': '2023-06-22_15:25:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-23T01:21:05.852 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T01:21:05.855 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-23T01:21:05.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T01:21:05.863 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2023-06-23T01:21:05.877 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:05.878 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T01:21:05.923 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T01:21:05.924 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-06-23T01:21:05.931 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T01:21:05.932 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:05.932 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 358 Links: 1 2023-06-23T01:21:05.932 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:05.933 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-23 01:16:49.452504513 +0000 2023-06-23T01:21:05.933 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-23 01:16:49.152511415 +0000 2023-06-23T01:21:05.933 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-23 01:16:49.152511415 +0000 2023-06-23T01:21:05.933 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-06-23T01:21:05.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T01:21:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-23T01:21:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-23T01:21:05.949 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.00025195 s, 2.0 MB/s 2023-06-23T01:21:05.950 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T01:21:06.001 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-06-23T01:21:06.008 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-23 01:16:49.964492734 +0000 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-23 01:16:49.656499820 +0000 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-23 01:16:49.656499820 +0000 2023-06-23T01:21:06.009 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-06-23T01:21:06.010 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T01:21:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-23T01:21:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-23T01:21:06.024 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000315569 s, 1.6 MB/s 2023-06-23T01:21:06.025 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T01:21:06.077 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-06-23T01:21:06.084 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T01:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-06-23T01:21:06.085 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-23 01:16:50.480480862 +0000 2023-06-23T01:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-23 01:16:50.184487672 +0000 2023-06-23T01:21:06.086 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-23 01:16:50.184487672 +0000 2023-06-23T01:21:06.087 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-06-23T01:21:06.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T01:21:06.099 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-23T01:21:06.099 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-23T01:21:06.100 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000288664 s, 1.8 MB/s 2023-06-23T01:21:06.101 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T01:21:06.153 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-06-23T01:21:06.161 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T01:21:06.161 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.161 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 379 Links: 1 2023-06-23T01:21:06.162 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.162 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-06-23 01:16:51.048467794 +0000 2023-06-23T01:21:06.162 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-06-23 01:16:50.724475249 +0000 2023-06-23T01:21:06.162 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-06-23 01:16:50.724475249 +0000 2023-06-23T01:21:06.162 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-06-23T01:21:06.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T01:21:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-06-23T01:21:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-06-23T01:21:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000293801 s, 1.7 MB/s 2023-06-23T01:21:06.176 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T01:21:06.229 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:06.229 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:06.229 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2023-06-23T01:21:06.236 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-23T01:21:06.237 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2023-06-23T01:21:06.244 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-23T01:21:06.244 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.244 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-06-23T01:21:06.244 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.245 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-06-23 01:16:49.894747897 +0000 2023-06-23T01:21:06.245 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-06-23 01:16:49.586754992 +0000 2023-06-23T01:21:06.245 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-06-23 01:16:49.586754992 +0000 2023-06-23T01:21:06.245 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-06-23T01:21:06.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-23T01:21:06.257 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-06-23T01:21:06.258 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-06-23T01:21:06.258 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000405627 s, 1.3 MB/s 2023-06-23T01:21:06.259 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-23T01:21:06.309 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2023-06-23T01:21:06.317 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 364 Links: 1 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-06-23 01:16:50.414735917 +0000 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-06-23 01:16:50.126742551 +0000 2023-06-23T01:21:06.318 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-06-23 01:16:50.126742551 +0000 2023-06-23T01:21:06.319 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-06-23T01:21:06.319 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-23T01:21:06.375 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-06-23T01:21:06.375 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-06-23T01:21:06.376 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000405097 s, 1.3 MB/s 2023-06-23T01:21:06.376 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-23T01:21:06.385 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2023-06-23T01:21:06.391 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-23T01:21:06.391 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.391 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 372 Links: 1 2023-06-23T01:21:06.391 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.391 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-06-23 01:16:50.938723845 +0000 2023-06-23T01:21:06.392 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-06-23 01:16:50.638730755 +0000 2023-06-23T01:21:06.392 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-06-23 01:16:50.638730755 +0000 2023-06-23T01:21:06.392 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-06-23T01:21:06.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-23T01:21:06.447 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-06-23T01:21:06.447 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-06-23T01:21:06.447 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000395435 s, 1.3 MB/s 2023-06-23T01:21:06.448 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-23T01:21:06.457 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2023-06-23T01:21:06.463 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-23T01:21:06.464 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-23T01:21:06.464 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 378 Links: 1 2023-06-23T01:21:06.464 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-23T01:21:06.465 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2023-06-23 01:16:51.502710851 +0000 2023-06-23T01:21:06.465 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2023-06-23 01:16:51.182718223 +0000 2023-06-23T01:21:06.465 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2023-06-23 01:16:51.182718223 +0000 2023-06-23T01:21:06.465 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2023-06-23T01:21:06.466 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-23T01:21:06.519 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2023-06-23T01:21:06.519 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2023-06-23T01:21:06.519 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000399408 s, 1.3 MB/s 2023-06-23T01:21:06.520 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-23T01:21:06.528 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:06.529 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T01:21:06.529 INFO:tasks.ceph:Generating config... 2023-06-23T01:21:06.530 INFO:tasks.ceph:[client] client acl type = posix_acl 2023-06-23T01:21:06.531 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-23T01:21:06.531 INFO:tasks.ceph:[client] debug client = 20 2023-06-23T01:21:06.531 INFO:tasks.ceph:[client] debug ms = 1 2023-06-23T01:21:06.531 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-23T01:21:06.531 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-23T01:21:06.532 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-23T01:21:06.532 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-23T01:21:06.532 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-23T01:21:06.532 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-23T01:21:06.532 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-23T01:21:06.533 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-23T01:21:06.533 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-23T01:21:06.533 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-23T01:21:06.533 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-23T01:21:06.533 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-23T01:21:06.534 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-23T01:21:06.534 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-23T01:21:06.534 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-23T01:21:06.534 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-23T01:21:06.534 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-23T01:21:06.534 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-23T01:21:06.535 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-06-23T01:21:06.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-23T01:21:06.535 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-23T01:21:06.535 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-23T01:21:06.535 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-23T01:21:06.536 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-23T01:21:06.536 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-23T01:21:06.536 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-23T01:21:06.536 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-23T01:21:06.536 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-23T01:21:06.537 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-23T01:21:06.537 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-23T01:21:06.537 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-23T01:21:06.537 INFO:tasks.ceph:Setting up mon.a... 2023-06-23T01:21:06.538 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-23T01:21:06.574 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-06-23T01:21:06.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-23T01:21:06.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T01:21:06.671 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.192'), ('mon.c', '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]')] 2023-06-23T01:21:06.671 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client acl type': 'posix_acl', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-23T01:21:06.672 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:06.673 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T01:21:06.678 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.192 --addv c '[v2:172.21.15.192:3301,v1:172.21.15.192:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:06.719 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid e324825f-5083-43ec-addd-73b25ee34de6 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = octopus 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:fsid e324825f-5083-43ec-addd-73b25ee34de6 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-06-23T01:21:06.718018+0000 2023-06-23T01:21:06.720 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-06-23T01:21:06.718018+0000 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 15 (octopus) 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.b 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] mon.c 2023-06-23T01:21:06.721 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-23T01:21:06.722 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-23T01:21:06.730 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e324825f-5083-43ec-addd-73b25ee34de6... 2023-06-23T01:21:06.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T01:21:06.775 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-23T01:21:06.809 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-06-23T01:21:06.810 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.811 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-06-23T01:21:06.811 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.811 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-06-23T01:21:06.812 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-06-23T01:21:06.812 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.812 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-06-23T01:21:06.812 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-06-23T01:21:06.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.813 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T01:21:06.813 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-06-23T01:21:06.813 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.814 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T01:21:06.814 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T01:21:06.814 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.815 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-06-23T01:21:06.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.815 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-06-23T01:21:06.815 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-06-23T01:21:06.816 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-06-23T01:21:06.816 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-06-23T01:21:06.816 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-06-23T01:21:06.817 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-06-23T01:21:06.817 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-06-23T01:21:06.817 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T01:21:06.818 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T01:21:06.818 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-06-23T01:21:06.819 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.820 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T01:21:06.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.820 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-06-23T01:21:06.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.821 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-06-23T01:21:06.821 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.821 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-06-23T01:21:06.821 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-06-23T01:21:06.822 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-06-23T01:21:06.822 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-06-23T01:21:06.822 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = e324825f-5083-43ec-addd-73b25ee34de6 2023-06-23T01:21:06.823 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.823 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-06-23T01:21:06.823 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-06-23T01:21:06.823 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.823 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-06-23T01:21:06.824 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-06-23T01:21:06.824 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-06-23T01:21:06.824 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.825 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-06-23T01:21:06.825 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-06-23T01:21:06.825 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.826 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-06-23T01:21:06.826 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-06-23T01:21:06.826 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-06-23T01:21:06.826 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.827 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-06-23T01:21:06.827 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-06-23T01:21:06.827 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.828 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-06-23T01:21:06.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.828 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-06-23T01:21:06.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.829 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-06-23T01:21:06.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.829 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-06-23T01:21:06.829 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-06-23T01:21:06.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.830 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-06-23T01:21:06.830 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-06-23T01:21:06.830 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-06-23T01:21:06.831 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore compression mode = aggressive 2023-06-23T01:21:06.831 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-06-23T01:21:06.831 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-06-23T01:21:06.831 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-06-23T01:21:06.832 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-23T01:21:06.832 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-06-23T01:21:06.832 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-06-23T01:21:06.833 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T01:21:06.833 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-06-23T01:21:06.833 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-06-23T01:21:06.833 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-06-23T01:21:06.834 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-23T01:21:06.835 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-06-23T01:21:06.836 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T01:21:06.837 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.838 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-06-23T01:21:06.839 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-06-23T01:21:06.839 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:06.839 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-06-23T01:21:06.839 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: client acl type = posix_acl 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-06-23T01:21:06.840 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-06-23T01:21:06.841 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-06-23T01:21:06.842 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-06-23T01:21:06.843 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-06-23T01:21:06.843 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-06-23T01:21:06.843 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-06-23T01:21:06.844 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2023-06-23T01:21:06.844 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2023-06-23T01:21:06.844 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.845 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2023-06-23T01:21:06.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2023-06-23T01:21:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-23T01:21:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2023-06-23T01:21:06.849 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.45,172.21.15.192,[v2:172.21.15.192:3301,v1:172.21.15.192:6790]" 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = e324825f-5083-43ec-addd-73b25ee34de6 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2023-06-23T01:21:06.850 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2023-06-23T01:21:06.851 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2023-06-23T01:21:06.852 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2023-06-23T01:21:06.853 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore compression mode = aggressive 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 20 2023-06-23T01:21:06.854 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 20 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 10 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 0.95 2023-06-23T01:21:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = bluestore 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-06-23T01:21:06.856 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2023-06-23T01:21:06.857 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2023-06-23T01:21:06.858 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-23T01:21:06.859 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2023-06-23T01:21:06.860 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: client acl type = posix_acl 2023-06-23T01:21:06.861 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2023-06-23T01:21:06.862 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2023-06-23T01:21:06.863 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2023-06-23T01:21:06.864 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2023-06-23T01:21:06.864 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2023-06-23T01:21:06.864 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2023-06-23T01:21:06.864 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-23T01:21:06.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-23T01:21:06.913 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-23T01:21:06.914 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:06.915 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-23T01:21:06.922 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:06.922 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-23T01:21:06.928 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:21:06.929 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:06.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T01:21:06.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T01:21:06.953 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:06.953 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:07.003 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:21:07.004 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:07.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-23T01:21:07.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-23T01:21:07.033 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:07.034 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:07.039 INFO:tasks.ceph:Setting up mon nodes... 2023-06-23T01:21:07.040 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-23T01:21:07.040 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T01:21:07.085 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-23T01:21:07.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T01:21:07.135 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-23T01:21:07.137 INFO:tasks.ceph:Setting up mds nodes... 2023-06-23T01:21:07.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T01:21:07.183 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-23T01:21:07.186 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-23T01:21:07.198 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T01:21:07.243 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-23T01:21:07.245 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-23T01:21:07.303 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-23T01:21:07.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-23T01:21:07.343 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-23T01:21:07.356 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-23T01:21:07.357 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-23T01:21:07.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-23T01:21:07.368 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:07.369 INFO:tasks.ceph:role: osd.0 2023-06-23T01:21:07.369 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:21:07.369 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T01:21:07.411 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:07.412 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:07.412 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:07.412 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-06-23T01:21:07.412 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:07.413 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:07.413 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:07.413 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:07.413 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:07.414 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:07.419 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-23T01:21:07.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-23T01:21:07.482 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-23T01:21:07.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:07.493 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:07.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-23T01:21:07.506 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:07.506 INFO:tasks.ceph:role: osd.1 2023-06-23T01:21:07.506 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:21:07.506 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T01:21:07.547 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:07.548 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:07.549 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:07.549 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:07.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-23T01:21:07.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-23T01:21:07.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-23T01:21:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:07.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:07.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-23T01:21:07.646 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:07.647 INFO:tasks.ceph:role: osd.2 2023-06-23T01:21:07.647 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:21:07.647 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T01:21:07.688 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:07.688 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:07.688 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:07.689 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-06-23T01:21:07.689 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:07.689 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:07.689 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:07.690 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:07.690 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:07.690 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:07.691 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-23T01:21:07.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-23T01:21:07.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-23T01:21:07.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:07.723 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:07.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-23T01:21:07.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:07.781 INFO:tasks.ceph:role: osd.3 2023-06-23T01:21:07.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:21:07.782 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T01:21:07.822 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:07.823 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:07.823 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:07.823 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-06-23T01:21:07.823 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:07.823 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:07.824 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:07.824 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:07.824 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:07.824 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:07.825 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-06-23T01:21:07.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-23T01:21:07.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-23T01:21:07.901 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:07.902 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:07.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-23T01:21:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-23T01:21:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T01:21:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T01:21:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-23T01:21:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:07.975+0000 7f767531a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-23T01:21:08.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:08.535+0000 7f767531a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:09.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:09.307+0000 7f767531a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:10.099+0000 7f767531a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:10.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-23T01:21:10.984 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:11.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-23T01:21:11.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-23T01:21:11.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T01:21:11.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T01:21:11.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-23T01:21:11.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.019+0000 7f6d88d103c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-23T01:21:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:11.587+0000 7f6d88d103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:12.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:12.363+0000 7f6d88d103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:13.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:13.151+0000 7f6d88d103c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:14.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-23T01:21:14.035 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.071+0000 7f9525aa43c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-23T01:21:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.071+0000 7f9525aa43c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-23T01:21:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.071+0000 7f9525aa43c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T01:21:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.071+0000 7f9525aa43c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T01:21:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.071+0000 7f9525aa43c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-23T01:21:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.075+0000 7f9525aa43c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-23T01:21:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:14.627+0000 7f9525aa43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:15.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:15.407+0000 7f9525aa43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:16.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:16.191+0000 7f9525aa43c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:17.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-23T01:21:17.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-23T01:21:17.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-23T01:21:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T01:21:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T01:21:17.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-23T01:21:17.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.159+0000 7f301f5613c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-23T01:21:17.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:17.715+0000 7f301f5613c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:18.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:18.491+0000 7f301f5613c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:19.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:19.275+0000 7f301f5613c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:20.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-23T01:21:20.167 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-23T01:21:20.186 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:20.187 INFO:tasks.ceph:role: osd.4 2023-06-23T01:21:20.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:21:20.187 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-23T01:21:20.728 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:20.729 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:20.730 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:20.730 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:20.731 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-06-23T01:21:20.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-23T01:21:20.817 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-23T01:21:20.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:20.830 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:20.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-23T01:21:20.848 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:20.848 INFO:tasks.ceph:role: osd.5 2023-06-23T01:21:20.848 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:21:20.849 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-23T01:21:21.380 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:21.381 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:21.382 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:21.382 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:21.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-06-23T01:21:21.383 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-23T01:21:21.417 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-23T01:21:21.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:21.428 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:21.428 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-23T01:21:21.441 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:21.444 INFO:tasks.ceph:role: osd.6 2023-06-23T01:21:21.444 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:21:21.445 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-23T01:21:21.949 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:21.949 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:21.949 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:21.950 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:21.951 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-06-23T01:21:21.953 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-23T01:21:22.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-23T01:21:22.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:22.015 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:22.015 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-23T01:21:22.027 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-23T01:21:22.028 INFO:tasks.ceph:role: osd.7 2023-06-23T01:21:22.028 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:21:22.028 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-23T01:21:22.521 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-23T01:21:22.521 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-23T01:21:22.522 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-23T01:21:22.522 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 2023-06-23T01:21:22.522 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-23T01:21:22.522 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2023-06-23T01:21:22.523 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-23T01:21:22.523 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-23T01:21:22.523 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-23T01:21:22.523 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-23T01:21:22.524 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2023-06-23T01:21:22.525 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-23T01:21:22.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-23T01:21:22.587 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: /sbin/restorecon: command not found 2023-06-23T01:21:22.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:21:22.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:22.667 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.659+0000 7fe0cb1bd3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-23T01:21:22.668 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.659+0000 7fe0cb1bd3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-23T01:21:22.668 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.659+0000 7fe0cb1bd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T01:21:22.668 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.659+0000 7fe0cb1bd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T01:21:22.668 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.659+0000 7fe0cb1bd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-23T01:21:22.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:22.667+0000 7fe0cb1bd3c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-23T01:21:23.253 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:23.243+0000 7fe0cb1bd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:24.011+0000 7fe0cb1bd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:24.807 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:24.799+0000 7fe0cb1bd3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:25.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-23T01:21:25.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:25.731 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-23T01:21:25.731 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-23T01:21:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T01:21:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T01:21:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-23T01:21:25.732 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:25.723+0000 7fcd4b1253c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-23T01:21:26.296 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:26.287+0000 7fcd4b1253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:27.070 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:27.063+0000 7fcd4b1253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:27.853 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:27.847+0000 7fcd4b1253c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:28.729 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-23T01:21:28.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:28.788 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.775+0000 7ff095e603c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-23T01:21:28.789 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.775+0000 7ff095e603c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-23T01:21:28.789 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.775+0000 7ff095e603c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T01:21:28.789 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.775+0000 7ff095e603c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T01:21:28.789 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.775+0000 7ff095e603c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-23T01:21:28.789 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:28.779+0000 7ff095e603c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-23T01:21:29.338 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:29.331+0000 7ff095e603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:30.121 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:30.111+0000 7ff095e603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:30.903 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:30.895+0000 7ff095e603c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:31.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-23T01:21:31.817 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:31.858 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-23T01:21:31.859 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-23T01:21:31.859 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T01:21:31.859 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T01:21:31.860 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-23T01:21:31.861 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:31.851+0000 7f22f78eb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-23T01:21:32.428 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:32.419+0000 7f22f78eb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:33.210 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:33.203+0000 7f22f78eb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:33.993 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:33.987+0000 7f22f78eb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-06-23T01:21:34.844 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-23T01:21:34.861 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-23T01:21:34.861 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:34.861 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-23T01:21:34.879 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:34.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-23T01:21:34.936 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:34.937 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-23T01:21:34.948 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:34.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-23T01:21:34.959 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:34.960 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-23T01:21:35.017 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:35.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-23T01:21:35.031 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.032 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-23T01:21:35.049 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-23T01:21:35.065 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.065 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-23T01:21:35.125 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-23T01:21:35.141 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.141 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-23T01:21:35.152 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:35.153 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-23T01:21:35.212 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:35.212 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-23T01:21:35.220 INFO:tasks.ceph:Adding keys to all mons... 2023-06-23T01:21:35.220 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T01:21:35.263 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-23T01:21:35.275 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85RkbFsPBRAAhV7MllBQH/ZfQwBnHSICEg== 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85RkD2DeChAAgflies0x9MZa4yXs3JcX9Q== 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85Rks/c2OhAAsHQqiXbXuzHpOw5B6X+HRQ== 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-06-23T01:21:35.276 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCH85RkJqZgARAAAQTjAs99iqeMFWO0MZtdMg== 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCK85RkyKSHBBAABQfjx8thYswxpY6jsN9gwg== 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCN85RkDGWgCRAASZAUw877dX8w/JFL4jbqRQ== 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85RkTYLqBxAAZhyIcYn15PCX/bmwg46HYA== 2023-06-23T01:21:35.277 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85RkMFRVDhAAZkTLdGxycKPX3hOv6CNRFg== 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCS85RkvYiPJxAAhjn4rBvsWzzEnKpjr4SmLw== 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCV85Rk4tRsKxAAFV2+JcI3nQ82Evgh79rQKQ== 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-06-23T01:21:35.278 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCY85RkgaOcLhAA9/dfj/Yd3RUQWITgYVEQbA== 2023-06-23T01:21:35.279 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-06-23T01:21:35.279 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCb85Rk1Bf8MhAAmoIoqvEU1jZIV54MZHgvNg== 2023-06-23T01:21:35.279 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-06-23T01:21:35.279 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQCD85RkctllFBAAMiNTzjEAVPk6jLK0bf1BZw== 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85RkbFsPBRAAhV7MllBQH/ZfQwBnHSICEg== 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85RkD2DeChAAgflies0x9MZa4yXs3JcX9Q== 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2023-06-23T01:21:35.280 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85Rks/c2OhAAsHQqiXbXuzHpOw5B6X+HRQ== 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCH85RkJqZgARAAAQTjAs99iqeMFWO0MZtdMg== 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCK85RkyKSHBBAABQfjx8thYswxpY6jsN9gwg== 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCN85RkDGWgCRAASZAUw877dX8w/JFL4jbqRQ== 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2023-06-23T01:21:35.281 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85RkTYLqBxAAZhyIcYn15PCX/bmwg46HYA== 2023-06-23T01:21:35.282 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2023-06-23T01:21:35.284 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85RkMFRVDhAAZkTLdGxycKPX3hOv6CNRFg== 2023-06-23T01:21:35.284 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2023-06-23T01:21:35.284 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCS85RkvYiPJxAAhjn4rBvsWzzEnKpjr4SmLw== 2023-06-23T01:21:35.285 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2023-06-23T01:21:35.285 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCV85Rk4tRsKxAAFV2+JcI3nQ82Evgh79rQKQ== 2023-06-23T01:21:35.285 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2023-06-23T01:21:35.286 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCY85RkgaOcLhAA9/dfj/Yd3RUQWITgYVEQbA== 2023-06-23T01:21:35.286 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2023-06-23T01:21:35.286 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCb85Rk1Bf8MhAAmoIoqvEU1jZIV54MZHgvNg== 2023-06-23T01:21:35.286 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2023-06-23T01:21:35.287 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQCD85RkctllFBAAMiNTzjEAVPk6jLK0bf1BZw== 2023-06-23T01:21:35.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T01:21:35.292 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T01:21:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T01:21:35.381 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T01:21:35.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.429 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.482 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.572 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.655 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T01:21:35.702 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-23T01:21:35.785 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T01:21:35.788 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-23T01:21:35.834 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.855 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:21:35.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:21:35.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:35.967 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:36.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:36.053 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-23T01:21:36.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T01:21:36.109 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-23T01:21:36.156 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-23T01:21:36.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-23T01:21:36.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T01:21:36.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-23T01:21:36.283 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-23T01:21:36.300 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T01:21:36.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-23T01:21:36.369 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-23T01:21:36.427 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-23T01:21:36.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-23T01:21:36.502 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:36.505 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-23T01:21:36.551 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-23T01:21:36.551 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-23T01:21:36.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-23T01:21:36.554 INFO:tasks.ceph.mon.a:Started 2023-06-23T01:21:36.555 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-23T01:21:36.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-23T01:21:36.557 INFO:tasks.ceph.mon.b:Started 2023-06-23T01:21:36.557 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-23T01:21:36.558 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-23T01:21:36.560 INFO:tasks.ceph.mon.c:Started 2023-06-23T01:21:36.560 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-23T01:21:36.561 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-23T01:21:36.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-23T01:21:36.563 INFO:tasks.ceph.mgr.y:Started 2023-06-23T01:21:36.564 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-23T01:21:36.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-23T01:21:36.567 INFO:tasks.ceph.mgr.x:Started 2023-06-23T01:21:36.567 INFO:tasks.ceph:Setting crush tunables to default 2023-06-23T01:21:36.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-06-23T01:21:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 Processor -- start 2023-06-23T01:21:36.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 -- start start 2023-06-23T01:21:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7013f640 con 0x7f7d700679e0 2023-06-23T01:21:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700abb80 con 0x7f7d70067db0 2023-06-23T01:21:36.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d77c5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7013e730 con 0x7f7d700b08f0 2023-06-23T01:21:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d759fb700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d700679e0 0x7f7d700aa340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:37356/0 (socket says 172.21.15.45:37356) 2023-06-23T01:21:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 learned_addr learned my addr 172.21.15.45:0/396481215 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:36.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T01:21:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:36.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.663+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T01:21:36.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.867+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.867+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T01:21:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.867+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.867+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:36.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:36.867+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T01:21:37.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:37.271+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:37.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:37.271+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T01:21:37.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:37.271+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:37.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:37.271+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:37.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:37.271+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T01:21:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:38.075+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:38.075+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-06-23T01:21:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:38.075+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:38.075+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:38.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:38.075+0000 7f7d761fc700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T01:21:39.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 msgr2=0x7f7d7013f100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T01:21:39.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d700b08f0 0x7f7d7013f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 >> v1:172.21.15.192:6789/0 conn(0x7f7d70067db0 legacy=0x7f7d70134d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 >> v1:172.21.15.45:6789/0 conn(0x7f7d700679e0 legacy=0x7f7d700aa340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5400af40 con 0x7f7d54005950 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5400b0b0 con 0x7f7d54008410 2023-06-23T01:21:39.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:39.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T01:21:39.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:39.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.662+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-23T01:21:39.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T01:21:39.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T01:21:39.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:39.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:39.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:39.866+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-23T01:21:40.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:40.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:40.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:40.270+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-06-23T01:21:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d759fb700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d759fb700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-23T01:21:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-06-23T01:21:41.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:41.074+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-06-23T01:21:41.957 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:41.950+0000 7f05400a3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T01:21:42.561 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:42.550+0000 7f05400a3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T01:21:42.618 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:42.610+0000 7f05400a3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T01:21:42.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 msgr2=0x7f7d5400a8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T01:21:42.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.192:3300/0 conn(0x7f7d54008410 0x7f7d5400a8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 msgr2=0x7f7d54007dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-23T01:21:42.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:42.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d700b17f0 con 0x7f7d700679e0 2023-06-23T01:21:42.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d54013350 con 0x7f7d70067db0 2023-06-23T01:21:42.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d677fe700 1 -- 172.21.15.45:0/396481215 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d5400af40 con 0x7f7d54005950 2023-06-23T01:21:42.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d761fc700 1 -- 172.21.15.45:0/396481215 reap_dead start 2023-06-23T01:21:42.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> v2:172.21.15.45:3300/0 conn(0x7f7d54005950 0x7f7d54007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:42.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d749f9700 1 -- 172.21.15.45:0/396481215 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809944935 0 0) 0x7f7d700b17f0 con 0x7f7d700679e0 2023-06-23T01:21:42.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.662+0000 7f7d749f9700 1 -- 172.21.15.45:0/396481215 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003570 con 0x7f7d700679e0 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v1:172.21.15.192:6789/0 conn(0x7f7d70067db0 legacy=0x7f7d54010be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 >> v1:172.21.15.45:6789/0 conn(0x7f7d700679e0 legacy=0x7f7d5400d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d751fa700 1 -- 172.21.15.45:0/396481215 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d54014560 con 0x7f7d54005950 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d751fa700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54005950 0x7f7d54007d60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007fd0 tx=0x7f7d6c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105ef958550caf87 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d749f9700 1 -- 172.21.15.45:0/396481215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c016490 con 0x7f7d54005950 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d749f9700 1 -- 172.21.15.45:0/396481215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0165f0 con 0x7f7d54005950 2023-06-23T01:21:42.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d749f9700 1 -- 172.21.15.45:0/396481215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0169b0 con 0x7f7d54005950 2023-06-23T01:21:42.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 -- 172.21.15.45:0/396481215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54005950 msgr2=0x7f7d54007d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54005950 0x7f7d54007d60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c007fd0 tx=0x7f7d6c009040 comp rx=0 tx=0).stop 2023-06-23T01:21:42.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 -- 172.21.15.45:0/396481215 shutdown_connections 2023-06-23T01:21:42.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/396481215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d54005950 0x7f7d54007d60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 -- 172.21.15.45:0/396481215 >> 172.21.15.45:0/396481215 conn(0x7f7d70066ed0 msgr2=0x7f7d700672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:42.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 -- 172.21.15.45:0/396481215 shutdown_connections 2023-06-23T01:21:42.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.666+0000 7f7d77c5f700 1 -- 172.21.15.45:0/396481215 wait complete. 2023-06-23T01:21:42.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 Processor -- start 2023-06-23T01:21:42.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 -- start start 2023-06-23T01:21:42.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:42.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 0x7f7d700ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:42.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 0x7f7d70155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:42.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700aef90 con 0x7f7d70067db0 2023-06-23T01:21:42.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70152070 con 0x7f7d700679e0 2023-06-23T01:21:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.670+0000 7f7d77c5f700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70152350 con 0x7f7d54005950 2023-06-23T01:21:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d761fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 0x7f7d70155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.45:38938/0 (socket says 172.21.15.45:38938) 2023-06-23T01:21:42.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d751fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 0x7f7d700ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d761fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 0x7f7d70155150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50456/0 (socket says 172.21.15.45:50456) 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 -- 172.21.15.45:0/3063013123 learned_addr learned my addr 172.21.15.45:0/3063013123 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 -- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 msgr2=0x7f7d700ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 0x7f7d700ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 -- 172.21.15.45:0/3063013123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 msgr2=0x7f7d70155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 0x7f7d70155150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 -- 172.21.15.45:0/3063013123 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c00f040 con 0x7f7d54005950 2023-06-23T01:21:42.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d751fa700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 0x7f7d700ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d759fb700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d600012b0 tx=0x7f7d60009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60001d30 con 0x7f7d54005950 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d60017460 con 0x7f7d54005950 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d70152630 con 0x7f7d54005950 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d600177e0 con 0x7f7d54005950 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d70151b70 con 0x7f7d54005950 2023-06-23T01:21:42.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7d60017bd0 con 0x7f7d54005950 2023-06-23T01:21:42.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7d60020e10 con 0x7f7d54005950 2023-06-23T01:21:42.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.674+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7004bc30 con 0x7f7d54005950 2023-06-23T01:21:42.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.682+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f7d6003f6e0 con 0x7f7d54005950 2023-06-23T01:21:42.729 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:42.722+0000 7f05400a3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T01:21:42.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.754+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7d70067790 con 0x7f7d54005950 2023-06-23T01:21:42.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.766+0000 7f7d65ffb700 1 -- 172.21.15.45:0/3063013123 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7d6002e020 con 0x7f7d54005950 2023-06-23T01:21:42.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 msgr2=0x7f7d7009a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:42.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7d600012b0 tx=0x7f7d60009040 comp rx=0 tx=0).stop 2023-06-23T01:21:42.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 shutdown_connections 2023-06-23T01:21:42.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d700679e0 0x7f7d700ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d70067db0 0x7f7d70155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 --2- 172.21.15.45:0/3063013123 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7d54005950 0x7f7d7009a340 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:42.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 >> 172.21.15.45:0/3063013123 conn(0x7f7d70066ed0 msgr2=0x7f7d7006f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:42.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 shutdown_connections 2023-06-23T01:21:42.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:42.770+0000 7f7d77c5f700 1 -- 172.21.15.45:0/3063013123 wait complete. 2023-06-23T01:21:42.778 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-06-23T01:21:42.790 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-23T01:21:42.790 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:42.791 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-23T01:21:42.805 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:42.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-23T01:21:42.818 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:42.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-23T01:21:42.835 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-06-23T01:21:42.836 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-23T01:21:42.847 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:42.842+0000 7f4ea7b6d000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-23T01:21:42.860 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:42.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-23T01:21:42.876 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:42.877 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-23T01:21:42.931 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:42.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-23T01:21:42.941 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2023-06-23T01:21:42.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-23T01:21:42.950 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:42.942+0000 7f05400a3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T01:21:42.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 522a6657-a991-46e3-b173-e7ecb177c97c 0 2023-06-23T01:21:42.998 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:42.990+0000 7f05400a3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T01:21:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 Processor -- start 2023-06-23T01:21:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 -- start start 2023-06-23T01:21:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faac814a4c0 0x7faac814c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac80967f0 con 0x7faac80b5e10 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac8095e80 con 0x7faac814a4c0 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faace096700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac80aff70 con 0x7faac80b61e0 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54710/0 (socket says 172.21.15.192:54710) 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 -- 172.21.15.192:0/4254593593 learned_addr learned my addr 172.21.15.192:0/4254593593 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacd895700 1 --2- 172.21.15.192:0/4254593593 >> v2:172.21.15.45:3300/0 conn(0x7faac814a4c0 0x7faac814c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 -- 172.21.15.192:0/4254593593 >> v2:172.21.15.45:3300/0 conn(0x7faac814a4c0 msgr2=0x7faac814c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 --2- 172.21.15.192:0/4254593593 >> v2:172.21.15.45:3300/0 conn(0x7faac814a4c0 0x7faac814c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 -- 172.21.15.192:0/4254593593 >> v1:172.21.15.45:6789/0 conn(0x7faac80b5e10 legacy=0x7faac8096c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 -- 172.21.15.192:0/4254593593 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8096080 con 0x7faac80b61e0 2023-06-23T01:21:43.102 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faacc893700 1 --2- 172.21.15.192:0/4254593593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faab80099b0 tx=0x7faab8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c3ed903b339e0e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.103 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faabffff700 1 -- 172.21.15.192:0/4254593593 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800b820 con 0x7faac80b61e0 2023-06-23T01:21:43.103 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faabffff700 1 -- 172.21.15.192:0/4254593593 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab800b980 con 0x7faac80b61e0 2023-06-23T01:21:43.103 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.090+0000 7faabffff700 1 -- 172.21.15.192:0/4254593593 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab800bd20 con 0x7faac80b61e0 2023-06-23T01:21:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/4254593593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 msgr2=0x7faac8149f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- 172.21.15.192:0/4254593593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faab80099b0 tx=0x7faab8009250 comp rx=0 tx=0).stop 2023-06-23T01:21:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/4254593593 shutdown_connections 2023-06-23T01:21:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- 172.21.15.192:0/4254593593 >> v2:172.21.15.45:3300/0 conn(0x7faac814a4c0 0x7faac814c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.107 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- 172.21.15.192:0/4254593593 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b61e0 0x7faac8149f80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/4254593593 >> 172.21.15.192:0/4254593593 conn(0x7faac8068a50 msgr2=0x7faac80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/4254593593 shutdown_connections 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/4254593593 wait complete. 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 Processor -- start 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- start start 2023-06-23T01:21:43.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 0x7faac8154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac80b61e0 0x7faac8098f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8098640 con 0x7faac80b61e0 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac809a950 con 0x7faac814a4c0 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac809ab50 con 0x7faac80b5e10 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.109 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd094700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 0x7faac8154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.110 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44498/0 (socket says 172.21.15.192:44498) 2023-06-23T01:21:43.110 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 -- 172.21.15.192:0/1552751200 learned_addr learned my addr 172.21.15.192:0/1552751200 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.110 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacc893700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac80b61e0 0x7faac8098f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.110 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 -- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 msgr2=0x7faac8154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.110 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 0x7faac8154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 -- 172.21.15.192:0/1552751200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac80b61e0 msgr2=0x7faac8098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac80b61e0 0x7faac8098f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 -- 172.21.15.192:0/1552751200 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab80094f0 con 0x7faac814a4c0 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd094700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 0x7faac8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faacd895700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faac000ce80 tx=0x7faac0007840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.111 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000acc0 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000ae20 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac81554e0 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.094+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0016680 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.098+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac8099b60 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.098+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7faac0003020 con 0x7faac814a4c0 2023-06-23T01:21:43.112 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.098+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7faac0012070 con 0x7faac814a4c0 2023-06-23T01:21:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.098+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac8098780 con 0x7faac814a4c0 2023-06-23T01:21:43.113 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.102+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7faac8098780 con 0x7faac814a4c0 2023-06-23T01:21:43.180 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:43.170+0000 7f05400a3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T01:21:43.183 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.174+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "522a6657-a991-46e3-b173-e7ecb177c97c", "id": 0} v 0) v1 -- 0x7faac8068e50 con 0x7faac814a4c0 2023-06-23T01:21:43.192 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faabd7fa700 1 -- 172.21.15.192:0/1552751200 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "522a6657-a991-46e3-b173-e7ecb177c97c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7faac0020440 con 0x7faac814a4c0 2023-06-23T01:21:43.193 INFO:teuthology.orchestra.run.smithi192.stdout:0 2023-06-23T01:21:43.195 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 msgr2=0x7faac80ab3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.195 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7faac000ce80 tx=0x7faac0007840 comp rx=0 tx=0).stop 2023-06-23T01:21:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 shutdown_connections 2023-06-23T01:21:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faac814a4c0 0x7faac80ab3f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faac80b61e0 0x7faac8098f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 --2- 172.21.15.192:0/1552751200 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7faac80b5e10 0x7faac8154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 >> 172.21.15.192:0/1552751200 conn(0x7faac8068a50 msgr2=0x7faac80b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 shutdown_connections 2023-06-23T01:21:43.201 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.182+0000 7faace096700 1 -- 172.21.15.192:0/1552751200 wait complete. 2023-06-23T01:21:43.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 30e0cce7-2a93-440f-9d12-5a968dc97f77 1 2023-06-23T01:21:43.241 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:43.230+0000 7f05400a3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T01:21:43.303 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:43.294+0000 7f05400a3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T01:21:43.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 Processor -- start 2023-06-23T01:21:43.307 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 -- start start 2023-06-23T01:21:43.308 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310006f930 0x7f3100067ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.308 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.308 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3100069c60 con 0x7f3100143d50 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310006a550 con 0x7f310006f930 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f310492e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31000ac5a0 con 0x7f310006a0f0 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310006f930 0x7f3100067ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30feffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310006f930 0x7f3100067ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44504/0 (socket says 172.21.15.192:44504) 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30feffd700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:54738/0 (socket says 172.21.15.192:54738) 2023-06-23T01:21:43.309 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 -- 172.21.15.192:0/799085112 learned_addr learned my addr 172.21.15.192:0/799085112 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 -- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 msgr2=0x7f31000acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:43.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 -- 172.21.15.192:0/799085112 >> v1:172.21.15.45:6789/0 conn(0x7f3100143d50 legacy=0x7f31000b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.311 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30ff7fe700 1 -- 172.21.15.192:0/799085112 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100069610 con 0x7f310006f930 2023-06-23T01:21:43.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.298+0000 7f30feffd700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:43.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30ff7fe700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100067ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30f00099b0 tx=0x7f30f0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad1cd34dcaa3d24 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.312 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30fe7fc700 1 -- 172.21.15.192:0/799085112 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f0009ea0 con 0x7f310006f930 2023-06-23T01:21:43.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30fe7fc700 1 -- 172.21.15.192:0/799085112 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f000b860 con 0x7f310006f930 2023-06-23T01:21:43.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30fe7fc700 1 -- 172.21.15.192:0/799085112 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f000bc00 con 0x7f310006f930 2023-06-23T01:21:43.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 msgr2=0x7f3100067ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100067ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f30f00099b0 tx=0x7f30f0009250 comp rx=0 tx=0).stop 2023-06-23T01:21:43.313 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- 172.21.15.192:0/799085112 shutdown_connections 2023-06-23T01:21:43.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f310006a0f0 0x7f31000acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- 172.21.15.192:0/799085112 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100067ff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- 172.21.15.192:0/799085112 >> 172.21.15.192:0/799085112 conn(0x7f3100066ed0 msgr2=0x7f31000672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.314 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- 172.21.15.192:0/799085112 shutdown_connections 2023-06-23T01:21:43.315 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- 172.21.15.192:0/799085112 wait complete. 2023-06-23T01:21:43.320 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 Processor -- start 2023-06-23T01:21:43.320 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- start start 2023-06-23T01:21:43.321 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f310006a0f0 0x7f31000ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.321 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.321 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3100143d50 0x7f3100098320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.321 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310009a5e0 con 0x7f310006a0f0 2023-06-23T01:21:43.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3100097950 con 0x7f310006f930 2023-06-23T01:21:43.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f310492e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3100099300 con 0x7f3100143d50 2023-06-23T01:21:43.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30feffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30feffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44520/0 (socket says 172.21.15.192:44520) 2023-06-23T01:21:43.322 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30feffd700 1 -- 172.21.15.192:0/6020626 learned_addr learned my addr 172.21.15.192:0/6020626 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30fffff700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3100143d50 0x7f3100098320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.302+0000 7f30ff7fe700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f310006a0f0 0x7f31000ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 -- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3100143d50 msgr2=0x7f3100098320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3100143d50 0x7f3100098320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 -- 172.21.15.192:0/6020626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f310006a0f0 msgr2=0x7f31000ab940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f310006a0f0 0x7f31000ab940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 -- 172.21.15.192:0/6020626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f4009420 con 0x7f310006f930 2023-06-23T01:21:43.324 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30feffd700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f400ec80 tx=0x7f30f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.325 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400c850 con 0x7f310006f930 2023-06-23T01:21:43.325 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f400c9b0 con 0x7f310006f930 2023-06-23T01:21:43.325 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f00094f0 con 0x7f310006f930 2023-06-23T01:21:43.325 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30f400cd30 con 0x7f310006f930 2023-06-23T01:21:43.326 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31000a82b0 con 0x7f310006f930 2023-06-23T01:21:43.326 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f30f4005c80 con 0x7f310006f930 2023-06-23T01:21:43.326 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f30f40063e0 con 0x7f310006f930 2023-06-23T01:21:43.326 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.306+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3100099780 con 0x7f310006f930 2023-06-23T01:21:43.326 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.310+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f30f4021060 con 0x7f310006f930 2023-06-23T01:21:43.393 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.382+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30e0cce7-2a93-440f-9d12-5a968dc97f77", "id": 1} v 0) v1 -- 0x7f310004b3f0 con 0x7f310006f930 2023-06-23T01:21:43.400 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.390+0000 7f30e77fe700 1 -- 172.21.15.192:0/6020626 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30e0cce7-2a93-440f-9d12-5a968dc97f77", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f30f4017070 con 0x7f310006f930 2023-06-23T01:21:43.400 INFO:teuthology.orchestra.run.smithi192.stdout:1 2023-06-23T01:21:43.401 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 msgr2=0x7f3100097de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.401 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f30f400ec80 tx=0x7f30f40091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.401 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 shutdown_connections 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310006f930 0x7f3100097de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f3100143d50 0x7f3100098320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 --2- 172.21.15.192:0/6020626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f310006a0f0 0x7f31000ab940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 >> 172.21.15.192:0/6020626 conn(0x7f3100066ed0 msgr2=0x7f3100140580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 shutdown_connections 2023-06-23T01:21:43.402 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.394+0000 7f310492e700 1 -- 172.21.15.192:0/6020626 wait complete. 2023-06-23T01:21:43.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new e882fecf-a714-4ad5-9720-5fcbdf959235 2 2023-06-23T01:21:43.484 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:43.478+0000 7f4ea7b6d000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-23T01:21:43.542 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:43.538+0000 7f4ea7b6d000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-23T01:21:43.573 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.562+0000 7f586f34c700 1 Processor -- start 2023-06-23T01:21:43.573 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.562+0000 7f586f34c700 1 -- start start 2023-06-23T01:21:43.587 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f586806c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586806aad0 con 0x7f58680b0d40 2023-06-23T01:21:43.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58680a8ad0 con 0x7f586806cc90 2023-06-23T01:21:43.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586806e0e0 con 0x7f586806f9c0 2023-06-23T01:21:43.588 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586db49700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f586806c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586db49700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54784/0 (socket says 172.21.15.192:54784) 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586db49700 1 -- 172.21.15.192:0/659930179 learned_addr learned my addr 172.21.15.192:0/659930179 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 -- 172.21.15.192:0/659930179 >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 msgr2=0x7f58680b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 --2- 172.21.15.192:0/659930179 >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 -- 172.21.15.192:0/659930179 >> v1:172.21.15.45:6789/0 conn(0x7f58680b0d40 legacy=0x7f58681426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.589 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 -- 172.21.15.192:0/659930179 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586806d0e0 con 0x7f586806f9c0 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586db49700 1 --2- 172.21.15.192:0/659930179 >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586e34a700 1 --2- 172.21.15.192:0/659930179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f586806c750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f586400bb90 tx=0x7f586400b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6505a6a117e83d68 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586d348700 1 -- 172.21.15.192:0/659930179 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586400db40 con 0x7f586806f9c0 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586d348700 1 -- 172.21.15.192:0/659930179 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586400dca0 con 0x7f586806f9c0 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586d348700 1 -- 172.21.15.192:0/659930179 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58640196b0 con 0x7f586806f9c0 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- 172.21.15.192:0/659930179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 msgr2=0x7f586806c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.590 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 --2- 172.21.15.192:0/659930179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f586806c750 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f586400bb90 tx=0x7f586400b430 comp rx=0 tx=0).stop 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- 172.21.15.192:0/659930179 shutdown_connections 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 --2- 172.21.15.192:0/659930179 >> v2:172.21.15.192:3300/0 conn(0x7f586806cc90 0x7f58680b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 --2- 172.21.15.192:0/659930179 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f586806c750 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- 172.21.15.192:0/659930179 >> 172.21.15.192:0/659930179 conn(0x7f5868066ed0 msgr2=0x7f58680672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- 172.21.15.192:0/659930179 shutdown_connections 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.566+0000 7f586f34c700 1 -- 172.21.15.192:0/659930179 wait complete. 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 Processor -- start 2023-06-23T01:21:43.591 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 -- start start 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f5868141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58680b0d40 0x7f58681424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868141260 con 0x7f58680b0d40 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5868141ae0 con 0x7f586806cc90 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586f34c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586813b380 con 0x7f586806f9c0 2023-06-23T01:21:43.592 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586db49700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f5868141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54786/0 (socket says 172.21.15.192:54786) 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 -- 172.21.15.192:0/3384456970 learned_addr learned my addr 172.21.15.192:0/3384456970 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586eb4b700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58680b0d40 0x7f58681424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 -- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 msgr2=0x7f5868141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f5868141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.593 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 -- 172.21.15.192:0/3384456970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58680b0d40 msgr2=0x7f58681424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58680b0d40 0x7f58681424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 -- 172.21.15.192:0/3384456970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580094f0 con 0x7f586806cc90 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.570+0000 7f586e34a700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f586400b2c0 tx=0x7f586401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864019680 con 0x7f586806cc90 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5864010680 con 0x7f586806cc90 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586400b6d0 con 0x7f586806cc90 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5864010a40 con 0x7f586806cc90 2023-06-23T01:21:43.594 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5868141770 con 0x7f586806cc90 2023-06-23T01:21:43.595 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5864023070 con 0x7f586806cc90 2023-06-23T01:21:43.595 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f5864014070 con 0x7f586806cc90 2023-06-23T01:21:43.595 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.574+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586806b660 con 0x7f586806cc90 2023-06-23T01:21:43.595 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.578+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f586402a070 con 0x7f586806cc90 2023-06-23T01:21:43.661 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:43.654+0000 7f4ea7b6d000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-23T01:21:43.661 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.650+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e882fecf-a714-4ad5-9720-5fcbdf959235", "id": 2} v 0) v1 -- 0x7f586804b3f0 con 0x7f586806cc90 2023-06-23T01:21:43.669 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f585e7fc700 1 -- 172.21.15.192:0/3384456970 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e882fecf-a714-4ad5-9720-5fcbdf959235", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5864006bc0 con 0x7f586806cc90 2023-06-23T01:21:43.669 INFO:teuthology.orchestra.run.smithi192.stdout:2 2023-06-23T01:21:43.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 msgr2=0x7f5868151500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f586400b2c0 tx=0x7f586401b000 comp rx=0 tx=0).stop 2023-06-23T01:21:43.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 shutdown_connections 2023-06-23T01:21:43.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58680b0d40 0x7f58681424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.674 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f586806f9c0 0x7f5868141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.675 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 --2- 172.21.15.192:0/3384456970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f586806cc90 0x7f5868151500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.675 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 >> 172.21.15.192:0/3384456970 conn(0x7f5868066ed0 msgr2=0x7f5868139f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.675 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 shutdown_connections 2023-06-23T01:21:43.675 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.658+0000 7f586f34c700 1 -- 172.21.15.192:0/3384456970 wait complete. 2023-06-23T01:21:43.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 594d4863-9863-4c31-9294-db1a72be1ae3 3 2023-06-23T01:21:43.719 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:43.710+0000 7f05400a3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T01:21:43.784 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.774+0000 7f499ad8b700 1 Processor -- start 2023-06-23T01:21:43.784 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.774+0000 7f499ad8b700 1 -- start start 2023-06-23T01:21:43.785 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.774+0000 7f499ad8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 0x7f49940b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.785 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.774+0000 7f499ad8b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499406b260 con 0x7f49940b2970 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499406add0 con 0x7f499413cfc0 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49940b11a0 con 0x7f49940b2d40 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4999328700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f499413cfc0 0x7f499413d420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52310/0 (socket says 172.21.15.192:52310) 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4999328700 1 -- 172.21.15.192:0/1843627680 learned_addr learned my addr 172.21.15.192:0/1843627680 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4993fff700 1 --2- 172.21.15.192:0/1843627680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 0x7f49940b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869030200 0 0) 0x7f499406add0 con 0x7f499413cfc0 2023-06-23T01:21:43.786 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4984003570 con 0x7f499413cfc0 2023-06-23T01:21:43.787 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4993fff700 1 -- 172.21.15.192:0/1843627680 >> v1:172.21.15.192:6789/0 conn(0x7f499413cfc0 legacy=0x7f499413d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.791 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659036966 0 0) 0x7f4988001110 con 0x7f49940b2970 2023-06-23T01:21:43.791 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4993fff700 1 -- 172.21.15.192:0/1843627680 >> v1:172.21.15.45:6789/0 conn(0x7f49940b2970 legacy=0x7f49941438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.791 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4993fff700 1 -- 172.21.15.192:0/1843627680 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940b1c70 con 0x7f49940b2d40 2023-06-23T01:21:43.791 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f4993fff700 1 --2- 172.21.15.192:0/1843627680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 0x7f49940b0a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4980009910 tx=0x7f49800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48fb67c3bec65a78 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.791 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000b680 con 0x7f49940b2d40 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000b7e0 con 0x7f49940b2d40 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f49937fe700 1 -- 172.21.15.192:0/1843627680 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000bba0 con 0x7f49940b2d40 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- 172.21.15.192:0/1843627680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 msgr2=0x7f49940b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1843627680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 0x7f49940b0a40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4980009910 tx=0x7f49800091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- 172.21.15.192:0/1843627680 shutdown_connections 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1843627680 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2d40 0x7f49940b0a40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.792 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- 172.21.15.192:0/1843627680 >> 172.21.15.192:0/1843627680 conn(0x7f49940b6230 msgr2=0x7f49940b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- 172.21.15.192:0/1843627680 shutdown_connections 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- 172.21.15.192:0/1843627680 wait complete. 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 Processor -- start 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.778+0000 7f499ad8b700 1 -- start start 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 0x7f49940972d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.793 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f499413cfc0 0x7f49940ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940af560 con 0x7f499413cfc0 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49940adda0 con 0x7f49940b2d40 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499413e380 con 0x7f49940b2970 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4993fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 0x7f49940972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:45428/0 (socket says 172.21.15.192:45428) 2023-06-23T01:21:43.794 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4993fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 0x7f49940972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54792/0 (socket says 172.21.15.192:54792) 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 -- 172.21.15.192:0/1208033362 learned_addr learned my addr 172.21.15.192:0/1208033362 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4999328700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f499413cfc0 0x7f49940ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 -- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 msgr2=0x7f49940972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 0x7f49940972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 -- 172.21.15.192:0/1208033362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f499413cfc0 msgr2=0x7f49940ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f499413cfc0 0x7f49940ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.795 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 -- 172.21.15.192:0/1208033362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4980009420 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4998b27700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f498800c560 tx=0x7f498800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988011590 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4988011710 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4994096a00 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988011ad0 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49940adae0 con 0x7f49940b2970 2023-06-23T01:21:43.796 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f498801c6c0 con 0x7f49940b2970 2023-06-23T01:21:43.797 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f49880128c0 con 0x7f49940b2970 2023-06-23T01:21:43.797 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.782+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499404bc30 con 0x7f49940b2970 2023-06-23T01:21:43.797 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.786+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f4988017070 con 0x7f49940b2970 2023-06-23T01:21:43.875 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:43.866+0000 7f05400a3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T01:21:43.898 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.890+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "594d4863-9863-4c31-9294-db1a72be1ae3", "id": 3} v 0) v1 -- 0x7f4994098350 con 0x7f49940b2970 2023-06-23T01:21:43.906 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f4990ff9700 1 -- 172.21.15.192:0/1208033362 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "594d4863-9863-4c31-9294-db1a72be1ae3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f499406b260 con 0x7f49940b2970 2023-06-23T01:21:43.906 INFO:teuthology.orchestra.run.smithi192.stdout:3 2023-06-23T01:21:43.907 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 msgr2=0x7f4994096d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:43.907 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f498800c560 tx=0x7f498800c870 comp rx=0 tx=0).stop 2023-06-23T01:21:43.907 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 shutdown_connections 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49940b2d40 0x7f49940972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f499413cfc0 0x7f49940ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 --2- 172.21.15.192:0/1208033362 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f49940b2970 0x7f4994096d90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 >> 172.21.15.192:0/1208033362 conn(0x7f49940b6230 msgr2=0x7f4994067560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 shutdown_connections 2023-06-23T01:21:43.908 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:43.898+0000 7f499ad8b700 1 -- 172.21.15.192:0/1208033362 wait complete. 2023-06-23T01:21:43.909 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:43.902+0000 7f4ea7b6d000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-23T01:21:43.919 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 8eb32754-7d27-4e13-98b7-78fe3f88fc5d 4 2023-06-23T01:21:43.962 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:43.958+0000 7f4ea7b6d000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-23T01:21:44.028 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 Processor -- start 2023-06-23T01:21:44.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 -- start start 2023-06-23T01:21:44.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f241c06f120 0x7f241c13bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c097150 con 0x7f241c0b61e0 2023-06-23T01:21:44.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c0b0e00 con 0x7f241c0b5e10 2023-06-23T01:21:44.029 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f242162c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c0964e0 con 0x7f241c06f120 2023-06-23T01:21:44.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241bfff700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f241c0b5e10 0x7f241c0978c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52322/0 (socket says 172.21.15.192:52322) 2023-06-23T01:21:44.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241bfff700 1 -- 172.21.15.192:0/1310103578 learned_addr learned my addr 172.21.15.192:0/1310103578 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-06-23T01:21:44.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f24137fe700 1 --2- 172.21.15.192:0/1310103578 >> v2:172.21.15.45:3300/0 conn(0x7f241c06f120 0x7f241c13bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.030 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948245381 0 0) 0x7f241c0b0e00 con 0x7f241c0b5e10 2023-06-23T01:21:44.031 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2408003570 con 0x7f241c0b5e10 2023-06-23T01:21:44.031 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2093852443 0 0) 0x7f2408003570 con 0x7f241c0b5e10 2023-06-23T01:21:44.031 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 >> v2:172.21.15.45:3300/0 conn(0x7f241c06f120 msgr2=0x7f241c13bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.031 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 --2- 172.21.15.192:0/1310103578 >> v2:172.21.15.45:3300/0 conn(0x7f241c06f120 0x7f241c13bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.031 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 >> v1:172.21.15.45:6789/0 conn(0x7f241c0b61e0 legacy=0x7f241c13c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.032 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c097430 con 0x7f241c0b5e10 2023-06-23T01:21:44.033 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f240c001470 con 0x7f241c0b5e10 2023-06-23T01:21:44.033 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 >> v1:172.21.15.192:6789/0 conn(0x7f241c0b5e10 legacy=0x7f241c0978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.033 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2408003a60 0x7f2408003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2408004810 0x7f2408004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f240800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0964e0 con 0x7f2408004810 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240800c2a0 con 0x7f2408003a60 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240800c460 con 0x7f24080052e0 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f241bfff700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2408003a60 0x7f2408003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f240800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.034 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f24137fe700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2408004810 0x7f2408004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 -- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2408003a60 msgr2=0x7f2408003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2408003a60 0x7f2408003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 -- 172.21.15.192:0/1310103578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2408004810 msgr2=0x7f2408004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2408004810 0x7f2408004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 -- 172.21.15.192:0/1310103578 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408003570 con 0x7f24080052e0 2023-06-23T01:21:44.035 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.018+0000 7f2420e2b700 1 -- 172.21.15.192:0/1310103578 reap_dead start 2023-06-23T01:21:44.039 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2420e2b700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f240800ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f241c06f580 tx=0x7f2414001640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4e503ce3b29300f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.039 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400c700 con 0x7f24080052e0 2023-06-23T01:21:44.039 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400c860 con 0x7f24080052e0 2023-06-23T01:21:44.039 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241b7fe700 1 -- 172.21.15.192:0/1310103578 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400cc20 con 0x7f24080052e0 2023-06-23T01:21:44.039 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 msgr2=0x7f240800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f240800ba60 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f241c06f580 tx=0x7f2414001640 comp rx=0 tx=0).stop 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/1310103578 shutdown_connections 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 --2- 172.21.15.192:0/1310103578 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f240800ba60 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/1310103578 >> 172.21.15.192:0/1310103578 conn(0x7f241c068a50 msgr2=0x7f241c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/1310103578 shutdown_connections 2023-06-23T01:21:44.040 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/1310103578 wait complete. 2023-06-23T01:21:44.041 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 Processor -- start 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- start start 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 0x7f241c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c13c910 0x7f241c0abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c09b680 con 0x7f241c13c910 2023-06-23T01:21:44.042 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c152330 con 0x7f241c13c4a0 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c0985d0 con 0x7f24080052e0 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:45442/0 (socket says 172.21.15.192:45442) 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 -- 172.21.15.192:0/2975401379 learned_addr learned my addr 172.21.15.192:0/2975401379 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f24137fe700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 0x7f241c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2420e2b700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c13c910 0x7f241c0abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.043 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 -- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 msgr2=0x7f241c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 0x7f241c152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 -- 172.21.15.192:0/2975401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c13c910 msgr2=0x7f241c0abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c13c910 0x7f241c0abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 -- 172.21.15.192:0/2975401379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c14a390 con 0x7f24080052e0 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f24137fe700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 0x7f241c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f241bfff700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f240c007390 tx=0x7f240c001e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c018030 con 0x7f24080052e0 2023-06-23T01:21:44.044 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c00f8d0 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f241c09b3a0 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c00fc90 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c0b34e0 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f240c01b070 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.022+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f240c019070 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.026+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c0b36d0 con 0x7f24080052e0 2023-06-23T01:21:44.045 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.026+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f241c0b36d0 con 0x7f24080052e0 2023-06-23T01:21:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.098+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8eb32754-7d27-4e13-98b7-78fe3f88fc5d", "id": 4} v 0) v1 -- 0x7f241c068e50 con 0x7f24080052e0 2023-06-23T01:21:44.118 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f2418ff9700 1 -- 172.21.15.192:0/2975401379 <== mon.2 v2:172.21.15.192:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8eb32754-7d27-4e13-98b7-78fe3f88fc5d", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f240c02d0b0 con 0x7f24080052e0 2023-06-23T01:21:44.118 INFO:teuthology.orchestra.run.smithi192.stdout:4 2023-06-23T01:21:44.119 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 msgr2=0x7f241c09acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.119 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f240c007390 tx=0x7f240c001e50 comp rx=0 tx=0).stop 2023-06-23T01:21:44.119 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 shutdown_connections 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f241c13c4a0 0x7f241c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c13c910 0x7f241c0abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 --2- 172.21.15.192:0/2975401379 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f24080052e0 0x7f241c09acd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 >> 172.21.15.192:0/2975401379 conn(0x7f241c068a50 msgr2=0x7f241c066ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 shutdown_connections 2023-06-23T01:21:44.120 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.106+0000 7f242162c700 1 -- 172.21.15.192:0/2975401379 wait complete. 2023-06-23T01:21:44.134 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 4749ac2b-5d6e-42e4-ab64-dad1c8c14177 5 2023-06-23T01:21:44.156 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:44.150+0000 7f4ea7b6d000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-23T01:21:44.197 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.190+0000 7f05400a3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T01:21:44.225 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:44.218+0000 7f4ea7b6d000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-23T01:21:44.235 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 Processor -- start 2023-06-23T01:21:44.235 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 -- start start 2023-06-23T01:21:44.239 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb580067ff0 0x7fb58006a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.239 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5800acd10 0x7fb58014a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.239 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb580069c60 con 0x7fb58006f930 2023-06-23T01:21:44.240 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb580068450 con 0x7fb580067ff0 2023-06-23T01:21:44.240 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.226+0000 7fb584beb700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5800ad150 con 0x7fb5800acd10 2023-06-23T01:21:44.240 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5800acd10 0x7fb58014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.240 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb5800acd10 0x7fb58014a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54822/0 (socket says 172.21.15.192:54822) 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 -- 172.21.15.192:0/712117667 learned_addr learned my addr 172.21.15.192:0/712117667 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57effd700 1 --2- 172.21.15.192:0/712117667 >> v2:172.21.15.45:3300/0 conn(0x7fb580067ff0 0x7fb58006a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 -- 172.21.15.192:0/712117667 >> v2:172.21.15.45:3300/0 conn(0x7fb580067ff0 msgr2=0x7fb58006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 --2- 172.21.15.192:0/712117667 >> v2:172.21.15.45:3300/0 conn(0x7fb580067ff0 0x7fb58006a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 -- 172.21.15.192:0/712117667 >> v1:172.21.15.192:6789/0 conn(0x7fb58006f930 legacy=0x7fb580143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 -- 172.21.15.192:0/712117667 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800ac5a0 con 0x7fb5800acd10 2023-06-23T01:21:44.241 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57ffff700 1 --2- 172.21.15.192:0/712117667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5800acd10 0x7fb58014a910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb580069bd0 tx=0x7fb578009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=996fa077f964339e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57e7fc700 1 -- 172.21.15.192:0/712117667 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800e070 con 0x7fb5800acd10 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57e7fc700 1 -- 172.21.15.192:0/712117667 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57800ba20 con 0x7fb5800acd10 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb57e7fc700 1 -- 172.21.15.192:0/712117667 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5780092e0 con 0x7fb5800acd10 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 -- 172.21.15.192:0/712117667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5800acd10 msgr2=0x7fb58014a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 --2- 172.21.15.192:0/712117667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5800acd10 0x7fb58014a910 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb580069bd0 tx=0x7fb578009840 comp rx=0 tx=0).stop 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 -- 172.21.15.192:0/712117667 shutdown_connections 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 --2- 172.21.15.192:0/712117667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb5800acd10 0x7fb58014a910 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 --2- 172.21.15.192:0/712117667 >> v2:172.21.15.45:3300/0 conn(0x7fb580067ff0 0x7fb58006a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 -- 172.21.15.192:0/712117667 >> 172.21.15.192:0/712117667 conn(0x7fb580066ed0 msgr2=0x7fb5800672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 -- 172.21.15.192:0/712117667 shutdown_connections 2023-06-23T01:21:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.230+0000 7fb584beb700 1 -- 172.21.15.192:0/712117667 wait complete. 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 Processor -- start 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 -- start start 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 0x7fb580153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 0x7fb580099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580142850 con 0x7fb580067ff0 2023-06-23T01:21:44.245 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb580097e00 con 0x7fb58006f930 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb584beb700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58009a920 con 0x7fb5800acd10 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 0x7fb580099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57ffff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.192:45452/0 (socket says 172.21.15.192:45452) 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57ffff700 1 -- 172.21.15.192:0/888762913 learned_addr learned my addr 172.21.15.192:0/888762913 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57f7fe700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 0x7fb580153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.246 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 -- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 msgr2=0x7fb580099860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 -- 172.21.15.192:0/888762913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 msgr2=0x7fb580153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 0x7fb580153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 -- 172.21.15.192:0/888762913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009ae0 con 0x7fb58006f930 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57ffff700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57f7fe700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 0x7fb580153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:44.247 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb57effd700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 0x7fb580099320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ea80 tx=0x7fb5680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.234+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5680095d0 con 0x7fb58006f930 2023-06-23T01:21:44.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800c7f0 con 0x7fb58006f930 2023-06-23T01:21:44.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58009a640 con 0x7fb58006f930 2023-06-23T01:21:44.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800cbb0 con 0x7fb58006f930 2023-06-23T01:21:44.248 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb580097160 con 0x7fb58006f930 2023-06-23T01:21:44.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb5680136f0 con 0x7fb58006f930 2023-06-23T01:21:44.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fb56801c5e0 con 0x7fb58006f930 2023-06-23T01:21:44.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58006b660 con 0x7fb58006f930 2023-06-23T01:21:44.249 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.238+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fb56803b6e0 con 0x7fb58006f930 2023-06-23T01:21:44.293 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:44.286+0000 7f4ea7b6d000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-23T01:21:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.314+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4749ac2b-5d6e-42e4-ab64-dad1c8c14177", "id": 5} v 0) v1 -- 0x7fb5801434a0 con 0x7fb58006f930 2023-06-23T01:21:44.330 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb5777fe700 1 -- 172.21.15.192:0/888762913 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4749ac2b-5d6e-42e4-ab64-dad1c8c14177", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb56802a020 con 0x7fb58006f930 2023-06-23T01:21:44.331 INFO:teuthology.orchestra.run.smithi192.stdout:5 2023-06-23T01:21:44.332 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 msgr2=0x7fb580099320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 0x7fb580099320 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ea80 tx=0x7fb5680091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 shutdown_connections 2023-06-23T01:21:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb58006f930 0x7fb580099320 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fb5800acd10 0x7fb580099860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 --2- 172.21.15.192:0/888762913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb580067ff0 0x7fb580153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.334 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 >> 172.21.15.192:0/888762913 conn(0x7fb580066ed0 msgr2=0x7fb580143b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.334 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 shutdown_connections 2023-06-23T01:21:44.335 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.322+0000 7fb584beb700 1 -- 172.21.15.192:0/888762913 wait complete. 2023-06-23T01:21:44.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 6665b039-4317-4d37-9822-a048a83c99ed 6 2023-06-23T01:21:44.365 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.354+0000 7f05400a3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T01:21:44.432 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.422+0000 7f05400a3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T01:21:44.436 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.426+0000 7fbdebfff700 1 Processor -- start 2023-06-23T01:21:44.437 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.426+0000 7fbdebfff700 1 -- start start 2023-06-23T01:21:44.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbdec06ef30 0x7fbdec0ae5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec0b20b0 con 0x7fbdec0aeb30 2023-06-23T01:21:44.440 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdec06e870 con 0x7fbdec0b3690 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdec0b1a80 con 0x7fbdec06ef30 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeb7fe700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbdec0b3690 0x7fbdec06e160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52336/0 (socket says 172.21.15.192:52336) 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeb7fe700 1 -- 172.21.15.192:0/59764713 learned_addr learned my addr 172.21.15.192:0/59764713 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/59764713 >> v2:172.21.15.45:3300/0 conn(0x7fbdec06ef30 0x7fbdec0ae5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763998557 0 0) 0x7fbdec06e870 con 0x7fbdec0b3690 2023-06-23T01:21:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdd4003570 con 0x7fbdec0b3690 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2612739405 0 0) 0x7fbdd4003570 con 0x7fbdec0b3690 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 >> v2:172.21.15.45:3300/0 conn(0x7fbdec06ef30 msgr2=0x7fbdec0ae5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 --2- 172.21.15.192:0/59764713 >> v2:172.21.15.45:3300/0 conn(0x7fbdec06ef30 0x7fbdec0ae5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 >> v1:172.21.15.45:6789/0 conn(0x7fbdec0aeb30 legacy=0x7fbdec06da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0ade80 con 0x7fbdec0b3690 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7fbde40017f0 con 0x7fbdec0b3690 2023-06-23T01:21:44.442 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 >> v1:172.21.15.192:6789/0 conn(0x7fbdec0b3690 legacy=0x7fbdec06e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.443 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdd4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.443 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd4004810 0x7fbdd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd40051c0 0x7fbdd400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0b1a80 con 0x7fbdd4004810 2023-06-23T01:21:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd400c050 con 0x7fbdd4003a60 2023-06-23T01:21:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdd400c210 con 0x7fbdd40051c0 2023-06-23T01:21:44.447 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdd4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.447 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeb7fe700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd40051c0 0x7fbdd400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.447 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdea7fc700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd4004810 0x7fbdd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.447 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 -- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd40051c0 msgr2=0x7fbdd400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.447 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd40051c0 0x7fbdd400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.448 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 -- 172.21.15.192:0/59764713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd4004810 msgr2=0x7fbdd4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.448 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdd4004810 0x7fbdd4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.448 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 -- 172.21.15.192:0/59764713 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd4003570 con 0x7fbdd4003a60 2023-06-23T01:21:44.448 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeb7fe700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdd40051c0 0x7fbdd400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:44.449 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeb7fe700 1 -- 172.21.15.192:0/59764713 reap_dead start 2023-06-23T01:21:44.449 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdd4003e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009c30 tx=0x7fbddc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e485ea031578ea69 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.449 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc0095b0 con 0x7fbdd4003a60 2023-06-23T01:21:44.449 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00e710 con 0x7fbdd4003a60 2023-06-23T01:21:44.450 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbde9ffb700 1 -- 172.21.15.192:0/59764713 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc00ead0 con 0x7fbdd4003a60 2023-06-23T01:21:44.453 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 msgr2=0x7fbdd4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.453 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdd4003e30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbddc009c30 tx=0x7fbddc0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.455 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- 172.21.15.192:0/59764713 shutdown_connections 2023-06-23T01:21:44.455 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 --2- 172.21.15.192:0/59764713 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdd4003e30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.455 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- 172.21.15.192:0/59764713 >> 172.21.15.192:0/59764713 conn(0x7fbdec066ed0 msgr2=0x7fbdec0672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.456 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.430+0000 7fbdebfff700 1 -- 172.21.15.192:0/59764713 shutdown_connections 2023-06-23T01:21:44.456 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- 172.21.15.192:0/59764713 wait complete. 2023-06-23T01:21:44.456 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 Processor -- start 2023-06-23T01:21:44.456 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- start start 2023-06-23T01:21:44.457 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.457 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 0x7fbdec1503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.457 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdec152f70 0x7fbdec1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.458 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec13f590 con 0x7fbdec14ffa0 2023-06-23T01:21:44.458 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec13efd0 con 0x7fbdd4003a60 2023-06-23T01:21:44.458 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec13d0f0 con 0x7fbdec152f70 2023-06-23T01:21:44.458 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.459 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54844/0 (socket says 172.21.15.192:54844) 2023-06-23T01:21:44.459 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 -- 172.21.15.192:0/1529156066 learned_addr learned my addr 172.21.15.192:0/1529156066 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:44.459 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeb7fe700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdec152f70 0x7fbdec1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.460 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdea7fc700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 0x7fbdec1503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.460 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 -- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdec152f70 msgr2=0x7fbdec1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.460 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdec152f70 0x7fbdec1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 -- 172.21.15.192:0/1529156066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 msgr2=0x7fbdec1503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 0x7fbdec1503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 -- 172.21.15.192:0/1529156066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec0aa9e0 con 0x7fbdd4003a60 2023-06-23T01:21:44.461 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdea7fc700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 0x7fbdec1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T01:21:44.462 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdeaffd700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e4b0 tx=0x7fbddc01a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.462 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc022070 con 0x7fbdd4003a60 2023-06-23T01:21:44.463 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc00ea90 con 0x7fbdd4003a60 2023-06-23T01:21:44.463 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec0aa700 con 0x7fbdd4003a60 2023-06-23T01:21:44.463 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbddc01c680 con 0x7fbdd4003a60 2023-06-23T01:21:44.464 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec14fa80 con 0x7fbdd4003a60 2023-06-23T01:21:44.464 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbddc01ccf0 con 0x7fbdd4003a60 2023-06-23T01:21:44.464 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.434+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fbddc026a10 con 0x7fbdd4003a60 2023-06-23T01:21:44.464 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.442+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdec0a9ee0 con 0x7fbdd4003a60 2023-06-23T01:21:44.465 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.442+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fbdec0a9ee0 con 0x7fbdd4003a60 2023-06-23T01:21:44.484 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.474+0000 7f05400a3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T01:21:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.518+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6665b039-4317-4d37-9822-a048a83c99ed", "id": 6} v 0) v1 -- 0x7fbdec14fc70 con 0x7fbdd4003a60 2023-06-23T01:21:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdd2ffd700 1 -- 172.21.15.192:0/1529156066 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6665b039-4317-4d37-9822-a048a83c99ed", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbddc02b070 con 0x7fbdd4003a60 2023-06-23T01:21:44.535 INFO:teuthology.orchestra.run.smithi192.stdout:6 2023-06-23T01:21:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 msgr2=0x7fbdec13e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbddc00e4b0 tx=0x7fbddc01a000 comp rx=0 tx=0).stop 2023-06-23T01:21:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 shutdown_connections 2023-06-23T01:21:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fbdec152f70 0x7fbdec1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbdec14ffa0 0x7fbdec1503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 --2- 172.21.15.192:0/1529156066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdd4003a60 0x7fbdec13e6c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 >> 172.21.15.192:0/1529156066 conn(0x7fbdec066ed0 msgr2=0x7fbdec0672a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 shutdown_connections 2023-06-23T01:21:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.526+0000 7fbdebfff700 1 -- 172.21.15.192:0/1529156066 wait complete. 2023-06-23T01:21:44.542 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.534+0000 7f05400a3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T01:21:44.546 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd new 44c15180-c7e5-4974-8451-598d9276fb67 7 2023-06-23T01:21:44.634 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 Processor -- start 2023-06-23T01:21:44.635 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 -- start start 2023-06-23T01:21:44.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f155c067c10 0x7f155c06e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.636 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c06c140 con 0x7f155c06d2b0 2023-06-23T01:21:44.638 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c06c4f0 con 0x7f155c06e8b0 2023-06-23T01:21:44.638 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1561650700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c142a10 con 0x7f155c067c10 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1560e4f700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f155c06e8b0 0x7f155c142300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52342/0 (socket says 172.21.15.192:52342) 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f1560e4f700 1 -- 172.21.15.192:0/3972519328 learned_addr learned my addr 172.21.15.192:0/3972519328 (peer_addr_for_me v1:172.21.15.192:0/0) 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f155bfff700 1 --2- 172.21.15.192:0/3972519328 >> v2:172.21.15.45:3300/0 conn(0x7f155c067c10 0x7f155c06e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.626+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354985371 0 0) 0x7f155c06c4f0 con 0x7f155c06e8b0 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1548003570 con 0x7f155c06e8b0 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2764852181 0 0) 0x7f1548003570 con 0x7f155c06e8b0 2023-06-23T01:21:44.639 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 >> v2:172.21.15.45:3300/0 conn(0x7f155c067c10 msgr2=0x7f155c06e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 --2- 172.21.15.192:0/3972519328 >> v2:172.21.15.45:3300/0 conn(0x7f155c067c10 0x7f155c06e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 >> v1:172.21.15.45:6789/0 conn(0x7f155c06d2b0 legacy=0x7f155c141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c06ed00 con 0x7f155c06e8b0 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f15540017f0 con 0x7f155c06e8b0 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 >> v1:172.21.15.192:6789/0 conn(0x7f155c06e8b0 legacy=0x7f155c142300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 0x7f1548003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.640 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15480051c0 0x7f154800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c142a10 con 0x7f1548004810 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154800d270 con 0x7f1548003a60 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154800c1b0 con 0x7f15480051c0 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 0x7f1548003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1560e4f700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15480051c0 0x7f154800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.641 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1553fff700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 -- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15480051c0 msgr2=0x7f154800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f15480051c0 0x7f154800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 -- 172.21.15.192:0/3972519328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548004810 msgr2=0x7f1548004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:44.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.642 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 -- 172.21.15.192:0/3972519328 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548003570 con 0x7f1548003a60 2023-06-23T01:21:44.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1560e4f700 1 -- 172.21.15.192:0/3972519328 reap_dead start 2023-06-23T01:21:44.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155bfff700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 0x7f1548003e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f154c009c00 tx=0x7f154c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6d58cbaa0e8e75 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00e710 con 0x7f1548003a60 2023-06-23T01:21:44.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00e870 con 0x7f1548003a60 2023-06-23T01:21:44.643 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f155b7fe700 1 -- 172.21.15.192:0/3972519328 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00ec30 con 0x7f1548003a60 2023-06-23T01:21:44.645 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 -- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 msgr2=0x7f1548003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 0x7f1548003e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f154c009c00 tx=0x7f154c0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 -- 172.21.15.192:0/3972519328 shutdown_connections 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 --2- 172.21.15.192:0/3972519328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1548003a60 0x7f1548003e70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 -- 172.21.15.192:0/3972519328 >> 172.21.15.192:0/3972519328 conn(0x7f155c066ed0 msgr2=0x7f155c0672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 -- 172.21.15.192:0/3972519328 shutdown_connections 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.630+0000 7f1561650700 1 -- 172.21.15.192:0/3972519328 wait complete. 2023-06-23T01:21:44.646 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 Processor -- start 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- start start 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548003a60 0x7f155c09a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f155c0aeb70 0x7f155c0ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c152000 con 0x7f1548003a60 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1557c0 con 0x7f155c151bb0 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c0a9b00 con 0x7f155c0aeb70 2023-06-23T01:21:44.647 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f155bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548003a60 0x7f155c09a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54862/0 (socket says 172.21.15.192:54862) 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 -- 172.21.15.192:0/3585764537 learned_addr learned my addr 172.21.15.192:0/3585764537 (peer_addr_for_me v2:172.21.15.192:0/0) 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1560e4f700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f155c0aeb70 0x7f155c0ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 -- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f155c0aeb70 msgr2=0x7f155c0ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f155c0aeb70 0x7f155c0ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.648 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 -- 172.21.15.192:0/3585764537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548003a60 msgr2=0x7f155c09a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548003a60 0x7f155c09a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 -- 172.21.15.192:0/3585764537 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c0a9890 con 0x7f155c151bb0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1553fff700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f154400e810 tx=0x7f1544009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544012590 con 0x7f155c151bb0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15440126f0 con 0x7f155c151bb0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c1551b0 con 0x7f155c151bb0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544012a90 con 0x7f155c151bb0 2023-06-23T01:21:44.649 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c0a8bf0 con 0x7f155c151bb0 2023-06-23T01:21:44.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f154401d460 con 0x7f155c151bb0 2023-06-23T01:21:44.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.634+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f1544012e00 con 0x7f155c151bb0 2023-06-23T01:21:44.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.638+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c1555f0 con 0x7f155c151bb0 2023-06-23T01:21:44.650 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.638+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f154401d710 con 0x7f155c151bb0 2023-06-23T01:21:44.714 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.706+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd new", "uuid": "44c15180-c7e5-4974-8451-598d9276fb67", "id": 7} v 0) v1 -- 0x7f155c155900 con 0x7f155c151bb0 2023-06-23T01:21:44.720 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.710+0000 7f1558ff9700 1 -- 172.21.15.192:0/3585764537 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44c15180-c7e5-4974-8451-598d9276fb67", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f154401d8b0 con 0x7f155c151bb0 2023-06-23T01:21:44.721 INFO:teuthology.orchestra.run.smithi192.stdout:7 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 msgr2=0x7f155c155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f154400e810 tx=0x7f1544009040 comp rx=0 tx=0).stop 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 shutdown_connections 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f155c151bb0 0x7f155c155c50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f155c0aeb70 0x7f155c0ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.722 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 --2- 172.21.15.192:0/3585764537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1548003a60 0x7f155c09a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.723 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 >> 172.21.15.192:0/3585764537 conn(0x7f155c066ed0 msgr2=0x7f155c0b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.723 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 shutdown_connections 2023-06-23T01:21:44.723 INFO:teuthology.orchestra.run.smithi192.stderr:2023-06-23T01:21:44.714+0000 7f1561650700 1 -- 172.21.15.192:0/3585764537 wait complete. 2023-06-23T01:21:44.731 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:44.722+0000 7f4ea7b6d000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-23T01:21:44.733 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-23T01:21:44.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-23T01:21:44.738 INFO:tasks.ceph.osd.0:Started 2023-06-23T01:21:44.738 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-23T01:21:44.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-23T01:21:44.742 INFO:tasks.ceph.osd.1:Started 2023-06-23T01:21:44.742 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-23T01:21:44.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-23T01:21:44.745 INFO:tasks.ceph.osd.2:Started 2023-06-23T01:21:44.745 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-23T01:21:44.746 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-23T01:21:44.749 INFO:tasks.ceph.osd.3:Started 2023-06-23T01:21:44.749 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-23T01:21:44.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-23T01:21:44.751 INFO:tasks.ceph.osd.4:Started 2023-06-23T01:21:44.752 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-23T01:21:44.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-23T01:21:44.754 INFO:tasks.ceph.osd.5:Started 2023-06-23T01:21:44.754 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-23T01:21:44.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-23T01:21:44.758 INFO:tasks.ceph.osd.6:Started 2023-06-23T01:21:44.758 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-23T01:21:44.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-23T01:21:44.761 INFO:tasks.ceph.osd.7:Started 2023-06-23T01:21:44.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:44.837 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.830+0000 7f05400a3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T01:21:44.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 Processor -- start 2023-06-23T01:21:44.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 -- start start 2023-06-23T01:21:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c1460a0 con 0x7fcd5c0aff80 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd5c0b3bb0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd61d1e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd5c146530 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50484/0 (socket says 172.21.15.45:50484) 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 -- 172.21.15.45:0/4111051518 learned_addr learned my addr 172.21.15.45:0/4111051518 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5affd700 1 --1- 172.21.15.45:0/4111051518 >> v1:172.21.15.45:6789/0 conn(0x7fcd5c0aff80 0x7fcd5c0abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57926/0 (socket says 172.21.15.45:57926) 2023-06-23T01:21:44.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 -- 172.21.15.45:0/4111051518 >> v1:172.21.15.192:6789/0 conn(0x7fcd5c0b26b0 legacy=0x7fcd5c0b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 -- 172.21.15.45:0/4111051518 >> v1:172.21.15.45:6789/0 conn(0x7fcd5c0aff80 legacy=0x7fcd5c0abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5a7fc700 1 -- 172.21.15.45:0/4111051518 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146898450 0 0) 0x7fcd5c1460a0 con 0x7fcd5c0aff80 2023-06-23T01:21:44.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 -- 172.21.15.45:0/4111051518 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c145a50 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5bfff700 1 --2- 172.21.15.45:0/4111051518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd500099b0 tx=0x7fcd50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271149f923dd8c3 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5a7fc700 1 -- 172.21.15.45:0/4111051518 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000b860 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5a7fc700 1 -- 172.21.15.45:0/4111051518 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd5000b9c0 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.874+0000 7fcd5a7fc700 1 -- 172.21.15.45:0/4111051518 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd5000bd80 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- 172.21.15.45:0/4111051518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b2a80 msgr2=0x7fcd5c0b0c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/4111051518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcd500099b0 tx=0x7fcd50009250 comp rx=0 tx=0).stop 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- 172.21.15.45:0/4111051518 shutdown_connections 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/4111051518 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c0b0c60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- 172.21.15.45:0/4111051518 >> 172.21.15.45:0/4111051518 conn(0x7fcd5c06e600 msgr2=0x7fcd5c06ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- 172.21.15.45:0/4111051518 shutdown_connections 2023-06-23T01:21:44.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- 172.21.15.45:0/4111051518 wait complete. 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 Processor -- start 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- start start 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd5c0aff80 0x7fcd5c139760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c1384e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:44.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c155630 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c135860 con 0x7fcd5c0b2a80 2023-06-23T01:21:44.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd61d1e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c13a030 con 0x7fcd5c0aff80 2023-06-23T01:21:44.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c1384e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50498/0 (socket says 172.21.15.45:50498) 2023-06-23T01:21:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5bfff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c1384e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.45:46146/0 (socket says 172.21.15.45:46146) 2023-06-23T01:21:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 -- 172.21.15.45:0/1185313209 learned_addr learned my addr 172.21.15.45:0/1185313209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:44.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5b7fe700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd5c0aff80 0x7fcd5c139760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:44.892 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:44.878+0000 7f4ea7b6d000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-23T01:21:44.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 -- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd5c0aff80 msgr2=0x7fcd5c139760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd5c0aff80 0x7fcd5c139760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 -- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 msgr2=0x7fcd5c1384e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c1384e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.878+0000 7fcd5affd700 1 -- 172.21.15.45:0/1185313209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500094f0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd5affd700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c530 tx=0x7fcd4c007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c005a70 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4c005bd0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5c1488a0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c0070d0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5c135ad0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcd4c01c440 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.882+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fcd4c012ae0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.886+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5c155920 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.886+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7fcd4c017070 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.896 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.886+0000 7f05400a3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T01:21:44.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.954+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd5c0707a0 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.954+0000 7fcd437fe700 1 -- 172.21.15.45:0/1185313209 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fcd4c01c880 con 0x7fcd5c0b26b0 2023-06-23T01:21:44.960 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:44.961 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:44.714430+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:44.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.954+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 msgr2=0x7fcd5c132ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.954+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00c530 tx=0x7fcd4c007f30 comp rx=0 tx=0).stop 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 shutdown_connections 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd5c0b2a80 0x7fcd5c1384e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd5c0b26b0 0x7fcd5c132ab0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 --2- 172.21.15.45:0/1185313209 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fcd5c0aff80 0x7fcd5c139760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:44.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 >> 172.21.15.45:0/1185313209 conn(0x7fcd5c06e600 msgr2=0x7fcd5c13ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:44.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 shutdown_connections 2023-06-23T01:21:44.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:44.958+0000 7fcd61d1e700 1 -- 172.21.15.45:0/1185313209 wait complete. 2023-06-23T01:21:44.964 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:44.954+0000 7f05400a3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T01:21:44.973 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-23T01:21:44.973 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-23T01:21:45.103 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-06-23T01:21:45.098+0000 7f57102d73c0 -1 Falling back to public interface 2023-06-23T01:21:45.119 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-06-23T01:21:45.114+0000 7f4a1f8f53c0 -1 Falling back to public interface 2023-06-23T01:21:45.137 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:45.130+0000 7f05400a3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T01:21:45.151 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-06-23T01:21:45.142+0000 7fa39e7513c0 -1 Falling back to public interface 2023-06-23T01:21:45.158 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-06-23T01:21:45.146+0000 7fd4d792f3c0 -1 Falling back to public interface 2023-06-23T01:21:45.206 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:45.198+0000 7f05400a3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T01:21:45.211 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.206+0000 7f4ea7b6d000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-23T01:21:45.382 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.374+0000 7f4ea7b6d000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-23T01:21:45.383 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-06-23T01:21:45.378+0000 7fac6154b3c0 -1 Falling back to public interface 2023-06-23T01:21:45.392 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-06-23T01:21:45.386+0000 7f23e3d3d3c0 -1 Falling back to public interface 2023-06-23T01:21:45.395 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-06-23T01:21:45.386+0000 7f55206f13c0 -1 Falling back to public interface 2023-06-23T01:21:45.407 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-06-23T01:21:45.398+0000 7f6f94d223c0 -1 Falling back to public interface 2023-06-23T01:21:45.450 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.446+0000 7f4ea7b6d000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-23T01:21:45.505 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.498+0000 7f4ea7b6d000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-23T01:21:45.562 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.558+0000 7f4ea7b6d000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-23T01:21:45.780 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:45.834 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.830+0000 7f4ea7b6d000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-23T01:21:45.880 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 Processor -- start 2023-06-23T01:21:45.880 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 -- start start 2023-06-23T01:21:45.884 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c06b270 0x7f186c1458b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.884 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f186c0b17c0 0x7f186c145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c0b2890 con 0x7f186c0b3e00 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c068510 con 0x7f186c0b17c0 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f18736ca700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b2240 con 0x7f186c06b270 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1870c65700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f186c0b3e00 0x7f186c0b6920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57938/0 (socket says 172.21.15.45:57938) 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1870c65700 1 -- 172.21.15.45:0/3589458956 learned_addr learned my addr 172.21.15.45:0/3589458956 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1871c67700 1 --2- 172.21.15.45:0/3589458956 >> v2:172.21.15.192:3300/0 conn(0x7f186c0b17c0 0x7f186c145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.885 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c06b270 0x7f186c1458b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.886 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284667303 0 0) 0x7f186c0b2890 con 0x7f186c0b3e00 2023-06-23T01:21:45.886 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1858003570 con 0x7f186c0b3e00 2023-06-23T01:21:45.886 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623936165 0 0) 0x7f1858003570 con 0x7f186c0b3e00 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c06b270 msgr2=0x7f186c1458b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c06b270 0x7f186c1458b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 >> v2:172.21.15.192:3300/0 conn(0x7f186c0b17c0 msgr2=0x7f186c145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 --2- 172.21.15.45:0/3589458956 >> v2:172.21.15.192:3300/0 conn(0x7f186c0b17c0 0x7f186c145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.874+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0b2520 con 0x7f186c0b3e00 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f185c001470 con 0x7f186c0b3e00 2023-06-23T01:21:45.887 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 >> v1:172.21.15.45:6789/0 conn(0x7f186c0b3e00 legacy=0x7f186c0b6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1858003a60 0x7f1858003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1858004810 0x7f1858004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18580051c0 0x7f185800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c068510 con 0x7f1858003a60 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b2240 con 0x7f18580051c0 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185800bfa0 con 0x7f1858004810 2023-06-23T01:21:45.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- 172.21.15.45:0/3589458956 >> v2:172.21.15.192:3300/0 conn(0x7f186c0b17c0 0x7f186c145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c06b270 0x7f186c1458b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1858003a60 0x7f1858003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18580051c0 0x7f185800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1870c65700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1858004810 0x7f1858004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 -- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1858004810 msgr2=0x7f1858004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1858004810 0x7f1858004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 -- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18580051c0 msgr2=0x7f185800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:45.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18580051c0 0x7f185800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 -- 172.21.15.45:0/3589458956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858003570 con 0x7f1858003a60 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18580051c0 0x7f185800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1858003a60 0x7f1858003e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1868009c50 tx=0x7f18680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f47ed235962ec6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800e6b0 con 0x7f1858003a60 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186800e810 con 0x7f1858003a60 2023-06-23T01:21:45.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1863fff700 1 -- 172.21.15.45:0/3589458956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186800ebb0 con 0x7f1858003a60 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- 172.21.15.45:0/3589458956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1858003a60 msgr2=0x7f1858003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 --2- 172.21.15.45:0/3589458956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1858003a60 0x7f1858003e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1868009c50 tx=0x7f18680091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 -- 172.21.15.45:0/3589458956 reap_dead start 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- 172.21.15.45:0/3589458956 shutdown_connections 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- 172.21.15.45:0/3589458956 >> 172.21.15.45:0/3589458956 conn(0x7f186c067950 msgr2=0x7f186c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- 172.21.15.45:0/3589458956 shutdown_connections 2023-06-23T01:21:45.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- 172.21.15.45:0/3589458956 wait complete. 2023-06-23T01:21:45.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 Processor -- start 2023-06-23T01:21:45.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- start start 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1858003a60 0x7f186c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c1564e0 0x7f186c0b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0b6f80 con 0x7f186c0b6b10 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c155b10 con 0x7f1858003a60 2023-06-23T01:21:45.894 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f18736ca700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c13cdd0 con 0x7f186c1564e0 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50516/0 (socket says 172.21.15.45:50516) 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 -- 172.21.15.45:0/940886996 learned_addr learned my addr 172.21.15.45:0/940886996 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1870c65700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c1564e0 0x7f186c0b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871466700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1858003a60 0x7f186c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 -- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c1564e0 msgr2=0x7f186c0b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:45.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c1564e0 0x7f186c0b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 -- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1858003a60 msgr2=0x7f186c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1858003a60 0x7f186c155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.878+0000 7f1871c67700 1 -- 172.21.15.45:0/940886996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c0b7760 con 0x7f186c0b6b10 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f1871c67700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f186c13fe00 tx=0x7f186400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400e070 con 0x7f186c0b6b10 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864011db0 con 0x7f186c0b6b10 2023-06-23T01:21:45.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c13d0b0 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640166c0 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0b07e0 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1864016a70 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1864016d20 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.882+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c04b3f0 con 0x7f186c0b6b10 2023-06-23T01:21:45.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.886+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71365 (secure 0 0 0) 0x7f186c04b3f0 con 0x7f186c0b6b10 2023-06-23T01:21:45.898 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.890+0000 7f4ea7b6d000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-23T01:21:45.933 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:45.922+0000 7f05400a3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T01:21:45.952 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.946+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186c155cc0 con 0x7f186c0b6b10 2023-06-23T01:21:45.953 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.946+0000 7f18617fa700 1 -- 172.21.15.45:0/940886996 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f186c155cc0 con 0x7f186c0b6b10 2023-06-23T01:21:45.953 INFO:teuthology.misc.health.smithi045.stdout: 2023-06-23T01:21:45.953 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:44.714430+0000","last_up_change":"0.000000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:45.954 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 msgr2=0x7f186c13a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:45.955 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f186c13fe00 tx=0x7f186400b040 comp rx=0 tx=0).stop 2023-06-23T01:21:45.955 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 shutdown_connections 2023-06-23T01:21:45.955 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f186c0b6b10 0x7f186c13a7a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.955 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f186c1564e0 0x7f186c0b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.956 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 --2- 172.21.15.45:0/940886996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1858003a60 0x7f186c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:45.956 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 >> 172.21.15.45:0/940886996 conn(0x7f186c067950 msgr2=0x7f186c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:45.956 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 shutdown_connections 2023-06-23T01:21:45.956 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:45.950+0000 7f18736ca700 1 -- 172.21.15.45:0/940886996 wait complete. 2023-06-23T01:21:45.963 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:45.958+0000 7f4ea7b6d000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-23T01:21:45.968 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-23T01:21:46.133 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:46.126+0000 7f4ea7b6d000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-23T01:21:46.201 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:46.194+0000 7f4ea7b6d000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-23T01:21:46.933 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-06-23T01:21:46.926+0000 7f4ea7b6d000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-23T01:21:46.984 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:46.974+0000 7f052919a700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-23T01:21:46.985 INFO:tasks.ceph.mgr.x.smithi192.stderr:2023-06-23T01:21:46.978+0000 7f052919a700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-23T01:21:48.735 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-06-23T01:21:48.726+0000 7fa39e7513c0 -1 osd.6 0 log_to_monitors true 2023-06-23T01:21:48.758 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-06-23T01:21:48.750+0000 7f55206f13c0 -1 osd.7 0 log_to_monitors true 2023-06-23T01:21:48.975 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-06-23T01:21:48.966+0000 7fd4d792f3c0 -1 osd.4 0 log_to_monitors true 2023-06-23T01:21:49.028 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-06-23T01:21:49.022+0000 7f4a1f8f53c0 -1 osd.3 0 log_to_monitors true 2023-06-23T01:21:49.057 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-06-23T01:21:49.050+0000 7f57102d73c0 -1 osd.1 0 log_to_monitors true 2023-06-23T01:21:49.181 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-06-23T01:21:49.170+0000 7f6f94d223c0 -1 osd.5 0 log_to_monitors true 2023-06-23T01:21:49.185 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-06-23T01:21:49.178+0000 7fac6154b3c0 -1 osd.0 0 log_to_monitors true 2023-06-23T01:21:49.235 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-06-23T01:21:49.230+0000 7f23e3d3d3c0 -1 osd.2 0 log_to_monitors true 2023-06-23T01:21:50.710 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-06-23T01:21:50.702+0000 7f551be91700 -1 osd.7 0 waiting for initial osdmap 2023-06-23T01:21:50.715 INFO:tasks.ceph.osd.7.smithi192.stderr:2023-06-23T01:21:50.706+0000 7f5514c35700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:50.720 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-06-23T01:21:50.710+0000 7fa39b716700 -1 osd.6 0 waiting for initial osdmap 2023-06-23T01:21:50.727 INFO:tasks.ceph.osd.6.smithi192.stderr:2023-06-23T01:21:50.718+0000 7fa392c95700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.712 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-06-23T01:21:51.702+0000 7fd4d48f4700 -1 osd.4 0 waiting for initial osdmap 2023-06-23T01:21:51.719 INFO:tasks.ceph.osd.4.smithi192.stderr:2023-06-23T01:21:51.710+0000 7fd4cbe73700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.745 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-06-23T01:21:51.738+0000 7f6f904c2700 -1 osd.5 0 waiting for initial osdmap 2023-06-23T01:21:51.751 INFO:tasks.ceph.osd.5.smithi192.stderr:2023-06-23T01:21:51.742+0000 7f6f89266700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.977 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-06-23T01:21:51.970+0000 7f23df4dd700 -1 osd.2 0 waiting for initial osdmap 2023-06-23T01:21:51.978 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-06-23T01:21:51.970+0000 7f4a1b095700 -1 osd.3 0 waiting for initial osdmap 2023-06-23T01:21:51.979 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-06-23T01:21:51.974+0000 7f570d29c700 -1 osd.1 0 waiting for initial osdmap 2023-06-23T01:21:51.981 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-06-23T01:21:51.974+0000 7f4a13e39700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.983 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-06-23T01:21:51.978+0000 7f23d8281700 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.987 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-06-23T01:21:51.982+0000 7fac5cceb700 -1 osd.0 0 waiting for initial osdmap 2023-06-23T01:21:51.988 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-06-23T01:21:51.982+0000 7f570481b700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:51.995 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-06-23T01:21:51.990+0000 7fac55a8f700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-23T01:21:52.784 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:52.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 Processor -- start 2023-06-23T01:21:52.888 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 -- start start 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18900b27a0 0x7f18900b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1890145ea0 con 0x7f189014a9e0 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18900b1070 con 0x7f18901421a0 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18967df700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18900b1de0 con 0x7f18900b27a0 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1895fde700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f189014a9e0 0x7f189014cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58728/0 (socket says 172.21.15.45:58728) 2023-06-23T01:21:52.889 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1895fde700 1 -- 172.21.15.45:0/1785294158 learned_addr learned my addr 172.21.15.45:0/1785294158 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:52.890 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18957dd700 1 --2- 172.21.15.45:0/1785294158 >> v2:172.21.15.192:3300/0 conn(0x7f18900b27a0 0x7f18900b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:52.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447650317 0 0) 0x7f1890145ea0 con 0x7f189014a9e0 2023-06-23T01:21:52.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f187c003570 con 0x7f189014a9e0 2023-06-23T01:21:52.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188519169 0 0) 0x7f18900b1070 con 0x7f18901421a0 2023-06-23T01:21:52.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1890145ea0 con 0x7f18901421a0 2023-06-23T01:21:52.891 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18957dd700 1 -- 172.21.15.45:0/1785294158 >> v1:172.21.15.192:6789/0 conn(0x7f18901421a0 legacy=0x7f18900aba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18957dd700 1 -- 172.21.15.45:0/1785294158 >> v1:172.21.15.45:6789/0 conn(0x7f189014a9e0 legacy=0x7f189014cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.882+0000 7f18957dd700 1 -- 172.21.15.45:0/1785294158 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890145850 con 0x7f18900b27a0 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18957dd700 1 --2- 172.21.15.45:0/1785294158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18900b0b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18800098e0 tx=0x7f18800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa9d2ad8de5f40ee server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011630 con 0x7f18900b27a0 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1880011790 con 0x7f18900b27a0 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1887fff700 1 -- 172.21.15.45:0/1785294158 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1880011b30 con 0x7f18900b27a0 2023-06-23T01:21:52.892 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- 172.21.15.45:0/1785294158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 msgr2=0x7f18900b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 --2- 172.21.15.45:0/1785294158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18900b0b30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f18800098e0 tx=0x7f18800091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- 172.21.15.45:0/1785294158 shutdown_connections 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 --2- 172.21.15.45:0/1785294158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18900b0b30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- 172.21.15.45:0/1785294158 >> 172.21.15.45:0/1785294158 conn(0x7f1890066e80 msgr2=0x7f1890067280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- 172.21.15.45:0/1785294158 shutdown_connections 2023-06-23T01:21:52.893 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- 172.21.15.45:0/1785294158 wait complete. 2023-06-23T01:21:52.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 Processor -- start 2023-06-23T01:21:52.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- start start 2023-06-23T01:21:52.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18901442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:52.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18901421a0 0x7f189013e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:52.895 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1890155800 con 0x7f189014a9e0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189013fac0 con 0x7f18900b27a0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18967df700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1890156030 con 0x7f18901421a0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1894fdc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18901421a0 0x7f189013e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f18957dd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18901442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:52.896 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47008/0 (socket says 172.21.15.45:47008) 2023-06-23T01:21:52.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 -- 172.21.15.45:0/384965011 learned_addr learned my addr 172.21.15.45:0/384965011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:52.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 -- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18901421a0 msgr2=0x7f189013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:52.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18901421a0 0x7f189013e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:52.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 -- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 msgr2=0x7f18901442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:52.897 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18901442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.886+0000 7f1895fde700 1 -- 172.21.15.45:0/384965011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1880009420 con 0x7f189014a9e0 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f1895fde700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18880010e0 tx=0x7f1888007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888005c00 con 0x7f189014a9e0 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1888005d60 con 0x7f189014a9e0 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18901559e0 con 0x7f189014a9e0 2023-06-23T01:21:52.898 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880072e0 con 0x7f189014a9e0 2023-06-23T01:21:52.899 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1890155d70 con 0x7f189014a9e0 2023-06-23T01:21:52.899 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1890069ed0 con 0x7f189014a9e0 2023-06-23T01:21:52.899 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.890+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 79811+0+0 (secure 0 0 0) 0x7f1888007690 con 0x7f189014a9e0 2023-06-23T01:21:52.900 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.894+0000 7f18857fa700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 0x7f18740629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:52.900 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.894+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f188807b4f0 con 0x7f189014a9e0 2023-06-23T01:21:52.900 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.894+0000 7f18957dd700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 0x7f18740629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:52.900 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.894+0000 7f18957dd700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 0x7f18740629a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18800093f0 tx=0x7f1880017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:52.907 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:52.902+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f1888049bd0 con 0x7f189014a9e0 2023-06-23T01:21:53.067 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.058+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1890155b70 con 0x7f189014a9e0 2023-06-23T01:21:53.067 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.058+0000 7f18857fa700 1 -- 172.21.15.45:0/384965011 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11993 (secure 0 0 0) 0x7f1888017020 con 0x7f189014a9e0 2023-06-23T01:21:53.067 INFO:teuthology.misc.health.smithi045.stdout: 2023-06-23T01:21:53.068 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":14,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:52.712540+0000","last_up_change":"2023-06-23T01:21:52.712540+0000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T01:21:52.030176+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":32676},{"type":"v1","addr":"172.21.15.45:6817","nonce":32676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":32676},{"type":"v1","addr":"172.21.15.45:6819","nonce":32676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":32676},{"type":"v1","addr":"172.21.15.45:6823","nonce":32676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":32676},{"type":"v1","addr":"172.21.15.45:6821","nonce":32676}]},"public_addr":"172.21.15.45:6817/32676","cluster_addr":"172.21.15.45:6819/32676","heartbeat_back_addr":"172.21.15.45:6823/32676","heartbeat_front_addr":"172.21.15.45:6821/32676","state":["exists","up"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":32675},{"type":"v1","addr":"172.21.15.45:6801","nonce":32675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":32675},{"type":"v1","addr":"172.21.15.45:6803","nonce":32675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":32675},{"type":"v1","addr":"172.21.15.45:6807","nonce":32675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":32675},{"type":"v1","addr":"172.21.15.45:6805","nonce":32675}]},"public_addr":"172.21.15.45:6801/32675","cluster_addr":"172.21.15.45:6803/32675","heartbeat_back_addr":"172.21.15.45:6807/32675","heartbeat_front_addr":"172.21.15.45:6805/32675","state":["exists","up"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":32677},{"type":"v1","addr":"172.21.15.45:6825","nonce":32677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":32677},{"type":"v1","addr":"172.21.15.45:6827","nonce":32677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":32677},{"type":"v1","addr":"172.21.15.45:6831","nonce":32677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":32677},{"type":"v1","addr":"172.21.15.45:6829","nonce":32677}]},"public_addr":"172.21.15.45:6825/32677","cluster_addr":"172.21.15.45:6827/32677","heartbeat_back_addr":"172.21.15.45:6831/32677","heartbeat_front_addr":"172.21.15.45:6829/32677","state":["exists","up"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":32678},{"type":"v1","addr":"172.21.15.45:6809","nonce":32678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":32678},{"type":"v1","addr":"172.21.15.45:6811","nonce":32678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":32678},{"type":"v1","addr":"172.21.15.45:6815","nonce":32678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":32678},{"type":"v1","addr":"172.21.15.45:6813","nonce":32678}]},"public_addr":"172.21.15.45:6809/32678","cluster_addr":"172.21.15.45:6811/32678","heartbeat_back_addr":"172.21.15.45:6815/32678","heartbeat_front_addr":"172.21.15.45:6813/32678","state":["exists","up"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":32949},{"type":"v1","addr":"172.21.15.192:6809","nonce":32949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":32949},{"type":"v1","addr":"172.21.15.192:6811","nonce":32949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":32949},{"type":"v1","addr":"172.21.15.192:6815","nonce":32949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":32949},{"type":"v1","addr":"172.21.15.192:6813","nonce":32949}]},"public_addr":"172.21.15.192:6809/32949","cluster_addr":"172.21.15.192:6811/32949","heartbeat_back_addr":"172.21.15.192:6815/32949","heartbeat_front_addr":"172.21.15.192:6813/32949","state":["exists","up"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":32950},{"type":"v1","addr":"172.21.15.192:6825","nonce":32950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":32950},{"type":"v1","addr":"172.21.15.192:6827","nonce":32950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":32950},{"type":"v1","addr":"172.21.15.192:6831","nonce":32950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":32950},{"type":"v1","addr":"172.21.15.192:6829","nonce":32950}]},"public_addr":"172.21.15.192:6825/32950","cluster_addr":"172.21.15.192:6827/32950","heartbeat_back_addr":"172.21.15.192:6831/32950","heartbeat_front_addr":"172.21.15.192:6829/32950","state":["exists","up"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":32948},{"type":"v1","addr":"172.21.15.192:6801","nonce":32948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":32948},{"type":"v1","addr":"172.21.15.192:6803","nonce":32948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":32948},{"type":"v1","addr":"172.21.15.192:6807","nonce":32948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":32948},{"type":"v1","addr":"172.21.15.192:6805","nonce":32948}]},"public_addr":"172.21.15.192:6801/32948","cluster_addr":"172.21.15.192:6803/32948","heartbeat_back_addr":"172.21.15.192:6807/32948","heartbeat_front_addr":"172.21.15.192:6805/32948","state":["exists","up"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":32951},{"type":"v1","addr":"172.21.15.192:6817","nonce":32951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":32951},{"type":"v1","addr":"172.21.15.192:6819","nonce":32951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":32951},{"type":"v1","addr":"172.21.15.192:6823","nonce":32951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":32951},{"type":"v1","addr":"172.21.15.192:6821","nonce":32951}]},"public_addr":"172.21.15.192:6817/32951","cluster_addr":"172.21.15.192:6819/32951","heartbeat_back_addr":"172.21.15.192:6823/32951","heartbeat_front_addr":"172.21.15.192:6821/32951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.782478+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.752980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:53.068 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 msgr2=0x7f18740629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 0x7f18740629a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f18800093f0 tx=0x7f1880017000 comp rx=0 tx=0).stop 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 msgr2=0x7f189013ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f18880010e0 tx=0x7f1888007d90 comp rx=0 tx=0).stop 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 shutdown_connections 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f18740604f0 0x7f18740629a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.069 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f189014a9e0 0x7f189013ea60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.070 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f18901421a0 0x7f189013e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.070 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 --2- 172.21.15.45:0/384965011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18900b27a0 0x7f18901442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.070 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 >> 172.21.15.45:0/384965011 conn(0x7f1890066e80 msgr2=0x7f18900b5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:53.070 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 shutdown_connections 2023-06-23T01:21:53.070 INFO:teuthology.misc.health.smithi045.stderr:2023-06-23T01:21:53.062+0000 7f18967df700 1 -- 172.21.15.45:0/384965011 wait complete. 2023-06-23T01:21:53.077 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-23T01:21:53.078 INFO:tasks.ceph:Creating RBD pool 2023-06-23T01:21:53.078 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-23T01:21:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.174+0000 7f1ff4b2b700 1 Processor -- start 2023-06-23T01:21:53.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.174+0000 7f1ff4b2b700 1 -- start start 2023-06-23T01:21:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.174+0000 7f1ff4b2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 0x7f1ff00978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ff006f120 0x7f1ff00697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff0097150 con 0x7f1ff00b61e0 2023-06-23T01:21:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff00964e0 con 0x7f1ff006f120 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00b0e00 con 0x7f1ff00b5e10 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ff006f120 0x7f1ff00697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ff006f120 0x7f1ff00697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47024/0 (socket says 172.21.15.45:47024) 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 -- 172.21.15.45:0/1361639085 learned_addr learned my addr 172.21.15.45:0/1361639085 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fef7fe700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 0x7f1ff00978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 -- 172.21.15.45:0/1361639085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 msgr2=0x7f1ff00978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:53.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 0x7f1ff00978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 -- 172.21.15.45:0/1361639085 >> v1:172.21.15.192:6789/0 conn(0x7f1ff00b61e0 legacy=0x7f1ff0069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 -- 172.21.15.45:0/1361639085 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0097430 con 0x7f1ff006f120 2023-06-23T01:21:53.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fef7fe700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 0x7f1ff00978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:53.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff006f120 0x7f1ff00697b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80099b0 tx=0x7f1fd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355dd87073080b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1feeffd700 1 -- 172.21.15.45:0/1361639085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800b860 con 0x7f1ff006f120 2023-06-23T01:21:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1feeffd700 1 -- 172.21.15.45:0/1361639085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800b9c0 con 0x7f1ff006f120 2023-06-23T01:21:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1feeffd700 1 -- 172.21.15.45:0/1361639085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800bd60 con 0x7f1ff006f120 2023-06-23T01:21:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/1361639085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff006f120 msgr2=0x7f1ff00697b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff006f120 0x7f1ff00697b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80099b0 tx=0x7f1fd8009250 comp rx=0 tx=0).stop 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/1361639085 shutdown_connections 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff006f120 0x7f1ff00697b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/1361639085 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff00b5e10 0x7f1ff00978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/1361639085 >> 172.21.15.45:0/1361639085 conn(0x7f1ff0068a50 msgr2=0x7f1ff00b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/1361639085 shutdown_connections 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/1361639085 wait complete. 2023-06-23T01:21:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 Processor -- start 2023-06-23T01:21:53.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- start start 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 0x7f1ff006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff013ee20 con 0x7f1ff00b61e0 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00a9980 con 0x7f1ff00b5e10 2023-06-23T01:21:53.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1ff4b2b700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff013eb20 con 0x7f1ff006f120 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1feffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.178+0000 7f1fef7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 0x7f1ff006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe6ffd700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.45:43714/0 (socket says 172.21.15.45:43714) 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe6ffd700 1 -- 172.21.15.45:0/479139454 learned_addr learned my addr 172.21.15.45:0/479139454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fef7fe700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 0x7f1ff006dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.45:41762/0 (socket says 172.21.15.45:41762) 2023-06-23T01:21:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47026/0 (socket says 172.21.15.45:47026) 2023-06-23T01:21:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 -- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 msgr2=0x7f1ff006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 0x7f1ff006dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 -- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 msgr2=0x7f1ff00a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 -- 172.21.15.45:0/479139454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80094f0 con 0x7f1ff00b61e0 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe6ffd700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1feffff700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00972e0 tx=0x7f1fe8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8006ba0 con 0x7f1ff00b61e0 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe8006d20 con 0x7f1ff00b61e0 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff0142120 con 0x7f1ff00b61e0 2023-06-23T01:21:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe8012880 con 0x7f1ff00b61e0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00ab300 con 0x7f1ff00b61e0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 79811+0+0 (secure 0 0 0) 0x7f1fe8012c70 con 0x7f1ff00b61e0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.182+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff00a9ba0 con 0x7f1ff00b61e0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.186+0000 7f1fe7fff700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 0x7f1fd00628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.186+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4842+0+0 (secure 0 0 0) 0x7f1fe807bf80 con 0x7f1ff00b61e0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.186+0000 7f1fef7fe700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 0x7f1fd00628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.186+0000 7f1fef7fe700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 0x7f1fd00628d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0006f00 tx=0x7f1fe0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.194+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f1fe804c9d0 con 0x7f1ff00b61e0 2023-06-23T01:21:53.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.342+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1ff013ef60 con 0x7f1ff00b61e0 2023-06-23T01:21:53.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.722+0000 7f1fe7fff700 1 -- 172.21.15.45:0/479139454 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7f1ff013ef60 con 0x7f1ff00b61e0 2023-06-23T01:21:53.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 msgr2=0x7f1fd00628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 0x7f1fd00628d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1fe0006f00 tx=0x7f1fe0008040 comp rx=0 tx=0).stop 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 msgr2=0x7f1ff00aa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1ff00972e0 tx=0x7f1fe8001690 comp rx=0 tx=0).stop 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 shutdown_connections 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1fd0060420 0x7f1fd00628d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ff00b5e10 0x7f1ff00a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ff00b61e0 0x7f1ff00aa3e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 --2- 172.21.15.45:0/479139454 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1ff006f120 0x7f1ff006dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 >> 172.21.15.45:0/479139454 conn(0x7f1ff0068a50 msgr2=0x7f1ff006c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 shutdown_connections 2023-06-23T01:21:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.726+0000 7f1ff4b2b700 1 -- 172.21.15.45:0/479139454 wait complete. 2023-06-23T01:21:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'rbd' created 2023-06-23T01:21:53.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-23T01:21:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 Processor -- start 2023-06-23T01:21:53.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 -- start start 2023-06-23T01:21:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17580aa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 0x7f17580aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580a9120 con 0x7f17580b4ca0 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580ae840 con 0x7f17580af710 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580ae180 con 0x7f17580a80b0 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1756d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 0x7f17580aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175659c700 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f17580b4ca0 0x7f17580af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.45:33314/0 (socket says 172.21.15.45:33314) 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f175659c700 1 -- 172.21.15.45:0/1142502292 learned_addr learned my addr 172.21.15.45:0/1142502292 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1756d9d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 0x7f17580aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.45:43720/0 (socket says 172.21.15.45:43720) 2023-06-23T01:21:53.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 --2- 172.21.15.45:0/1142502292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17580aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1755d9b700 1 -- 172.21.15.45:0/1142502292 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56470239 0 0) 0x7f17580a9120 con 0x7f17580b4ca0 2023-06-23T01:21:53.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1755d9b700 1 -- 172.21.15.45:0/1142502292 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1744003570 con 0x7f17580b4ca0 2023-06-23T01:21:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 -- 172.21.15.45:0/1142502292 >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 msgr2=0x7f17580aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 --2- 172.21.15.45:0/1142502292 >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 0x7f17580aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 -- 172.21.15.45:0/1142502292 >> v1:172.21.15.192:6789/0 conn(0x7f17580b4ca0 legacy=0x7f17580af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 -- 172.21.15.45:0/1142502292 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580ae460 con 0x7f17580a80b0 2023-06-23T01:21:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f174ffff700 1 --2- 172.21.15.45:0/1142502292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17580aa930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f17400098e0 tx=0x7f17400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9960ffa478dd7bec server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1755d9b700 1 -- 172.21.15.45:0/1142502292 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011630 con 0x7f17580a80b0 2023-06-23T01:21:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1755d9b700 1 -- 172.21.15.45:0/1142502292 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740011790 con 0x7f17580a80b0 2023-06-23T01:21:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.862+0000 7f1755d9b700 1 -- 172.21.15.45:0/1142502292 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011b30 con 0x7f17580a80b0 2023-06-23T01:21:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- 172.21.15.45:0/1142502292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 msgr2=0x7f17580aa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 --2- 172.21.15.45:0/1142502292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17580aa930 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f17400098e0 tx=0x7f17400091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- 172.21.15.45:0/1142502292 shutdown_connections 2023-06-23T01:21:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 --2- 172.21.15.45:0/1142502292 >> v2:172.21.15.192:3300/0 conn(0x7f17580af710 0x7f17580aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 --2- 172.21.15.45:0/1142502292 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17580aa930 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- 172.21.15.45:0/1142502292 >> 172.21.15.45:0/1142502292 conn(0x7f17580679e0 msgr2=0x7f17580b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- 172.21.15.45:0/1142502292 shutdown_connections 2023-06-23T01:21:53.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- 172.21.15.45:0/1142502292 wait complete. 2023-06-23T01:21:53.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 Processor -- start 2023-06-23T01:21:53.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.866+0000 7f175759e700 1 -- start start 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17581441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17580b4ca0 0x7f175806d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175811d460 con 0x7f17580af710 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175811c1e0 con 0x7f17580b4ca0 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175811d640 con 0x7f17580a80b0 2023-06-23T01:21:53.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175659c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17581441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47032/0 (socket says 172.21.15.45:47032) 2023-06-23T01:21:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 -- 172.21.15.45:0/1882805061 learned_addr learned my addr 172.21.15.45:0/1882805061 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:53.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f1756d9d700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17580b4ca0 0x7f175806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 -- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 msgr2=0x7f17581441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17581441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 -- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17580b4ca0 msgr2=0x7f175806d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17580b4ca0 0x7f175806d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 -- 172.21.15.45:0/1882805061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009420 con 0x7f17580af710 2023-06-23T01:21:53.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174ffff700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17580ae2c0 tx=0x7f1740017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740011900 con 0x7f17580af710 2023-06-23T01:21:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1740011a60 con 0x7f17580af710 2023-06-23T01:21:53.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175811c430 con 0x7f17580af710 2023-06-23T01:21:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740023620 con 0x7f17580af710 2023-06-23T01:21:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1758145110 con 0x7f17580af710 2023-06-23T01:21:53.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.870+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175806ad20 con 0x7f17580af710 2023-06-23T01:21:53.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.874+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 79811+0+0 (secure 0 0 0) 0x7f174002c3b0 con 0x7f17580af710 2023-06-23T01:21:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.874+0000 7f174e7fc700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 0x7f17380628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.874+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f174007d690 con 0x7f17580af710 2023-06-23T01:21:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.874+0000 7f175659c700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 0x7f17380628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:53.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.874+0000 7f175659c700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 0x7f17380628d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1748007fd0 tx=0x7f1748009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:53.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:53.882+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f174004e0a0 con 0x7f17580af710 2023-06-23T01:21:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.046+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17580a8ac0 con 0x7f17580af710 2023-06-23T01:21:54.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.726+0000 7f174e7fc700 1 -- 172.21.15.45:0/1882805061 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7f17400516c0 con 0x7f17580af710 2023-06-23T01:21:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 msgr2=0x7f17380628d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:54.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 0x7f17380628d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1748007fd0 tx=0x7f1748009040 comp rx=0 tx=0).stop 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 msgr2=0x7f175806d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f17580ae2c0 tx=0x7f1740017000 comp rx=0 tx=0).stop 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 shutdown_connections 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1738060420 0x7f17380628d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17580b4ca0 0x7f175806d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17580af710 0x7f175806d010 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 --2- 172.21.15.45:0/1882805061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f17580a80b0 0x7f17581441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 >> 172.21.15.45:0/1882805061 conn(0x7f17580679e0 msgr2=0x7f17580aac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 shutdown_connections 2023-06-23T01:21:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.730+0000 7f175759e700 1 -- 172.21.15.45:0/1882805061 wait complete. 2023-06-23T01:21:54.739 INFO:teuthology.orchestra.run.smithi045.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-23T01:21:54.752 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-23T01:21:54.752 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-23T01:21:54.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-23T01:21:54.754 INFO:tasks.ceph.mds.a:Started 2023-06-23T01:21:54.754 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-23T01:21:54.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-23T01:21:54.757 INFO:tasks.ceph.mds.b:Started 2023-06-23T01:21:54.758 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-23T01:21:54.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:54.823 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-06-23T01:21:54.827 INFO:tasks.ceph.mds.b.smithi192.stdout:starting mds.b at 2023-06-23T01:21:54.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 Processor -- start 2023-06-23T01:21:54.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 -- start start 2023-06-23T01:21:54.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb1406f9c0 0x7ffb140af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb1406d310 0x7ffb14142a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb1406ce80 con 0x7ffb1406ea90 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1406e120 con 0x7ffb1406f9c0 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1359e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb1406cbe0 con 0x7ffb1406d310 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb1406f9c0 0x7ffb140af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffb1406f9c0 0x7ffb140af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47050/0 (socket says 172.21.15.45:47050) 2023-06-23T01:21:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb1259c700 1 -- 172.21.15.45:0/532428756 learned_addr learned my addr 172.21.15.45:0/532428756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:54.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.854+0000 7ffb12d9d700 1 --2- 172.21.15.45:0/532428756 >> v2:172.21.15.192:3300/0 conn(0x7ffb1406d310 0x7ffb14142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.858+0000 7ffb1259c700 1 -- 172.21.15.45:0/532428756 >> v2:172.21.15.192:3300/0 conn(0x7ffb1406d310 msgr2=0x7ffb14142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:54.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.858+0000 7ffb1259c700 1 --2- 172.21.15.45:0/532428756 >> v2:172.21.15.192:3300/0 conn(0x7ffb1406d310 0x7ffb14142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.858+0000 7ffb1259c700 1 -- 172.21.15.45:0/532428756 >> v1:172.21.15.192:6789/0 conn(0x7ffb1406ea90 legacy=0x7ffb141422f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:54.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.858+0000 7ffb1259c700 1 -- 172.21.15.45:0/532428756 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1406e320 con 0x7ffb1406f9c0 2023-06-23T01:21:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.858+0000 7ffb1259c700 1 --2- 172.21.15.45:0/532428756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406f9c0 0x7ffb140af770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406dfe0 tx=0x7ffb04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=805c4b48d5362baa server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1159a700 1 -- 172.21.15.45:0/532428756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400e070 con 0x7ffb1406f9c0 2023-06-23T01:21:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1159a700 1 -- 172.21.15.45:0/532428756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400b9e0 con 0x7ffb1406f9c0 2023-06-23T01:21:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1159a700 1 -- 172.21.15.45:0/532428756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040092e0 con 0x7ffb1406f9c0 2023-06-23T01:21:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- 172.21.15.45:0/532428756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406f9c0 msgr2=0x7ffb140af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- 172.21.15.45:0/532428756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406f9c0 0x7ffb140af770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb1406dfe0 tx=0x7ffb04009840 comp rx=0 tx=0).stop 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- 172.21.15.45:0/532428756 shutdown_connections 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- 172.21.15.45:0/532428756 >> v2:172.21.15.192:3300/0 conn(0x7ffb1406d310 0x7ffb14142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- 172.21.15.45:0/532428756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406f9c0 0x7ffb140af770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- 172.21.15.45:0/532428756 >> 172.21.15.45:0/532428756 conn(0x7ffb140b1870 msgr2=0x7ffb140b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- 172.21.15.45:0/532428756 shutdown_connections 2023-06-23T01:21:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- 172.21.15.45:0/532428756 wait complete. 2023-06-23T01:21:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 Processor -- start 2023-06-23T01:21:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- start start 2023-06-23T01:21:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 0x7ffb140ae520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 0x7ffb1414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb1406f9c0 0x7ffb14152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414fae0 con 0x7ffb1406ea90 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb140a4ec0 con 0x7ffb1406d310 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1359e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1414f700 con 0x7ffb1406f9c0 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb11d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 0x7ffb1414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb11d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 0x7ffb1414ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47066/0 (socket says 172.21.15.45:47066) 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb11d9b700 1 -- 172.21.15.45:0/2506601993 learned_addr learned my addr 172.21.15.45:0/2506601993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.862+0000 7ffb1259c700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 0x7ffb140ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb12d9d700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb1406f9c0 0x7ffb14152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 -- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb1406f9c0 msgr2=0x7ffb14152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb1406f9c0 0x7ffb14152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 -- 172.21.15.45:0/2506601993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 msgr2=0x7ffb1414ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 0x7ffb1414ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 -- 172.21.15.45:0/2506601993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009ae0 con 0x7ffb1406d310 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1259c700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 0x7ffb140ae520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb04014000 tx=0x7ffb04017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:54.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04012af0 con 0x7ffb1406d310 2023-06-23T01:21:54.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04012c70 con 0x7ffb1406d310 2023-06-23T01:21:54.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb140aeb90 con 0x7ffb1406d310 2023-06-23T01:21:54.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0401d420 con 0x7ffb1406d310 2023-06-23T01:21:54.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb140ab3d0 con 0x7ffb1406d310 2023-06-23T01:21:54.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb140ab5c0 con 0x7ffb1406d310 2023-06-23T01:21:54.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7ffb0401d790 con 0x7ffb1406d310 2023-06-23T01:21:54.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 0x7ffaf4062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:54.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.866+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ffb0407db90 con 0x7ffb1406d310 2023-06-23T01:21:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.874+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7ffb0404e390 con 0x7ffb1406d310 2023-06-23T01:21:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.882+0000 7ffb11d9b700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 0x7ffaf4062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:54.882+0000 7ffb11d9b700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 0x7ffaf4062990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb14144460 tx=0x7ffafc0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.038+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb1404bc30 con 0x7ffb1406d310 2023-06-23T01:21:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.038+0000 7ffb0a7fc700 1 -- 172.21.15.45:0/2506601993 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13660 (secure 0 0 0) 0x7ffb0402a090 con 0x7ffb1406d310 2023-06-23T01:21:55.045 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:55.045 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:54.719356+0000","last_up_change":"2023-06-23T01:21:52.712540+0000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T01:21:52.030176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T01:21:53.384459+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":32676},{"type":"v1","addr":"172.21.15.45:6817","nonce":32676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":32676},{"type":"v1","addr":"172.21.15.45:6819","nonce":32676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":32676},{"type":"v1","addr":"172.21.15.45:6823","nonce":32676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":32676},{"type":"v1","addr":"172.21.15.45:6821","nonce":32676}]},"public_addr":"172.21.15.45:6817/32676","cluster_addr":"172.21.15.45:6819/32676","heartbeat_back_addr":"172.21.15.45:6823/32676","heartbeat_front_addr":"172.21.15.45:6821/32676","state":["exists","up"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":32675},{"type":"v1","addr":"172.21.15.45:6801","nonce":32675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":32675},{"type":"v1","addr":"172.21.15.45:6803","nonce":32675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":32675},{"type":"v1","addr":"172.21.15.45:6807","nonce":32675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":32675},{"type":"v1","addr":"172.21.15.45:6805","nonce":32675}]},"public_addr":"172.21.15.45:6801/32675","cluster_addr":"172.21.15.45:6803/32675","heartbeat_back_addr":"172.21.15.45:6807/32675","heartbeat_front_addr":"172.21.15.45:6805/32675","state":["exists","up"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":32677},{"type":"v1","addr":"172.21.15.45:6825","nonce":32677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":32677},{"type":"v1","addr":"172.21.15.45:6827","nonce":32677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":32677},{"type":"v1","addr":"172.21.15.45:6831","nonce":32677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":32677},{"type":"v1","addr":"172.21.15.45:6829","nonce":32677}]},"public_addr":"172.21.15.45:6825/32677","cluster_addr":"172.21.15.45:6827/32677","heartbeat_back_addr":"172.21.15.45:6831/32677","heartbeat_front_addr":"172.21.15.45:6829/32677","state":["exists","up"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":32678},{"type":"v1","addr":"172.21.15.45:6809","nonce":32678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":32678},{"type":"v1","addr":"172.21.15.45:6811","nonce":32678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":32678},{"type":"v1","addr":"172.21.15.45:6815","nonce":32678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":32678},{"type":"v1","addr":"172.21.15.45:6813","nonce":32678}]},"public_addr":"172.21.15.45:6809/32678","cluster_addr":"172.21.15.45:6811/32678","heartbeat_back_addr":"172.21.15.45:6815/32678","heartbeat_front_addr":"172.21.15.45:6813/32678","state":["exists","up"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":32949},{"type":"v1","addr":"172.21.15.192:6809","nonce":32949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":32949},{"type":"v1","addr":"172.21.15.192:6811","nonce":32949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":32949},{"type":"v1","addr":"172.21.15.192:6815","nonce":32949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":32949},{"type":"v1","addr":"172.21.15.192:6813","nonce":32949}]},"public_addr":"172.21.15.192:6809/32949","cluster_addr":"172.21.15.192:6811/32949","heartbeat_back_addr":"172.21.15.192:6815/32949","heartbeat_front_addr":"172.21.15.192:6813/32949","state":["exists","up"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":32950},{"type":"v1","addr":"172.21.15.192:6825","nonce":32950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":32950},{"type":"v1","addr":"172.21.15.192:6827","nonce":32950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":32950},{"type":"v1","addr":"172.21.15.192:6831","nonce":32950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":32950},{"type":"v1","addr":"172.21.15.192:6829","nonce":32950}]},"public_addr":"172.21.15.192:6825/32950","cluster_addr":"172.21.15.192:6827/32950","heartbeat_back_addr":"172.21.15.192:6831/32950","heartbeat_front_addr":"172.21.15.192:6829/32950","state":["exists","up"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":32948},{"type":"v1","addr":"172.21.15.192:6801","nonce":32948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":32948},{"type":"v1","addr":"172.21.15.192:6803","nonce":32948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":32948},{"type":"v1","addr":"172.21.15.192:6807","nonce":32948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":32948},{"type":"v1","addr":"172.21.15.192:6805","nonce":32948}]},"public_addr":"172.21.15.192:6801/32948","cluster_addr":"172.21.15.192:6803/32948","heartbeat_back_addr":"172.21.15.192:6807/32948","heartbeat_front_addr":"172.21.15.192:6805/32948","state":["exists","up"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":32951},{"type":"v1","addr":"172.21.15.192:6817","nonce":32951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":32951},{"type":"v1","addr":"172.21.15.192:6819","nonce":32951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":32951},{"type":"v1","addr":"172.21.15.192:6823","nonce":32951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":32951},{"type":"v1","addr":"172.21.15.192:6821","nonce":32951}]},"public_addr":"172.21.15.192:6817/32951","cluster_addr":"172.21.15.192:6819/32951","heartbeat_back_addr":"172.21.15.192:6823/32951","heartbeat_front_addr":"172.21.15.192:6821/32951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.186110+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.065375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.238884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.049003+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.975748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.223214+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.782478+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.752980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:55.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 msgr2=0x7ffaf4062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 0x7ffaf4062990 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb14144460 tx=0x7ffafc0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 msgr2=0x7ffb140ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 0x7ffb140ae520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ffb04014000 tx=0x7ffb04017000 comp rx=0 tx=0).stop 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 shutdown_connections 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ffaf40604e0 0x7ffaf4062990 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ffb1406f9c0 0x7ffb14152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb1406ea90 0x7ffb1414ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 --2- 172.21.15.45:0/2506601993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb1406d310 0x7ffb140ae520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 >> 172.21.15.45:0/2506601993 conn(0x7ffb140b1870 msgr2=0x7ffb140b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 shutdown_connections 2023-06-23T01:21:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.042+0000 7ffb1359e700 1 -- 172.21.15.45:0/2506601993 wait complete. 2023-06-23T01:21:55.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T01:21:52.030176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T01:21:53.384459+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-23T01:21:55.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T01:21:55.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 Processor -- start 2023-06-23T01:21:55.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 -- start start 2023-06-23T01:21:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f46ec0b0e50 0x7f46ec13eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46ec13f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ec087280 con 0x7f46ec0b0a80 2023-06-23T01:21:55.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ec141f60 con 0x7f46ec0b0e50 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f107e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec142150 con 0x7f46ec0afd70 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46ebfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f46ec0b0a80 0x7f46ec0b3300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58744/0 (socket says 172.21.15.45:58744) 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46ebfff700 1 -- 172.21.15.45:0/1314582011 learned_addr learned my addr 172.21.15.45:0/1314582011 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f087d700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46ec13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977824191 0 0) 0x7f46ec087280 con 0x7f46ec0b0a80 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46d8003570 con 0x7f46ec0b0a80 2023-06-23T01:21:55.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eb7fe700 1 --2- 172.21.15.45:0/1314582011 >> v2:172.21.15.192:3300/0 conn(0x7f46ec0b0e50 0x7f46ec13eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403277915 0 0) 0x7f46d8003570 con 0x7f46ec0b0a80 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 msgr2=0x7f46ec13f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46ec13f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 >> v2:172.21.15.192:3300/0 conn(0x7f46ec0b0e50 msgr2=0x7f46ec13eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 --2- 172.21.15.45:0/1314582011 >> v2:172.21.15.192:3300/0 conn(0x7f46ec0b0e50 0x7f46ec13eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec142430 con 0x7f46ec0b0a80 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f46dc001470 con 0x7f46ec0b0a80 2023-06-23T01:21:55.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 >> v1:172.21.15.45:6789/0 conn(0x7f46ec0b0a80 legacy=0x7f46ec0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46d8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46d8003fe0 0x7f46d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec142150 con 0x7f46d8003fe0 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46d800bb70 con 0x7f46d8004d50 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46d800bd30 con 0x7f46ec0afd70 2023-06-23T01:21:55.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46ebfff700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46d8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46eb7fe700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46d8003fe0 0x7f46d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.154+0000 7f46f087d700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 -- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d8004d50 msgr2=0x7f46d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46d8004d50 0x7f46d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 -- 172.21.15.45:0/1314582011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46d8003fe0 msgr2=0x7f46d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46d8003fe0 0x7f46d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 -- 172.21.15.45:0/1314582011 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8003570 con 0x7f46ec0afd70 2023-06-23T01:21:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46ebfff700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46d8003a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c390 tx=0x7f46dc001e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d5fdc28eb62c70 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00cc60 con 0x7f46ec0afd70 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00cde0 con 0x7f46ec0afd70 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46eaffd700 1 -- 172.21.15.45:0/1314582011 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc005b70 con 0x7f46ec0afd70 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 msgr2=0x7f46d8003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 --2- 172.21.15.45:0/1314582011 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec0afd70 0x7f46d8003a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f46dc00c390 tx=0x7f46dc001e90 comp rx=0 tx=0).stop 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f087d700 1 -- 172.21.15.45:0/1314582011 reap_dead start 2023-06-23T01:21:55.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- 172.21.15.45:0/1314582011 shutdown_connections 2023-06-23T01:21:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- 172.21.15.45:0/1314582011 >> 172.21.15.45:0/1314582011 conn(0x7f46ec06e600 msgr2=0x7f46ec06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- 172.21.15.45:0/1314582011 shutdown_connections 2023-06-23T01:21:55.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- 172.21.15.45:0/1314582011 wait complete. 2023-06-23T01:21:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 Processor -- start 2023-06-23T01:21:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.158+0000 7f46f107e700 1 -- start start 2023-06-23T01:21:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec0a4950 0x7f46ec155c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec149690 0x7f46ec0af240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0a7390 con 0x7f46ec1492c0 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0a6750 con 0x7f46ec0a4950 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ec0a7570 con 0x7f46ec149690 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47080/0 (socket says 172.21.15.45:47080) 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 -- 172.21.15.45:0/467817272 learned_addr learned my addr 172.21.15.45:0/467817272 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46eb7fe700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec0a4950 0x7f46ec155c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f087d700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec149690 0x7f46ec0af240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 -- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec149690 msgr2=0x7f46ec0af240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec149690 0x7f46ec0af240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 -- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec0a4950 msgr2=0x7f46ec155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec0a4950 0x7f46ec155c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 -- 172.21.15.45:0/467817272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ec1561d0 con 0x7f46ec1492c0 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46ebfff700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bec0 tx=0x7f46dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc022070 con 0x7f46ec1492c0 2023-06-23T01:21:55.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00cc60 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ec155490 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc007300 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ec144770 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.162+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ec155910 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.166+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f46dc0076b0 con 0x7f46ec1492c0 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.166+0000 7f46e3fff700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 0x7f46cc062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.166+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f46dc07d5d0 con 0x7f46ec1492c0 2023-06-23T01:21:55.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.166+0000 7f46eb7fe700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 0x7f46cc062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.166+0000 7f46eb7fe700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 0x7f46cc062990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f46ec144d70 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.174+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f46dc04de70 con 0x7f46ec1492c0 2023-06-23T01:21:55.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.334+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f46ec144960 con 0x7f46ec1492c0 2023-06-23T01:21:55.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.334+0000 7f46e3fff700 1 -- 172.21.15.45:0/467817272 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f46dc0170a0 con 0x7f46ec1492c0 2023-06-23T01:21:55.340 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-06-23T01:21:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 msgr2=0x7f46cc062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 0x7f46cc062990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f46ec144d70 tx=0x7f46d4008040 comp rx=0 tx=0).stop 2023-06-23T01:21:55.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 msgr2=0x7f46ec0a6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bec0 tx=0x7f46dc015000 comp rx=0 tx=0).stop 2023-06-23T01:21:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 shutdown_connections 2023-06-23T01:21:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f46cc0604e0 0x7f46cc062990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f46ec0a4950 0x7f46ec155c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f46ec149690 0x7f46ec0af240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 --2- 172.21.15.45:0/467817272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f46ec1492c0 0x7f46ec0a6130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 >> 172.21.15.45:0/467817272 conn(0x7f46ec06e600 msgr2=0x7f46ec13e140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 shutdown_connections 2023-06-23T01:21:55.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.338+0000 7f46f107e700 1 -- 172.21.15.45:0/467817272 wait complete. 2023-06-23T01:21:55.355 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T01:21:55.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 Processor -- start 2023-06-23T01:21:55.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 -- start start 2023-06-23T01:21:55.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feafc0b0a80 0x7feafc0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc087280 con 0x7feafc0b0e50 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feafc146380 con 0x7feafc0afd70 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb02618700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feafc141f60 con 0x7feafc0b0a80 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feafc0b0e50 0x7feafc145560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58748/0 (socket says 172.21.15.45:58748) 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 -- 172.21.15.45:0/1681806012 learned_addr learned my addr 172.21.15.45:0/1681806012 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:55.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb01616700 1 --2- 172.21.15.45:0/1681806012 >> v2:172.21.15.192:3300/0 conn(0x7feafc0b0a80 0x7feafc0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432310421 0 0) 0x7feafc087280 con 0x7feafc0b0e50 2023-06-23T01:21:55.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feae8003570 con 0x7feafc0b0e50 2023-06-23T01:21:55.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529222585 0 0) 0x7feae8003570 con 0x7feafc0b0e50 2023-06-23T01:21:55.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 >> v2:172.21.15.192:3300/0 conn(0x7feafc0b0a80 msgr2=0x7feafc0b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 --2- 172.21.15.45:0/1681806012 >> v2:172.21.15.192:3300/0 conn(0x7feafc0b0a80 0x7feafc0b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 >> v1:172.21.15.192:6789/0 conn(0x7feafc0afd70 legacy=0x7feafc145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0b3840 con 0x7feafc0b0e50 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7feaf8001470 con 0x7feafc0b0e50 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 >> v1:172.21.15.45:6789/0 conn(0x7feafc0b0e50 legacy=0x7feafc145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feae8003a60 0x7feae8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feae8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80052e0 0x7feae800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae800c270 con 0x7feae80052e0 2023-06-23T01:21:55.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feae800c3e0 con 0x7feae8004810 2023-06-23T01:21:55.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feae800c5a0 con 0x7feae8003a60 2023-06-23T01:21:55.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb01e17700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80052e0 0x7feae800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feae8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb01616700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feae8003a60 0x7feae8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 -- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feae8003a60 msgr2=0x7feae8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feae8003a60 0x7feae8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 -- 172.21.15.45:0/1681806012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80052e0 msgr2=0x7feae800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80052e0 0x7feae800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 -- 172.21.15.45:0/1681806012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae8003570 con 0x7feae8004810 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb01e17700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feae80052e0 0x7feae800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb01e17700 1 -- 172.21.15.45:0/1681806012 reap_dead start 2023-06-23T01:21:55.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feb00e15700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feae8004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c390 tx=0x7feafc0b39d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf500077dd60efd4 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800cc60 con 0x7feae8004810 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800cdc0 con 0x7feae8004810 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.466+0000 7feaf3fff700 1 -- 172.21.15.45:0/1681806012 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8005b70 con 0x7feae8004810 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 msgr2=0x7feae8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feae8004c80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7feaf800c390 tx=0x7feafc0b39d0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- 172.21.15.45:0/1681806012 shutdown_connections 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 --2- 172.21.15.45:0/1681806012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feae8004c80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- 172.21.15.45:0/1681806012 >> 172.21.15.45:0/1681806012 conn(0x7feafc06e600 msgr2=0x7feafc06e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- 172.21.15.45:0/1681806012 shutdown_connections 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- 172.21.15.45:0/1681806012 wait complete. 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 Processor -- start 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- start start 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feafc0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feafc151c40 0x7feafc0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc152110 con 0x7feafc0a5f80 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feafc1523f0 con 0x7feae8004810 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb02618700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feafc0a4b70 con 0x7feafc151c40 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47088/0 (socket says 172.21.15.45:47088) 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01616700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feafc0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 -- 172.21.15.45:0/71236301 learned_addr learned my addr 172.21.15.45:0/71236301 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:55.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb00e15700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feafc151c40 0x7feafc0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 -- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feafc151c40 msgr2=0x7feafc0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feafc151c40 0x7feafc0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 -- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 msgr2=0x7feafc0a5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feafc0a5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.470+0000 7feb01e17700 1 -- 172.21.15.45:0/71236301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0a4d30 con 0x7feafc0a5f80 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feb01e17700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feafc0b5c30 tx=0x7feaf4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400d8f0 con 0x7feafc0a5f80 2023-06-23T01:21:55.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf400da50 con 0x7feafc0a5f80 2023-06-23T01:21:55.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feafc0a6840 con 0x7feafc0a5f80 2023-06-23T01:21:55.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf400de10 con 0x7feafc0a5f80 2023-06-23T01:21:55.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feafc0a6c90 con 0x7feafc0a5f80 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feafc152630 con 0x7feafc0a5f80 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7feaf4003030 con 0x7feafc0a5f80 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 0x7feae0062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7feaf407cd30 con 0x7feafc0a5f80 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.474+0000 7feb01616700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 0x7feae0062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.478+0000 7feb01616700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 0x7feae0062990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feaec006f00 tx=0x7feaec0091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.482+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7feaf404d650 con 0x7feafc0a5f80 2023-06-23T01:21:55.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.638+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7feafc152630 con 0x7feafc0a5f80 2023-06-23T01:21:55.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feaf17fa700 1 -- 172.21.15.45:0/71236301 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7feafc152630 con 0x7feafc0a5f80 2023-06-23T01:21:55.647 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-06-23T01:21:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 msgr2=0x7feae0062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 0x7feae0062990 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feaec006f00 tx=0x7feaec0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 msgr2=0x7feafc0af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feafc0b5c30 tx=0x7feaf4009040 comp rx=0 tx=0).stop 2023-06-23T01:21:55.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 shutdown_connections 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7feae00604e0 0x7feae0062990 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feafc0a5f80 0x7feafc0af430 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7feafc151c40 0x7feafc0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 --2- 172.21.15.45:0/71236301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feae8004810 0x7feafc0a5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 >> 172.21.15.45:0/71236301 conn(0x7feafc06e600 msgr2=0x7feafc063100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 shutdown_connections 2023-06-23T01:21:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.642+0000 7feb02618700 1 -- 172.21.15.45:0/71236301 wait complete. 2023-06-23T01:21:55.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-23T01:21:55.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.758+0000 7f2ada495700 1 Processor -- start 2023-06-23T01:21:55.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.758+0000 7f2ada495700 1 -- start start 2023-06-23T01:21:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 0x7f2ad4141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad406d210 con 0x7f2ad41424f0 2023-06-23T01:21:55.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad4067cf0 con 0x7f2ad40b1060 2023-06-23T01:21:55.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b1540 con 0x7f2ad406f9c0 2023-06-23T01:21:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9c94700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2ad41424f0 0x7f2ad40675e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58764/0 (socket says 172.21.15.45:58764) 2023-06-23T01:21:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9c94700 1 -- 172.21.15.45:0/3430891323 learned_addr learned my addr 172.21.15.45:0/3430891323 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9493700 1 --2- 172.21.15.45:0/3430891323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 0x7f2ad4141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057713404 0 0) 0x7f2ad406d210 con 0x7f2ad41424f0 2023-06-23T01:21:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003570 con 0x7f2ad41424f0 2023-06-23T01:21:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841197115 0 0) 0x7f2ad4067cf0 con 0x7f2ad40b1060 2023-06-23T01:21:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad406d210 con 0x7f2ad40b1060 2023-06-23T01:21:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4024475741 0 0) 0x7f2ac0003570 con 0x7f2ad41424f0 2023-06-23T01:21:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9493700 1 -- 172.21.15.45:0/3430891323 >> v1:172.21.15.192:6789/0 conn(0x7f2ad40b1060 legacy=0x7f2ad4066ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9493700 1 -- 172.21.15.45:0/3430891323 >> v1:172.21.15.45:6789/0 conn(0x7f2ad41424f0 legacy=0x7f2ad40675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9493700 1 -- 172.21.15.45:0/3430891323 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad406d4f0 con 0x7f2ad406f9c0 2023-06-23T01:21:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ad9493700 1 --2- 172.21.15.45:0/3430891323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 0x7f2ad4141fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009900 tx=0x7f2ac4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a57eae5c29da318a server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc001810 con 0x7f2ad406f9c0 2023-06-23T01:21:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4011420 con 0x7f2ad406f9c0 2023-06-23T01:21:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2acbfff700 1 -- 172.21.15.45:0/3430891323 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac40117c0 con 0x7f2ad406f9c0 2023-06-23T01:21:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- 172.21.15.45:0/3430891323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 msgr2=0x7f2ad4141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 --2- 172.21.15.45:0/3430891323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 0x7f2ad4141fb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009900 tx=0x7f2ac4009120 comp rx=0 tx=0).stop 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- 172.21.15.45:0/3430891323 shutdown_connections 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 --2- 172.21.15.45:0/3430891323 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad406f9c0 0x7f2ad4141fb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- 172.21.15.45:0/3430891323 >> 172.21.15.45:0/3430891323 conn(0x7f2ad40b1870 msgr2=0x7f2ad40b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- 172.21.15.45:0/3430891323 shutdown_connections 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.762+0000 7f2ada495700 1 -- 172.21.15.45:0/3430891323 wait complete. 2023-06-23T01:21:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 Processor -- start 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- start start 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ad406f9c0 0x7f2ad411d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad40b1060 0x7f2ad4151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4151b50 con 0x7f2ad41424f0 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad411f170 con 0x7f2ad406f9c0 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad411d910 con 0x7f2ad40b1060 2023-06-23T01:21:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47102/0 (socket says 172.21.15.45:47102) 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 -- 172.21.15.45:0/2046732960 learned_addr learned my addr 172.21.15.45:0/2046732960 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9493700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ad406f9c0 0x7f2ad411d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad8c92700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad40b1060 0x7f2ad4151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 -- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad40b1060 msgr2=0x7f2ad4151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad40b1060 0x7f2ad4151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 -- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ad406f9c0 msgr2=0x7f2ad411d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ad406f9c0 0x7f2ad411d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 -- 172.21.15.45:0/2046732960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac40093c0 con 0x7f2ad41424f0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ad9c94700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cb90 tx=0x7f2acc007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc004dc0 con 0x7f2ad41424f0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc007150 con 0x7f2ad41424f0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40aea60 con 0x7f2ad41424f0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc007510 con 0x7f2ad41424f0 2023-06-23T01:21:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.766+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad411ced0 con 0x7f2ad41424f0 2023-06-23T01:21:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.770+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad4151d00 con 0x7f2ad41424f0 2023-06-23T01:21:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.770+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f2acc0078c0 con 0x7f2ad41424f0 2023-06-23T01:21:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.770+0000 7f2ac97fa700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 0x7f2ab8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.770+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2acc07bb40 con 0x7f2ad41424f0 2023-06-23T01:21:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.770+0000 7f2ad9493700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 0x7f2ab8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.774+0000 7f2ad9493700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 0x7f2ab8062960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009850 tx=0x7f2ac4016000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.778+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f2ad4151d00 con 0x7f2ad41424f0 2023-06-23T01:21:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.974+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ad4151d00 con 0x7f2ad41424f0 2023-06-23T01:21:55.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.974+0000 7f2ac97fa700 1 -- 172.21.15.45:0/2046732960 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2015 (secure 0 0 0) 0x7f2ad4151d00 con 0x7f2ad41424f0 2023-06-23T01:21:55.983 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:55.983 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4285,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6833/4151410138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":4151410138},{"type":"v1","addr":"172.21.15.45:6833","nonce":4151410138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/2245614397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2245614397},{"type":"v1","addr":"172.21.15.192:6835","nonce":2245614397}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-06-23T01:21:55.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 msgr2=0x7f2ab8062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 0x7f2ab8062960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009850 tx=0x7f2ac4016000 comp rx=0 tx=0).stop 2023-06-23T01:21:55.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 msgr2=0x7f2ad4152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2acc00cb90 tx=0x7f2acc007c70 comp rx=0 tx=0).stop 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 shutdown_connections 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2ab80604b0 0x7f2ab8062960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ad41424f0 0x7f2ad4152520 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2ad40b1060 0x7f2ad4151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 --2- 172.21.15.45:0/2046732960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ad406f9c0 0x7f2ad411d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:55.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 >> 172.21.15.45:0/2046732960 conn(0x7f2ad40b1870 msgr2=0x7f2ad4067620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:55.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 shutdown_connections 2023-06-23T01:21:55.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:55.978+0000 7f2ada495700 1 -- 172.21.15.45:0/2046732960 wait complete. 2023-06-23T01:21:55.986 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-06-23T01:21:55.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 Processor -- start 2023-06-23T01:21:56.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 -- start start 2023-06-23T01:21:56.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff46c0ab960 0x7ff46c0a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff46c0abd30 0x7ff46c0ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0ae380 con 0x7ff46c0aedf0 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0adc80 con 0x7ff46c0abd30 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff472b9c700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46c0b02d0 con 0x7ff46c0ab960 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff471399700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff46c0abd30 0x7ff46c0ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff47239b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff46c0aedf0 0x7ff46c0af230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58774/0 (socket says 172.21.15.45:58774) 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff47239b700 1 -- 172.21.15.45:0/1798878681 learned_addr learned my addr 172.21.15.45:0/1798878681 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.098+0000 7ff471b9a700 1 --2- 172.21.15.45:0/1798878681 >> v2:172.21.15.192:3300/0 conn(0x7ff46c0ab960 0x7ff46c0a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff471399700 1 -- 172.21.15.45:0/1798878681 >> v2:172.21.15.192:3300/0 conn(0x7ff46c0ab960 msgr2=0x7ff46c0a83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:56.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff471399700 1 --2- 172.21.15.45:0/1798878681 >> v2:172.21.15.192:3300/0 conn(0x7ff46c0ab960 0x7ff46c0a83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff471399700 1 -- 172.21.15.45:0/1798878681 >> v1:172.21.15.45:6789/0 conn(0x7ff46c0aedf0 legacy=0x7ff46c0af230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff471399700 1 -- 172.21.15.45:0/1798878681 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0ad610 con 0x7ff46c0abd30 2023-06-23T01:21:56.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff471399700 1 --2- 172.21.15.45:0/1798878681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0abd30 0x7ff46c0ad0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff46c06a270 tx=0x7ff45c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b09b4976037d6074 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff470b98700 1 -- 172.21.15.45:0/1798878681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011630 con 0x7ff46c0abd30 2023-06-23T01:21:56.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff470b98700 1 -- 172.21.15.45:0/1798878681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c011790 con 0x7ff46c0abd30 2023-06-23T01:21:56.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff470b98700 1 -- 172.21.15.45:0/1798878681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c011b30 con 0x7ff46c0abd30 2023-06-23T01:21:56.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- 172.21.15.45:0/1798878681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0abd30 msgr2=0x7ff46c0ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 --2- 172.21.15.45:0/1798878681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0abd30 0x7ff46c0ad0d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff46c06a270 tx=0x7ff45c0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- 172.21.15.45:0/1798878681 shutdown_connections 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 --2- 172.21.15.45:0/1798878681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0abd30 0x7ff46c0ad0d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 --2- 172.21.15.45:0/1798878681 >> v2:172.21.15.192:3300/0 conn(0x7ff46c0ab960 0x7ff46c0a83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- 172.21.15.45:0/1798878681 >> 172.21.15.45:0/1798878681 conn(0x7ff46c067970 msgr2=0x7ff46c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- 172.21.15.45:0/1798878681 shutdown_connections 2023-06-23T01:21:56.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- 172.21.15.45:0/1798878681 wait complete. 2023-06-23T01:21:56.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 Processor -- start 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.102+0000 7ff472b9c700 1 -- start start 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff46c0ab960 0x7ff46c144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff46c0abd30 0x7ff46c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0a53f0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c140000 con 0x7ff46c0ab960 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0a5df0 con 0x7ff46c0abd30 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff471b9a700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff46c0ab960 0x7ff46c144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff471399700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff46c0abd30 0x7ff46c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47112/0 (socket says 172.21.15.45:47112) 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 -- 172.21.15.45:0/2174760061 learned_addr learned my addr 172.21.15.45:0/2174760061 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 -- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff46c0abd30 msgr2=0x7ff46c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff46c0abd30 0x7ff46c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 -- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff46c0ab960 msgr2=0x7ff46c144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff46c0ab960 0x7ff46c144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 -- 172.21.15.45:0/2174760061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009420 con 0x7ff46c0aedf0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff47239b700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff46400cbf0 tx=0x7ff4640019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400a870 con 0x7ff46c0aedf0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400a9d0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c13fd20 con 0x7ff46c0aedf0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400ad50 con 0x7ff46c0aedf0 2023-06-23T01:21:56.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.106+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c0a6530 con 0x7ff46c0aedf0 2023-06-23T01:21:56.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c0a55a0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7ff464007300 con 0x7ff46c0aedf0 2023-06-23T01:21:56.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff461ffb700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 0x7ff450062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff46407c6d0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff471b9a700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 0x7ff450062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.110+0000 7ff471b9a700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 0x7ff450062960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff468009db0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.118+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7ff46c0a55a0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.278+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff46c0a55a0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.282+0000 7ff461ffb700 1 -- 172.21.15.45:0/2174760061 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13647 (secure 0 0 0) 0x7ff46c0a55a0 con 0x7ff46c0aedf0 2023-06-23T01:21:56.288 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:56.289 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:55.721995+0000","last_up_change":"2023-06-23T01:21:52.712540+0000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T01:21:52.030176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T01:21:53.384459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":32676},{"type":"v1","addr":"172.21.15.45:6817","nonce":32676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":32676},{"type":"v1","addr":"172.21.15.45:6819","nonce":32676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":32676},{"type":"v1","addr":"172.21.15.45:6823","nonce":32676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":32676},{"type":"v1","addr":"172.21.15.45:6821","nonce":32676}]},"public_addr":"172.21.15.45:6817/32676","cluster_addr":"172.21.15.45:6819/32676","heartbeat_back_addr":"172.21.15.45:6823/32676","heartbeat_front_addr":"172.21.15.45:6821/32676","state":["exists","up"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":32675},{"type":"v1","addr":"172.21.15.45:6801","nonce":32675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":32675},{"type":"v1","addr":"172.21.15.45:6803","nonce":32675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":32675},{"type":"v1","addr":"172.21.15.45:6807","nonce":32675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":32675},{"type":"v1","addr":"172.21.15.45:6805","nonce":32675}]},"public_addr":"172.21.15.45:6801/32675","cluster_addr":"172.21.15.45:6803/32675","heartbeat_back_addr":"172.21.15.45:6807/32675","heartbeat_front_addr":"172.21.15.45:6805/32675","state":["exists","up"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":32677},{"type":"v1","addr":"172.21.15.45:6825","nonce":32677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":32677},{"type":"v1","addr":"172.21.15.45:6827","nonce":32677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":32677},{"type":"v1","addr":"172.21.15.45:6831","nonce":32677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":32677},{"type":"v1","addr":"172.21.15.45:6829","nonce":32677}]},"public_addr":"172.21.15.45:6825/32677","cluster_addr":"172.21.15.45:6827/32677","heartbeat_back_addr":"172.21.15.45:6831/32677","heartbeat_front_addr":"172.21.15.45:6829/32677","state":["exists","up"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":32678},{"type":"v1","addr":"172.21.15.45:6809","nonce":32678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":32678},{"type":"v1","addr":"172.21.15.45:6811","nonce":32678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":32678},{"type":"v1","addr":"172.21.15.45:6815","nonce":32678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":32678},{"type":"v1","addr":"172.21.15.45:6813","nonce":32678}]},"public_addr":"172.21.15.45:6809/32678","cluster_addr":"172.21.15.45:6811/32678","heartbeat_back_addr":"172.21.15.45:6815/32678","heartbeat_front_addr":"172.21.15.45:6813/32678","state":["exists","up"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":32949},{"type":"v1","addr":"172.21.15.192:6809","nonce":32949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":32949},{"type":"v1","addr":"172.21.15.192:6811","nonce":32949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":32949},{"type":"v1","addr":"172.21.15.192:6815","nonce":32949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":32949},{"type":"v1","addr":"172.21.15.192:6813","nonce":32949}]},"public_addr":"172.21.15.192:6809/32949","cluster_addr":"172.21.15.192:6811/32949","heartbeat_back_addr":"172.21.15.192:6815/32949","heartbeat_front_addr":"172.21.15.192:6813/32949","state":["exists","up"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":32950},{"type":"v1","addr":"172.21.15.192:6825","nonce":32950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":32950},{"type":"v1","addr":"172.21.15.192:6827","nonce":32950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":32950},{"type":"v1","addr":"172.21.15.192:6831","nonce":32950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":32950},{"type":"v1","addr":"172.21.15.192:6829","nonce":32950}]},"public_addr":"172.21.15.192:6825/32950","cluster_addr":"172.21.15.192:6827/32950","heartbeat_back_addr":"172.21.15.192:6831/32950","heartbeat_front_addr":"172.21.15.192:6829/32950","state":["exists","up"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":32948},{"type":"v1","addr":"172.21.15.192:6801","nonce":32948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":32948},{"type":"v1","addr":"172.21.15.192:6803","nonce":32948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":32948},{"type":"v1","addr":"172.21.15.192:6807","nonce":32948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":32948},{"type":"v1","addr":"172.21.15.192:6805","nonce":32948}]},"public_addr":"172.21.15.192:6801/32948","cluster_addr":"172.21.15.192:6803/32948","heartbeat_back_addr":"172.21.15.192:6807/32948","heartbeat_front_addr":"172.21.15.192:6805/32948","state":["exists","up"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":32951},{"type":"v1","addr":"172.21.15.192:6817","nonce":32951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":32951},{"type":"v1","addr":"172.21.15.192:6819","nonce":32951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":32951},{"type":"v1","addr":"172.21.15.192:6823","nonce":32951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":32951},{"type":"v1","addr":"172.21.15.192:6821","nonce":32951}]},"public_addr":"172.21.15.192:6817/32951","cluster_addr":"172.21.15.192:6819/32951","heartbeat_back_addr":"172.21.15.192:6823/32951","heartbeat_front_addr":"172.21.15.192:6821/32951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.186110+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.065375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.238884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.049003+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.975748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.223214+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.782478+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.752980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:56.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.282+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 msgr2=0x7ff450062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 0x7ff450062960 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff468009db0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 msgr2=0x7ff46c1461b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff46400cbf0 tx=0x7ff4640019c0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 shutdown_connections 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff4500604b0 0x7ff450062960 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff46c0aedf0 0x7ff46c1461b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff46c0abd30 0x7ff46c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 --2- 172.21.15.45:0/2174760061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff46c0ab960 0x7ff46c144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 >> 172.21.15.45:0/2174760061 conn(0x7ff46c067970 msgr2=0x7ff46c147d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 shutdown_connections 2023-06-23T01:21:56.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.286+0000 7ff472b9c700 1 -- 172.21.15.45:0/2174760061 wait complete. 2023-06-23T01:21:56.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-23T01:21:52.030176+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-23T01:21:53.384459+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-06-23T01:21:56.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-23T01:21:56.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.406+0000 7f8251da9700 1 Processor -- start 2023-06-23T01:21:56.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.406+0000 7f8251da9700 1 -- start start 2023-06-23T01:21:56.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f824c0b4ec0 0x7f824c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f824c13f040 0x7f824c13f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c0b0d00 con 0x7f824c1423a0 2023-06-23T01:21:56.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c0ade30 con 0x7f824c13f040 2023-06-23T01:21:56.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c13f9e0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f824c13f040 0x7f824c13f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f824c13f040 0x7f824c13f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47120/0 (socket says 172.21.15.45:47120) 2023-06-23T01:21:56.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 -- 172.21.15.45:0/680168377 learned_addr learned my addr 172.21.15.45:0/680168377 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:56.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8250da7700 1 --2- 172.21.15.45:0/680168377 >> v2:172.21.15.192:3300/0 conn(0x7f824c0b4ec0 0x7f824c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 -- 172.21.15.45:0/680168377 >> v2:172.21.15.192:3300/0 conn(0x7f824c0b4ec0 msgr2=0x7f824c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:56.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 --2- 172.21.15.45:0/680168377 >> v2:172.21.15.192:3300/0 conn(0x7f824c0b4ec0 0x7f824c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 -- 172.21.15.45:0/680168377 >> v1:172.21.15.192:6789/0 conn(0x7f824c1423a0 legacy=0x7f824c142800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 -- 172.21.15.45:0/680168377 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c06b910 con 0x7f824c13f040 2023-06-23T01:21:56.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824bfff700 1 --2- 172.21.15.45:0/680168377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c13f040 0x7f824c13f4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f824c062990 tx=0x7f8234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80073220b0bf7b0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824b7fe700 1 -- 172.21.15.45:0/680168377 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8234009e70 con 0x7f824c13f040 2023-06-23T01:21:56.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824b7fe700 1 -- 172.21.15.45:0/680168377 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823400b860 con 0x7f824c13f040 2023-06-23T01:21:56.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f824b7fe700 1 -- 172.21.15.45:0/680168377 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823400bc00 con 0x7f824c13f040 2023-06-23T01:21:56.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- 172.21.15.45:0/680168377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c13f040 msgr2=0x7f824c13f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 --2- 172.21.15.45:0/680168377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c13f040 0x7f824c13f4a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f824c062990 tx=0x7f8234009250 comp rx=0 tx=0).stop 2023-06-23T01:21:56.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- 172.21.15.45:0/680168377 shutdown_connections 2023-06-23T01:21:56.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 --2- 172.21.15.45:0/680168377 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c13f040 0x7f824c13f4a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 --2- 172.21.15.45:0/680168377 >> v2:172.21.15.192:3300/0 conn(0x7f824c0b4ec0 0x7f824c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- 172.21.15.45:0/680168377 >> 172.21.15.45:0/680168377 conn(0x7f824c067940 msgr2=0x7f824c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- 172.21.15.45:0/680168377 shutdown_connections 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.410+0000 7f8251da9700 1 -- 172.21.15.45:0/680168377 wait complete. 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 Processor -- start 2023-06-23T01:21:56.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- start start 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824c13f040 0x7f824c152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 0x7f824c1555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c1523a0 con 0x7f824c1423a0 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c13abe0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c152050 con 0x7f824c13f040 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.45:43890/0 (socket says 172.21.15.45:43890) 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f82515a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 0x7f824c1555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 -- 172.21.15.45:0/3716580147 learned_addr learned my addr 172.21.15.45:0/3716580147 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f824bfff700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824c13f040 0x7f824c152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 -- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824c13f040 msgr2=0x7f824c152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824c13f040 0x7f824c152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 -- 172.21.15.45:0/3716580147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 msgr2=0x7f824c1555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 0x7f824c1555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 -- 172.21.15.45:0/3716580147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340094f0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f82515a8700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 0x7f824c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:56.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8250da7700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f823c00ec80 tx=0x7f823c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0096b0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c00c850 con 0x7f824c0b4ec0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c00cc10 con 0x7f824c0b4ec0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c13aec0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.414+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c0b2800 con 0x7f824c0b4ec0 2023-06-23T01:21:56.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.418+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c06a760 con 0x7f824c0b4ec0 2023-06-23T01:21:56.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.418+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f823c013470 con 0x7f824c0b4ec0 2023-06-23T01:21:56.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.418+0000 7f8248ff9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 0x7f822c062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.418+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f823c07c730 con 0x7f824c0b4ec0 2023-06-23T01:21:56.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.418+0000 7f824bfff700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 0x7f822c062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.422+0000 7f824bfff700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 0x7f822c062960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f824c062990 tx=0x7f8234017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.430+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f823c04cf30 con 0x7f824c0b4ec0 2023-06-23T01:21:56.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f824c0b06b0 con 0x7f824c0b4ec0 2023-06-23T01:21:56.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8248ff9700 1 -- 172.21.15.45:0/3716580147 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f823c050550 con 0x7f824c0b4ec0 2023-06-23T01:21:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 msgr2=0x7f822c062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 0x7f822c062960 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f824c062990 tx=0x7f8234017000 comp rx=0 tx=0).stop 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 msgr2=0x7f824c140e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f823c00ec80 tx=0x7f823c0091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 shutdown_connections 2023-06-23T01:21:56.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f822c0604b0 0x7f822c062960 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f824c1423a0 0x7f824c1555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f824c13f040 0x7f824c152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 --2- 172.21.15.45:0/3716580147 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f824c0b4ec0 0x7f824c140e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 >> 172.21.15.45:0/3716580147 conn(0x7f824c067940 msgr2=0x7f824c0b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 shutdown_connections 2023-06-23T01:21:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.590+0000 7f8251da9700 1 -- 172.21.15.45:0/3716580147 wait complete. 2023-06-23T01:21:56.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-23T01:21:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 Processor -- start 2023-06-23T01:21:56.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 -- start start 2023-06-23T01:21:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8024142650 0x7f802413bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240b22c0 con 0x7f8024142280 2023-06-23T01:21:56.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240b2880 con 0x7f80240b0820 2023-06-23T01:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f8023fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240b20c0 con 0x7f8024142650 2023-06-23T01:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8024142650 0x7f802413bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8024142650 0x7f802413bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47142/0 (socket says 172.21.15.45:47142) 2023-06-23T01:21:56.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 -- 172.21.15.45:0/106399965 learned_addr learned my addr 172.21.15.45:0/106399965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 -- 172.21.15.45:0/106399965 >> v1:172.21.15.192:6789/0 conn(0x7f80240b0820 legacy=0x7f802413c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 -- 172.21.15.45:0/106399965 >> v1:172.21.15.45:6789/0 conn(0x7f8024142280 legacy=0x7f80240b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.718+0000 7f80227fc700 1 -- 172.21.15.45:0/106399965 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240b2b60 con 0x7f8024142650 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f80227fc700 1 --2- 172.21.15.45:0/106399965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f802413bcf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80140099b0 tx=0x7f8014009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0b162a078dad9f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8021ffb700 1 -- 172.21.15.45:0/106399965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400b860 con 0x7f8024142650 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8021ffb700 1 -- 172.21.15.45:0/106399965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801400b9c0 con 0x7f8024142650 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8021ffb700 1 -- 172.21.15.45:0/106399965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801400bd60 con 0x7f8024142650 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- 172.21.15.45:0/106399965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 msgr2=0x7f802413bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 --2- 172.21.15.45:0/106399965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f802413bcf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f80140099b0 tx=0x7f8014009250 comp rx=0 tx=0).stop 2023-06-23T01:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- 172.21.15.45:0/106399965 shutdown_connections 2023-06-23T01:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 --2- 172.21.15.45:0/106399965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f802413bcf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- 172.21.15.45:0/106399965 >> 172.21.15.45:0/106399965 conn(0x7f802406fb30 msgr2=0x7f802406e600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- 172.21.15.45:0/106399965 shutdown_connections 2023-06-23T01:21:56.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- 172.21.15.45:0/106399965 wait complete. 2023-06-23T01:21:56.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 Processor -- start 2023-06-23T01:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.722+0000 7f8023fff700 1 -- start start 2023-06-23T01:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 0x7f802413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024142280 0x7f80240a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240a88c0 con 0x7f8024142650 2023-06-23T01:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240a6610 con 0x7f80240b0820 2023-06-23T01:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240a68f0 con 0x7f8024142280 2023-06-23T01:21:56.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47156/0 (socket says 172.21.15.45:47156) 2023-06-23T01:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 -- 172.21.15.45:0/4039490325 learned_addr learned my addr 172.21.15.45:0/4039490325 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80227fc700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024142280 0x7f80240a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8022ffd700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 0x7f802413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 -- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024142280 msgr2=0x7f80240a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024142280 0x7f80240a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 -- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 msgr2=0x7f802413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 0x7f802413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 -- 172.21.15.45:0/4039490325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094f0 con 0x7f8024142650 2023-06-23T01:21:56.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8022ffd700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 0x7f802413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f80237fe700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c8e0 tx=0x7f801c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c012630 con 0x7f8024142650 2023-06-23T01:21:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c0127b0 con 0x7f8024142650 2023-06-23T01:21:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80240a8240 con 0x7f8024142650 2023-06-23T01:21:56.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c012b70 con 0x7f8024142650 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8024155420 con 0x7f8024142650 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80240a8070 con 0x7f8024142650 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f801c003030 con 0x7f8024142650 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.726+0000 7f801affd700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 0x7f8004062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.730+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f801c07c450 con 0x7f8024142650 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.730+0000 7f8022ffd700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 0x7f8004062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:56.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.730+0000 7f8022ffd700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 0x7f8004062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80240b2450 tx=0x7f800c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:56.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.734+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f801c04ccf0 con 0x7f8024142650 2023-06-23T01:21:56.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.894+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f80240a6a60 con 0x7f8024142650 2023-06-23T01:21:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.894+0000 7f801affd700 1 -- 172.21.15.45:0/4039490325 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f801c050310 con 0x7f8024142650 2023-06-23T01:21:56.901 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 8 2023-06-23T01:21:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 msgr2=0x7f8004062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 0x7f8004062960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f80240b2450 tx=0x7f800c009040 comp rx=0 tx=0).stop 2023-06-23T01:21:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 msgr2=0x7f80240a6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c8e0 tx=0x7f801c001710 comp rx=0 tx=0).stop 2023-06-23T01:21:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 shutdown_connections 2023-06-23T01:21:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f80040604b0 0x7f8004062960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8024142650 0x7f80240a6d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8024142280 0x7f80240a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 --2- 172.21.15.45:0/4039490325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80240b0820 0x7f802413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 >> 172.21.15.45:0/4039490325 conn(0x7f802406fb30 msgr2=0x7f802413c210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 shutdown_connections 2023-06-23T01:21:56.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:56.898+0000 7f8023fff700 1 -- 172.21.15.45:0/4039490325 wait complete. 2023-06-23T01:21:56.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-23T01:21:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 Processor -- start 2023-06-23T01:21:57.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 -- start start 2023-06-23T01:21:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e780b31c0 0x7f1e780ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e780b1680 0x7f1e7806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780ae030 con 0x7f1e780aece0 2023-06-23T01:21:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780b1be0 con 0x7f1e780b31c0 2023-06-23T01:21:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e7cda4700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e780b1ec0 con 0x7f1e780b1680 2023-06-23T01:21:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e777fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1e780b31c0 0x7f1e780ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e76ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1e780aece0 0x7f1e7806da90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58792/0 (socket says 172.21.15.45:58792) 2023-06-23T01:21:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e76ffd700 1 -- 172.21.15.45:0/2233852825 learned_addr learned my addr 172.21.15.45:0/2233852825 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.010+0000 7f1e77fff700 1 --2- 172.21.15.45:0/2233852825 >> v2:172.21.15.192:3300/0 conn(0x7f1e780b1680 0x7f1e7806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e767fc700 1 -- 172.21.15.45:0/2233852825 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558312735 0 0) 0x7f1e780ae030 con 0x7f1e780aece0 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e767fc700 1 -- 172.21.15.45:0/2233852825 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003570 con 0x7f1e780aece0 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e777fe700 1 -- 172.21.15.45:0/2233852825 >> v2:172.21.15.192:3300/0 conn(0x7f1e780b1680 msgr2=0x7f1e7806e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e777fe700 1 --2- 172.21.15.45:0/2233852825 >> v2:172.21.15.192:3300/0 conn(0x7f1e780b1680 0x7f1e7806e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e777fe700 1 -- 172.21.15.45:0/2233852825 >> v1:172.21.15.45:6789/0 conn(0x7f1e780aece0 legacy=0x7f1e7806da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e777fe700 1 -- 172.21.15.45:0/2233852825 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780b21a0 con 0x7f1e780b31c0 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e777fe700 1 --2- 172.21.15.45:0/2233852825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b31c0 0x7f1e780ae7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009e60 tx=0x7f1e68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613902e5c6f7f2cf server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e767fc700 1 -- 172.21.15.45:0/2233852825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800e070 con 0x7f1e780b31c0 2023-06-23T01:21:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e767fc700 1 -- 172.21.15.45:0/2233852825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6800ba70 con 0x7f1e780b31c0 2023-06-23T01:21:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e767fc700 1 -- 172.21.15.45:0/2233852825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6800be30 con 0x7f1e780b31c0 2023-06-23T01:21:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- 172.21.15.45:0/2233852825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b31c0 msgr2=0x7f1e780ae7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/2233852825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b31c0 0x7f1e780ae7a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1e68009e60 tx=0x7f1e68009780 comp rx=0 tx=0).stop 2023-06-23T01:21:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- 172.21.15.45:0/2233852825 shutdown_connections 2023-06-23T01:21:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/2233852825 >> v2:172.21.15.192:3300/0 conn(0x7f1e780b1680 0x7f1e7806e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/2233852825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b31c0 0x7f1e780ae7a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- 172.21.15.45:0/2233852825 >> 172.21.15.45:0/2233852825 conn(0x7f1e7806f790 msgr2=0x7f1e78066ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- 172.21.15.45:0/2233852825 shutdown_connections 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- 172.21.15.45:0/2233852825 wait complete. 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 Processor -- start 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 -- start start 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.014+0000 7f1e7cda4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 0x7f1e7813d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e780aced0 0x7f1e780ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780ad420 con 0x7f1e780b1680 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7814f660 con 0x7f1e780b31c0 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7814f940 con 0x7f1e780aced0 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47172/0 (socket says 172.21.15.45:47172) 2023-06-23T01:21:57.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 -- 172.21.15.45:0/127130034 learned_addr learned my addr 172.21.15.45:0/127130034 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:57.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e76ffd700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 0x7f1e7813d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e77fff700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e780aced0 0x7f1e780ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 -- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e780aced0 msgr2=0x7f1e780ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e780aced0 0x7f1e780ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 -- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 msgr2=0x7f1e7813d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 0x7f1e7813d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 -- 172.21.15.45:0/127130034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e68009a20 con 0x7f1e780b1680 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e76ffd700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 0x7f1e7813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e777fe700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e680099f0 tx=0x7f1e68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68012cb0 con 0x7f1e780b1680 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68012e30 con 0x7f1e780b1680 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7814fc20 con 0x7f1e780b1680 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e680276c0 con 0x7f1e780b1680 2023-06-23T01:21:57.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e781502e0 con 0x7f1e780b1680 2023-06-23T01:21:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7804bc30 con 0x7f1e780b1680 2023-06-23T01:21:57.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.018+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f1e68024070 con 0x7f1e780b1680 2023-06-23T01:21:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.022+0000 7f1e6f7fe700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 0x7f1e58062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.022+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1e6807ea30 con 0x7f1e780b1680 2023-06-23T01:21:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.022+0000 7f1e76ffd700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 0x7f1e58062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.022+0000 7f1e76ffd700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 0x7f1e58062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007fd0 tx=0x7f1e60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.026+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f1e6804f2d0 con 0x7f1e780b1680 2023-06-23T01:21:57.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.186+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1e780a9610 con 0x7f1e780b1680 2023-06-23T01:21:57.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.186+0000 7f1e6f7fe700 1 -- 172.21.15.45:0/127130034 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1e680528f0 con 0x7f1e780b1680 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-06-23T01:21:57.194 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-06-23T01:21:57.195 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 2, 2023-06-23T01:21:57.195 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": "rbd" 2023-06-23T01:21:57.195 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-06-23T01:21:57.195 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 msgr2=0x7f1e58062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 0x7f1e58062960 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1e60007fd0 tx=0x7f1e60009040 comp rx=0 tx=0).stop 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 msgr2=0x7f1e78141ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1e680099f0 tx=0x7f1e68019000 comp rx=0 tx=0).stop 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 shutdown_connections 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f1e580604b0 0x7f1e58062960 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e780b31c0 0x7f1e7813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f1e780aced0 0x7f1e780ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 --2- 172.21.15.45:0/127130034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1e780b1680 0x7f1e78141ea0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 >> 172.21.15.45:0/127130034 conn(0x7f1e7806f790 msgr2=0x7f1e78145120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:57.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 shutdown_connections 2023-06-23T01:21:57.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.190+0000 7f1e7cda4700 1 -- 172.21.15.45:0/127130034 wait complete. 2023-06-23T01:21:57.208 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-23T01:21:57.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-23T01:21:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 Processor -- start 2023-06-23T01:21:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 -- start start 2023-06-23T01:21:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d180afef0 0x7f2d180b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180b1110 con 0x7f2d180b2620 2023-06-23T01:21:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180b2100 con 0x7f2d180b29f0 2023-06-23T01:21:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.322+0000 7f2d1f6c8700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d181431e0 con 0x7f2d180afef0 2023-06-23T01:21:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1d464700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2d180b2620 0x7f2d180b3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58800/0 (socket says 172.21.15.45:58800) 2023-06-23T01:21:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1d464700 1 -- 172.21.15.45:0/2225120215 learned_addr learned my addr 172.21.15.45:0/2225120215 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1cc63700 1 --2- 172.21.15.45:0/2225120215 >> v2:172.21.15.192:3300/0 conn(0x7f2d180afef0 0x7f2d180b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d0ffff700 1 -- 172.21.15.45:0/2225120215 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3953450381 0 0) 0x7f2d180b1110 con 0x7f2d180b2620 2023-06-23T01:21:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d0ffff700 1 -- 172.21.15.45:0/2225120215 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d04003570 con 0x7f2d180b2620 2023-06-23T01:21:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2225120215 >> v1:172.21.15.192:6789/0 conn(0x7f2d180b29f0 legacy=0x7f2d180b3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2225120215 >> v1:172.21.15.45:6789/0 conn(0x7f2d180b2620 legacy=0x7f2d180b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2225120215 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b42a0 con 0x7f2d180afef0 2023-06-23T01:21:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1cc63700 1 --2- 172.21.15.45:0/2225120215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180afef0 0x7f2d180b0bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098e0 tx=0x7f2d140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5862897378d33725 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d0ffff700 1 -- 172.21.15.45:0/2225120215 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400b640 con 0x7f2d180afef0 2023-06-23T01:21:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d0ffff700 1 -- 172.21.15.45:0/2225120215 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400b7a0 con 0x7f2d180afef0 2023-06-23T01:21:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d0ffff700 1 -- 172.21.15.45:0/2225120215 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400bb20 con 0x7f2d180afef0 2023-06-23T01:21:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2225120215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180afef0 msgr2=0x7f2d180b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2225120215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180afef0 0x7f2d180b0bd0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098e0 tx=0x7f2d140091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2225120215 shutdown_connections 2023-06-23T01:21:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2225120215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180afef0 0x7f2d180b0bd0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2225120215 >> 172.21.15.45:0/2225120215 conn(0x7f2d1806e600 msgr2=0x7f2d1806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2225120215 shutdown_connections 2023-06-23T01:21:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.326+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2225120215 wait complete. 2023-06-23T01:21:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 Processor -- start 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- start start 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d180afef0 0x7f2d1813e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180b29f0 0x7f2d18155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181522b0 con 0x7f2d180b2620 2023-06-23T01:21:57.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18152590 con 0x7f2d180b29f0 2023-06-23T01:21:57.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18142b70 con 0x7f2d180afef0 2023-06-23T01:21:57.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47180/0 (socket says 172.21.15.45:47180) 2023-06-23T01:21:57.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2309240048 learned_addr learned my addr 172.21.15.45:0/2309240048 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:57.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1dc65700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180b29f0 0x7f2d18155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1d464700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d180afef0 0x7f2d1813e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d180afef0 msgr2=0x7f2d1813e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d180afef0 0x7f2d1813e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180b29f0 msgr2=0x7f2d18155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180b29f0 0x7f2d18155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 -- 172.21.15.45:0/2309240048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009420 con 0x7f2d180b2620 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1cc63700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009f80 tx=0x7f2d14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1400b910 con 0x7f2d180b2620 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1400ba90 con 0x7f2d180b2620 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d18151de0 con 0x7f2d180b2620 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14011670 con 0x7f2d180b2620 2023-06-23T01:21:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.330+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18155940 con 0x7f2d180b2620 2023-06-23T01:21:57.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.334+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d181520a0 con 0x7f2d180b2620 2023-06-23T01:21:57.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.334+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f2d14011aa0 con 0x7f2d180b2620 2023-06-23T01:21:57.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.334+0000 7f2d0d7fa700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 0x7f2cfc062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.334+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d1407dd90 con 0x7f2d180b2620 2023-06-23T01:21:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.334+0000 7f2d1d464700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 0x7f2cfc062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:57.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.338+0000 7f2d1d464700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 0x7f2cfc062960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d08007fd0 tx=0x7f2d08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:57.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.342+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f2d1404e590 con 0x7f2d180b2620 2023-06-23T01:21:57.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.506+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2d181523f0 con 0x7f2d180b2620 2023-06-23T01:21:57.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.886+0000 7f2d0d7fa700 1 -- 172.21.15.45:0/2309240048 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2d181523f0 con 0x7f2d180b2620 2023-06-23T01:21:57.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.890+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 msgr2=0x7f2cfc062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.890+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 0x7f2cfc062960 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2d08007fd0 tx=0x7f2d08009040 comp rx=0 tx=0).stop 2023-06-23T01:21:57.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.890+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 msgr2=0x7f2d1813eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:57.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.890+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009f80 tx=0x7f2d14017000 comp rx=0 tx=0).stop 2023-06-23T01:21:57.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 shutdown_connections 2023-06-23T01:21:57.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f2cfc0604b0 0x7f2cfc062960 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d180b29f0 0x7f2d18155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d180b2620 0x7f2d1813eb50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 --2- 172.21.15.45:0/2309240048 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f2d180afef0 0x7f2d1813e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:57.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 >> 172.21.15.45:0/2309240048 conn(0x7f2d1806e600 msgr2=0x7f2d1813bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:57.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 shutdown_connections 2023-06-23T01:21:57.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:57.894+0000 7f2d1f6c8700 1 -- 172.21.15.45:0/2309240048 wait complete. 2023-06-23T01:21:57.904 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-06-23T01:21:57.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-23T01:21:58.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.030+0000 7ff0aed75700 1 Processor -- start 2023-06-23T01:21:58.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.030+0000 7ff0aed75700 1 -- start start 2023-06-23T01:21:58.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a81425f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a80b1d90 con 0x7ff0a80b2a50 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0a8087210 con 0x7ff0a80b55b0 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a813c830 con 0x7ff0a80b4780 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ae574700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff0a80b2a50 0x7ff0a814c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58816/0 (socket says 172.21.15.45:58816) 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ae574700 1 -- 172.21.15.45:0/1827072796 learned_addr learned my addr 172.21.15.45:0/1827072796 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:58.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ad572700 1 --2- 172.21.15.45:0/1827072796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a81425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:58.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1265570649 0 0) 0x7ff0a80b1d90 con 0x7ff0a80b2a50 2023-06-23T01:21:58.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff094003570 con 0x7ff0a80b2a50 2023-06-23T01:21:58.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005450863 0 0) 0x7ff094003570 con 0x7ff0a80b2a50 2023-06-23T01:21:58.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ad572700 1 -- 172.21.15.45:0/1827072796 >> v1:172.21.15.192:6789/0 conn(0x7ff0a80b55b0 legacy=0x7ff0a80b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ad572700 1 -- 172.21.15.45:0/1827072796 >> v1:172.21.15.45:6789/0 conn(0x7ff0a80b2a50 legacy=0x7ff0a814c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ad572700 1 -- 172.21.15.45:0/1827072796 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a80b4c10 con 0x7ff0a80b4780 2023-06-23T01:21:58.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0ad572700 1 --2- 172.21.15.45:0/1827072796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a81425f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009910 tx=0x7ff0a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5dc5cc63538579 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:58.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 <== mon.2 v2:172.21.15.192:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0001810 con 0x7ff0a80b4780 2023-06-23T01:21:58.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 <== mon.2 v2:172.21.15.192:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4011420 con 0x7ff0a80b4780 2023-06-23T01:21:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0acd71700 1 -- 172.21.15.45:0/1827072796 <== mon.2 v2:172.21.15.192:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40117c0 con 0x7ff0a80b4780 2023-06-23T01:21:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 -- 172.21.15.45:0/1827072796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 msgr2=0x7ff0a81425f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 --2- 172.21.15.45:0/1827072796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a81425f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009910 tx=0x7ff0a40091a0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 -- 172.21.15.45:0/1827072796 shutdown_connections 2023-06-23T01:21:58.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.034+0000 7ff0aed75700 1 --2- 172.21.15.45:0/1827072796 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a81425f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- 172.21.15.45:0/1827072796 >> 172.21.15.45:0/1827072796 conn(0x7ff0a806e600 msgr2=0x7ff0a806ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:58.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- 172.21.15.45:0/1827072796 shutdown_connections 2023-06-23T01:21:58.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- 172.21.15.45:0/1827072796 wait complete. 2023-06-23T01:21:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 Processor -- start 2023-06-23T01:21:58.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- start start 2023-06-23T01:21:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0a80b2a50 0x7ff0a81386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 0x7ff0a8153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8139ca0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8152750 con 0x7ff0a80b2a50 2023-06-23T01:21:58.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0aed75700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0a8139f30 con 0x7ff0a80b4780 2023-06-23T01:21:58.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ae574700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 0x7ff0a8153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:58.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ad572700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:58.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0add73700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0a80b2a50 0x7ff0a81386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:58.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ad572700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3301/0 says I am v2:172.21.15.45:41928/0 (socket says 172.21.15.45:41928) 2023-06-23T01:21:58.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ad572700 1 -- 172.21.15.45:0/823993075 learned_addr learned my addr 172.21.15.45:0/823993075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:58.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ae574700 1 -- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 msgr2=0x7ff0a8152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.038+0000 7ff0ae574700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0ae574700 1 -- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0a80b2a50 msgr2=0x7ff0a81386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0ae574700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0a80b2a50 0x7ff0a81386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0ae574700 1 -- 172.21.15.45:0/823993075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4009420 con 0x7ff0a80b55b0 2023-06-23T01:21:58.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0ad572700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:21:58.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0ae574700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 0x7ff0a8153170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0001940 tx=0x7ff0a0007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:58.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0004dc0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a000a5a0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0a813a210 con 0x7ff0a80b55b0 2023-06-23T01:21:58.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a000a960 con 0x7ff0a80b55b0 2023-06-23T01:21:58.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0a8137740 con 0x7ff0a80b55b0 2023-06-23T01:21:58.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.042+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0a81525b0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.046+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7ff0a0007150 con 0x7ff0a80b55b0 2023-06-23T01:21:58.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.046+0000 7ff09dffb700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 0x7ff08c062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:58.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.046+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff0a007bc30 con 0x7ff0a80b55b0 2023-06-23T01:21:58.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.046+0000 7ff0add73700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 0x7ff08c062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:58.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.046+0000 7ff0add73700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 0x7ff08c062990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff098000f60 tx=0x7ff098007ea0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:58.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.054+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7ff0a004c570 con 0x7ff0a80b55b0 2023-06-23T01:21:58.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.214+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff0a81525b0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.902+0000 7ff09dffb700 1 -- 172.21.15.45:0/823993075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff0a81525b0 con 0x7ff0a80b55b0 2023-06-23T01:21:58.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.926+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 msgr2=0x7ff08c062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.926+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 0x7ff08c062990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff098000f60 tx=0x7ff098007ea0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 msgr2=0x7ff0a8153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 0x7ff0a8153170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0001940 tx=0x7ff0a0007be0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 shutdown_connections 2023-06-23T01:21:58.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7ff08c0604e0 0x7ff08c062990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0a80b55b0 0x7ff0a8153170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7ff0a80b4780 0x7ff0a8152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 --2- 172.21.15.45:0/823993075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff0a80b2a50 0x7ff0a81386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 >> 172.21.15.45:0/823993075 conn(0x7ff0a806e600 msgr2=0x7ff0a8140840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 shutdown_connections 2023-06-23T01:21:58.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:58.930+0000 7ff0aed75700 1 -- 172.21.15.45:0/823993075 wait complete. 2023-06-23T01:21:58.937 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-06-23T01:21:58.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-23T01:21:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.050+0000 7f8c225fa700 1 Processor -- start 2023-06-23T01:21:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.050+0000 7f8c225fa700 1 -- start start 2023-06-23T01:21:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c13f750 0x7f8c1c0ad8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c1c138620 0x7f8c1c138a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c0b0d00 con 0x7f8c1c0b4ec0 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0ade30 con 0x7f8c1c138620 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c06b910 con 0x7f8c1c13f750 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c1c138620 0x7f8c1c138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8c1c138620 0x7f8c1c138a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47202/0 (socket says 172.21.15.45:47202) 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 -- 172.21.15.45:0/3173285721 learned_addr learned my addr 172.21.15.45:0/3173285721 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c20df7700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c13f750 0x7f8c1c0ad8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 -- 172.21.15.45:0/3173285721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c13f750 msgr2=0x7f8c1c0ad8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c13f750 0x7f8c1c0ad8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 -- 172.21.15.45:0/3173285721 >> v1:172.21.15.192:6789/0 conn(0x7f8c1c0b4ec0 legacy=0x7f8c1c13f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 -- 172.21.15.45:0/3173285721 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0b06b0 con 0x7f8c1c138620 2023-06-23T01:21:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c21df9700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c138a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400bc50 tx=0x7f8c1400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31dfc55feceadf6 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c0ffff700 1 -- 172.21.15.45:0/3173285721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400dbf0 con 0x7f8c1c138620 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c0ffff700 1 -- 172.21.15.45:0/3173285721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1400dd50 con 0x7f8c1c138620 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c0ffff700 1 -- 172.21.15.45:0/3173285721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140196b0 con 0x7f8c1c138620 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- 172.21.15.45:0/3173285721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 msgr2=0x7f8c1c138a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c138a80 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400bc50 tx=0x7f8c1400b4f0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- 172.21.15.45:0/3173285721 shutdown_connections 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c138a80 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 --2- 172.21.15.45:0/3173285721 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c13f750 0x7f8c1c0ad8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- 172.21.15.45:0/3173285721 >> 172.21.15.45:0/3173285721 conn(0x7f8c1c067940 msgr2=0x7f8c1c0b4580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- 172.21.15.45:0/3173285721 shutdown_connections 2023-06-23T01:21:59.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.054+0000 7f8c225fa700 1 -- 172.21.15.45:0/3173285721 wait complete. 2023-06-23T01:21:59.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 Processor -- start 2023-06-23T01:21:59.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- start start 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 0x7f8c1c0af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 0x7f8c1c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c13a260 con 0x7f8c1c138620 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c13b350 con 0x7f8c1c13f750 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c139c10 con 0x7f8c1c0b4ec0 2023-06-23T01:21:59.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47210/0 (socket says 172.21.15.45:47210) 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 -- 172.21.15.45:0/2934079750 learned_addr learned my addr 172.21.15.45:0/2934079750 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c215f8700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 0x7f8c1c0af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c21df9700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 0x7f8c1c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 -- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 msgr2=0x7f8c1c0af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 0x7f8c1c0af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 -- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 msgr2=0x7f8c1c155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 0x7f8c1c155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 -- 172.21.15.45:0/2934079750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1400b790 con 0x7f8c1c138620 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c21df9700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 0x7f8c1c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c215f8700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 0x7f8c1c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c20df7700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ef0 tx=0x7f8c1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1800cc50 con 0x7f8c1c138620 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1800f040 con 0x7f8c1c138620 2023-06-23T01:21:59.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c139ef0 con 0x7f8c1c138620 2023-06-23T01:21:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c18014480 con 0x7f8c1c138620 2023-06-23T01:21:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.058+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c0ab470 con 0x7f8c1c138620 2023-06-23T01:21:59.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.062+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c06a760 con 0x7f8c1c138620 2023-06-23T01:21:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.062+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f8c180147f0 con 0x7f8c1c138620 2023-06-23T01:21:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.062+0000 7f8c0d7fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 0x7f8c00062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.062+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f8c1807d270 con 0x7f8c1c138620 2023-06-23T01:21:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.066+0000 7f8c215f8700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 0x7f8c00062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.066+0000 7f8c215f8700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 0x7f8c00062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007fd0 tx=0x7f8c10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.074+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f8c1804d780 con 0x7f8c1c138620 2023-06-23T01:21:59.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.266+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8c1c154d70 con 0x7f8c1c138620 2023-06-23T01:21:59.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.274+0000 7f8c0d7fa700 1 -- 172.21.15.45:0/2934079750 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8c18050da0 con 0x7f8c1c138620 2023-06-23T01:21:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.278+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 msgr2=0x7f8c00062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.278+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 0x7f8c00062960 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8c10007fd0 tx=0x7f8c10009040 comp rx=0 tx=0).stop 2023-06-23T01:21:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.278+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 msgr2=0x7f8c1c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.278+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009ef0 tx=0x7f8c1800b040 comp rx=0 tx=0).stop 2023-06-23T01:21:59.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 shutdown_connections 2023-06-23T01:21:59.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f8c000604b0 0x7f8c00062960 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8c1c13f750 0x7f8c1c155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8c1c138620 0x7f8c1c155010 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 --2- 172.21.15.45:0/2934079750 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f8c1c0b4ec0 0x7f8c1c0af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.282+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 >> 172.21.15.45:0/2934079750 conn(0x7f8c1c067940 msgr2=0x7f8c1c143240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.290+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 shutdown_connections 2023-06-23T01:21:59.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.294+0000 7f8c225fa700 1 -- 172.21.15.45:0/2934079750 wait complete. 2023-06-23T01:21:59.310 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 3 and data pool 4 2023-06-23T01:21:59.322 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 Processor -- start 2023-06-23T01:21:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 -- start start 2023-06-23T01:21:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f70340aff80 0x7f70340b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70341460a0 con 0x7f70340b2a80 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70340b3bb0 con 0x7f70340b26b0 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703be40700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7034146530 con 0x7f70340aff80 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703a3dd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f70340b2a80 0x7f70340abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58818/0 (socket says 172.21.15.45:58818) 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703a3dd700 1 -- 172.21.15.45:0/3275945953 learned_addr learned my addr 172.21.15.45:0/3275945953 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f70393db700 1 --2- 172.21.15.45:0/3275945953 >> v2:172.21.15.192:3300/0 conn(0x7f70340aff80 0x7f70340b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717945867 0 0) 0x7f70341460a0 con 0x7f70340b2a80 2023-06-23T01:21:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7020003570 con 0x7f70340b2a80 2023-06-23T01:21:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173014019 0 0) 0x7f70340b3bb0 con 0x7f70340b26b0 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70341460a0 con 0x7f70340b26b0 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986544184 0 0) 0x7f7020003570 con 0x7f70340b2a80 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 >> v2:172.21.15.192:3300/0 conn(0x7f70340aff80 msgr2=0x7f70340b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 --2- 172.21.15.45:0/3275945953 >> v2:172.21.15.192:3300/0 conn(0x7f70340aff80 0x7f70340b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 >> v1:172.21.15.192:6789/0 conn(0x7f70340b26b0 legacy=0x7f70340b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034145a50 con 0x7f70340b2a80 2023-06-23T01:21:59.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f7030001470 con 0x7f70340b2a80 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 >> v1:172.21.15.45:6789/0 conn(0x7f70340b2a80 legacy=0x7f70340abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 0x7f7020003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7020004810 0x7f7020004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020005230 0x7f702000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034146530 con 0x7f7020003bf0 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f702000c200 con 0x7f7020004810 2023-06-23T01:21:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702000c3c0 con 0x7f7020005230 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 0x7f7020003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f70393db700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7020004810 0x7f7020004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703a3dd700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020005230 0x7f702000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 -- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020005230 msgr2=0x7f702000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020005230 0x7f702000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 -- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7020004810 msgr2=0x7f7020004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7020004810 0x7f7020004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f7039bdc700 1 -- 172.21.15.45:0/3275945953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020003570 con 0x7f7020003bf0 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.414+0000 7f703a3dd700 1 -- 172.21.15.45:0/3275945953 reap_dead start 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f7039bdc700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 0x7f7020003fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f702c002120 tx=0x7f702c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d00962caf04cf69 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c006ba0 con 0x7f7020003bf0 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c006d00 con 0x7f7020003bf0 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f7038bda700 1 -- 172.21.15.45:0/3275945953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c00cae0 con 0x7f7020003bf0 2023-06-23T01:21:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 -- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 msgr2=0x7f7020003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 0x7f7020003fe0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f702c002120 tx=0x7f702c0017a0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 -- 172.21.15.45:0/3275945953 shutdown_connections 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 --2- 172.21.15.45:0/3275945953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7020003bf0 0x7f7020003fe0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 -- 172.21.15.45:0/3275945953 >> 172.21.15.45:0/3275945953 conn(0x7f703406e600 msgr2=0x7f703406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 -- 172.21.15.45:0/3275945953 shutdown_connections 2023-06-23T01:21:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 -- 172.21.15.45:0/3275945953 wait complete. 2023-06-23T01:21:59.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.418+0000 7f703be40700 1 Processor -- start 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- start start 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020003bf0 0x7f7034132d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340b73e0 0x7f70341551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034155bd0 con 0x7f7034155730 2023-06-23T01:21:59.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034139d70 con 0x7f70340b73e0 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70341397b0 con 0x7f7020003bf0 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47232/0 (socket says 172.21.15.45:47232) 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 -- 172.21.15.45:0/1619260558 learned_addr learned my addr 172.21.15.45:0/1619260558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f7039bdc700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020003bf0 0x7f7034132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f70393db700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340b73e0 0x7f70341551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 -- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020003bf0 msgr2=0x7f7034132d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020003bf0 0x7f7034132d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 -- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340b73e0 msgr2=0x7f70341551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340b73e0 0x7f70341551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 -- 172.21.15.45:0/1619260558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7034139a90 con 0x7f7034155730 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703a3dd700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7030000fd0 tx=0x7f7030001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030018030 con 0x7f7034155730 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000f630 con 0x7f7034155730 2023-06-23T01:21:59.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7034131340 con 0x7f7034155730 2023-06-23T01:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703000f9d0 con 0x7f7034155730 2023-06-23T01:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70340b70e0 con 0x7f7034155730 2023-06-23T01:21:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.422+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7034139610 con 0x7f7034155730 2023-06-23T01:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.426+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f703001b070 con 0x7f7034155730 2023-06-23T01:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.426+0000 7f7029ffb700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 0x7f7018062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.426+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7030019070 con 0x7f7034155730 2023-06-23T01:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.426+0000 7f7039bdc700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 0x7f7018062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.426+0000 7f7039bdc700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 0x7f7018062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f702c001be0 tx=0x7f702c015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.434+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f7034139610 con 0x7f7034155730 2023-06-23T01:21:59.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.597+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7034139610 con 0x7f7034155730 2023-06-23T01:21:59.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.597+0000 7f7029ffb700 1 -- 172.21.15.45:0/1619260558 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f7034139610 con 0x7f7034155730 2023-06-23T01:21:59.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:59.605 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:59.269716+0000","last_up_change":"2023-06-23T01:21:52.712540+0000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T01:21:52.030176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T01:21:53.384459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T01:21:57.552896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T01:21:58.258610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":32676},{"type":"v1","addr":"172.21.15.45:6817","nonce":32676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":32676},{"type":"v1","addr":"172.21.15.45:6819","nonce":32676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":32676},{"type":"v1","addr":"172.21.15.45:6823","nonce":32676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":32676},{"type":"v1","addr":"172.21.15.45:6821","nonce":32676}]},"public_addr":"172.21.15.45:6817/32676","cluster_addr":"172.21.15.45:6819/32676","heartbeat_back_addr":"172.21.15.45:6823/32676","heartbeat_front_addr":"172.21.15.45:6821/32676","state":["exists","up"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":32675},{"type":"v1","addr":"172.21.15.45:6801","nonce":32675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":32675},{"type":"v1","addr":"172.21.15.45:6803","nonce":32675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":32675},{"type":"v1","addr":"172.21.15.45:6807","nonce":32675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":32675},{"type":"v1","addr":"172.21.15.45:6805","nonce":32675}]},"public_addr":"172.21.15.45:6801/32675","cluster_addr":"172.21.15.45:6803/32675","heartbeat_back_addr":"172.21.15.45:6807/32675","heartbeat_front_addr":"172.21.15.45:6805/32675","state":["exists","up"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":32677},{"type":"v1","addr":"172.21.15.45:6825","nonce":32677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":32677},{"type":"v1","addr":"172.21.15.45:6827","nonce":32677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":32677},{"type":"v1","addr":"172.21.15.45:6831","nonce":32677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":32677},{"type":"v1","addr":"172.21.15.45:6829","nonce":32677}]},"public_addr":"172.21.15.45:6825/32677","cluster_addr":"172.21.15.45:6827/32677","heartbeat_back_addr":"172.21.15.45:6831/32677","heartbeat_front_addr":"172.21.15.45:6829/32677","state":["exists","up"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":32678},{"type":"v1","addr":"172.21.15.45:6809","nonce":32678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":32678},{"type":"v1","addr":"172.21.15.45:6811","nonce":32678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":32678},{"type":"v1","addr":"172.21.15.45:6815","nonce":32678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":32678},{"type":"v1","addr":"172.21.15.45:6813","nonce":32678}]},"public_addr":"172.21.15.45:6809/32678","cluster_addr":"172.21.15.45:6811/32678","heartbeat_back_addr":"172.21.15.45:6815/32678","heartbeat_front_addr":"172.21.15.45:6813/32678","state":["exists","up"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":32949},{"type":"v1","addr":"172.21.15.192:6809","nonce":32949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":32949},{"type":"v1","addr":"172.21.15.192:6811","nonce":32949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":32949},{"type":"v1","addr":"172.21.15.192:6815","nonce":32949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":32949},{"type":"v1","addr":"172.21.15.192:6813","nonce":32949}]},"public_addr":"172.21.15.192:6809/32949","cluster_addr":"172.21.15.192:6811/32949","heartbeat_back_addr":"172.21.15.192:6815/32949","heartbeat_front_addr":"172.21.15.192:6813/32949","state":["exists","up"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":32950},{"type":"v1","addr":"172.21.15.192:6825","nonce":32950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":32950},{"type":"v1","addr":"172.21.15.192:6827","nonce":32950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":32950},{"type":"v1","addr":"172.21.15.192:6831","nonce":32950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":32950},{"type":"v1","addr":"172.21.15.192:6829","nonce":32950}]},"public_addr":"172.21.15.192:6825/32950","cluster_addr":"172.21.15.192:6827/32950","heartbeat_back_addr":"172.21.15.192:6831/32950","heartbeat_front_addr":"172.21.15.192:6829/32950","state":["exists","up"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":32948},{"type":"v1","addr":"172.21.15.192:6801","nonce":32948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":32948},{"type":"v1","addr":"172.21.15.192:6803","nonce":32948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":32948},{"type":"v1","addr":"172.21.15.192:6807","nonce":32948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":32948},{"type":"v1","addr":"172.21.15.192:6805","nonce":32948}]},"public_addr":"172.21.15.192:6801/32948","cluster_addr":"172.21.15.192:6803/32948","heartbeat_back_addr":"172.21.15.192:6807/32948","heartbeat_front_addr":"172.21.15.192:6805/32948","state":["exists","up"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":32951},{"type":"v1","addr":"172.21.15.192:6817","nonce":32951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":32951},{"type":"v1","addr":"172.21.15.192:6819","nonce":32951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":32951},{"type":"v1","addr":"172.21.15.192:6823","nonce":32951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":32951},{"type":"v1","addr":"172.21.15.192:6821","nonce":32951}]},"public_addr":"172.21.15.192:6817/32951","cluster_addr":"172.21.15.192:6819/32951","heartbeat_back_addr":"172.21.15.192:6823/32951","heartbeat_front_addr":"172.21.15.192:6821/32951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.186110+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.065375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.238884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.049003+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.975748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.223214+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.782478+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.752980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 msgr2=0x7f7018062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 0x7f7018062960 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f702c001be0 tx=0x7f702c015000 comp rx=0 tx=0).stop 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 msgr2=0x7f703412c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7030000fd0 tx=0x7f7030001df0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 shutdown_connections 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f70180604b0 0x7f7018062960 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340b73e0 0x7f70341551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7034155730 0x7f703412c180 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 --2- 172.21.15.45:0/1619260558 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f7020003bf0 0x7f7034132d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 >> 172.21.15.45:0/1619260558 conn(0x7f703406e600 msgr2=0x7f703413a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 shutdown_connections 2023-06-23T01:21:59.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.601+0000 7f703be40700 1 -- 172.21.15.45:0/1619260558 wait complete. 2023-06-23T01:21:59.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-23T01:21:59.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.721+0000 7f3721baa700 1 Processor -- start 2023-06-23T01:21:59.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.721+0000 7f3721baa700 1 -- start start 2023-06-23T01:21:59.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3714007070 0x7f371400ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3714009560 con 0x7f3714007dc0 2023-06-23T01:21:59.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371400c570 con 0x7f37140cf360 2023-06-23T01:21:59.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3714008370 con 0x7f3714007070 2023-06-23T01:21:59.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3714007dc0 0x7f37140cec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58830/0 (socket says 172.21.15.45:58830) 2023-06-23T01:21:59.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371bfff700 1 -- 172.21.15.45:0/3438705860 learned_addr learned my addr 172.21.15.45:0/3438705860 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:21:59.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3720ba8700 1 --2- 172.21.15.45:0/3438705860 >> v2:172.21.15.192:3300/0 conn(0x7f3714007070 0x7f371400ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819609686 0 0) 0x7f3714009560 con 0x7f3714007dc0 2023-06-23T01:21:59.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f370c003570 con 0x7f3714007dc0 2023-06-23T01:21:59.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468765601 0 0) 0x7f370c003570 con 0x7f3714007dc0 2023-06-23T01:21:59.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 >> v2:172.21.15.192:3300/0 conn(0x7f3714007070 msgr2=0x7f371400ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 --2- 172.21.15.45:0/3438705860 >> v2:172.21.15.192:3300/0 conn(0x7f3714007070 0x7f371400ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 >> v1:172.21.15.192:6789/0 conn(0x7f37140cf360 legacy=0x7f37140d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714007440 con 0x7f3714007dc0 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7f3708001470 con 0x7f3714007dc0 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 >> v1:172.21.15.45:6789/0 conn(0x7f3714007dc0 legacy=0x7f37140cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c003a60 0x7f370c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f370c004810 0x7f370c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 0x7f370c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714008370 con 0x7f370c0052e0 2023-06-23T01:21:59.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00c250 con 0x7f370c004810 2023-06-23T01:21:59.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f370c00c410 con 0x7f370c003a60 2023-06-23T01:21:59.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 0x7f370c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3720ba8700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c003a60 0x7f370c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 -- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c003a60 msgr2=0x7f370c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c003a60 0x7f370c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371bfff700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f370c004810 0x7f370c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 -- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f370c004810 msgr2=0x7f370c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f370c004810 0x7f370c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 -- 172.21.15.45:0/3438705860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c003570 con 0x7f370c0052e0 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371bfff700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f370c004810 0x7f370c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 -- 172.21.15.45:0/3438705860 reap_dead start 2023-06-23T01:21:59.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f37213a9700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 0x7f370c00ba60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37100018b0 tx=0x7f3710007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af713032a264873f server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710012420 con 0x7f370c0052e0 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3710012580 con 0x7f370c0052e0 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f371b7fe700 1 -- 172.21.15.45:0/3438705860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710012920 con 0x7f370c0052e0 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 msgr2=0x7f370c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 0x7f370c00ba60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f37100018b0 tx=0x7f3710007d30 comp rx=0 tx=0).stop 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- 172.21.15.45:0/3438705860 shutdown_connections 2023-06-23T01:21:59.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 --2- 172.21.15.45:0/3438705860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f370c0052e0 0x7f370c00ba60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- 172.21.15.45:0/3438705860 >> 172.21.15.45:0/3438705860 conn(0x7f37140063c0 msgr2=0x7f37140067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- 172.21.15.45:0/3438705860 shutdown_connections 2023-06-23T01:21:59.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.725+0000 7f3721baa700 1 -- 172.21.15.45:0/3438705860 wait complete. 2023-06-23T01:21:59.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 Processor -- start 2023-06-23T01:21:59.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- start start 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c0052e0 0x7f3714022160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37140de770 0x7f37140db1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3714025cd0 con 0x7f3714020530 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37140200a0 con 0x7f37140de770 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371401fa50 con 0x7f370c0052e0 2023-06-23T01:21:59.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47250/0 (socket says 172.21.15.45:47250) 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 -- 172.21.15.45:0/673727853 learned_addr learned my addr 172.21.15.45:0/673727853 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3720ba8700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c0052e0 0x7f3714022160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f37213a9700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37140de770 0x7f37140db1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 -- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c0052e0 msgr2=0x7f3714022160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c0052e0 0x7f3714022160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 -- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37140de770 msgr2=0x7f37140db1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37140de770 0x7f37140db1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 -- 172.21.15.45:0/673727853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371401fd30 con 0x7f3714020530 2023-06-23T01:21:59.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f371bfff700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f370800db80 tx=0x7f3708009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370800de90 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708007150 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37140cab60 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37080074d0 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.729+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37140ded70 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37140088d0 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f370800b600 con 0x7f3714020530 2023-06-23T01:21:59.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3718ff9700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 0x7f3700062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:21:59.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f370807c700 con 0x7f3714020530 2023-06-23T01:21:59.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3720ba8700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 0x7f3700062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:21:59.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.733+0000 7f3720ba8700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 0x7f3700062960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f371c04c4b0 tx=0x7f371c088040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:21:59.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.737+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f370804ce60 con 0x7f3714020530 2023-06-23T01:21:59.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.897+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37140226a0 con 0x7f3714020530 2023-06-23T01:21:59.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.901+0000 7f3718ff9700 1 -- 172.21.15.45:0/673727853 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16879 (secure 0 0 0) 0x7f37140226a0 con 0x7f3714020530 2023-06-23T01:21:59.910 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-06-23T01:21:59.910 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"e324825f-5083-43ec-addd-73b25ee34de6","created":"2023-06-23T01:21:41.738566+0000","modified":"2023-06-23T01:21:59.269716+0000","last_up_change":"2023-06-23T01:21:52.712540+0000","last_in_change":"2023-06-23T01:21:44.714430+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-23T01:21:52.030176+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-23T01:21:53.384459+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-23T01:21:57.552896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-23T01:21:58.258610+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"522a6657-a991-46e3-b173-e7ecb177c97c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":32676},{"type":"v1","addr":"172.21.15.45:6817","nonce":32676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":32676},{"type":"v1","addr":"172.21.15.45:6819","nonce":32676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":32676},{"type":"v1","addr":"172.21.15.45:6823","nonce":32676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":32676},{"type":"v1","addr":"172.21.15.45:6821","nonce":32676}]},"public_addr":"172.21.15.45:6817/32676","cluster_addr":"172.21.15.45:6819/32676","heartbeat_back_addr":"172.21.15.45:6823/32676","heartbeat_front_addr":"172.21.15.45:6821/32676","state":["exists","up"]},{"osd":1,"uuid":"30e0cce7-2a93-440f-9d12-5a968dc97f77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":32675},{"type":"v1","addr":"172.21.15.45:6801","nonce":32675}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":32675},{"type":"v1","addr":"172.21.15.45:6803","nonce":32675}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":32675},{"type":"v1","addr":"172.21.15.45:6807","nonce":32675}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":32675},{"type":"v1","addr":"172.21.15.45:6805","nonce":32675}]},"public_addr":"172.21.15.45:6801/32675","cluster_addr":"172.21.15.45:6803/32675","heartbeat_back_addr":"172.21.15.45:6807/32675","heartbeat_front_addr":"172.21.15.45:6805/32675","state":["exists","up"]},{"osd":2,"uuid":"e882fecf-a714-4ad5-9720-5fcbdf959235","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":32677},{"type":"v1","addr":"172.21.15.45:6825","nonce":32677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":32677},{"type":"v1","addr":"172.21.15.45:6827","nonce":32677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":32677},{"type":"v1","addr":"172.21.15.45:6831","nonce":32677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":32677},{"type":"v1","addr":"172.21.15.45:6829","nonce":32677}]},"public_addr":"172.21.15.45:6825/32677","cluster_addr":"172.21.15.45:6827/32677","heartbeat_back_addr":"172.21.15.45:6831/32677","heartbeat_front_addr":"172.21.15.45:6829/32677","state":["exists","up"]},{"osd":3,"uuid":"594d4863-9863-4c31-9294-db1a72be1ae3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":32678},{"type":"v1","addr":"172.21.15.45:6809","nonce":32678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":32678},{"type":"v1","addr":"172.21.15.45:6811","nonce":32678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":32678},{"type":"v1","addr":"172.21.15.45:6815","nonce":32678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":32678},{"type":"v1","addr":"172.21.15.45:6813","nonce":32678}]},"public_addr":"172.21.15.45:6809/32678","cluster_addr":"172.21.15.45:6811/32678","heartbeat_back_addr":"172.21.15.45:6815/32678","heartbeat_front_addr":"172.21.15.45:6813/32678","state":["exists","up"]},{"osd":4,"uuid":"8eb32754-7d27-4e13-98b7-78fe3f88fc5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":32949},{"type":"v1","addr":"172.21.15.192:6809","nonce":32949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":32949},{"type":"v1","addr":"172.21.15.192:6811","nonce":32949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":32949},{"type":"v1","addr":"172.21.15.192:6815","nonce":32949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":32949},{"type":"v1","addr":"172.21.15.192:6813","nonce":32949}]},"public_addr":"172.21.15.192:6809/32949","cluster_addr":"172.21.15.192:6811/32949","heartbeat_back_addr":"172.21.15.192:6815/32949","heartbeat_front_addr":"172.21.15.192:6813/32949","state":["exists","up"]},{"osd":5,"uuid":"4749ac2b-5d6e-42e4-ab64-dad1c8c14177","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":32950},{"type":"v1","addr":"172.21.15.192:6825","nonce":32950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":32950},{"type":"v1","addr":"172.21.15.192:6827","nonce":32950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":32950},{"type":"v1","addr":"172.21.15.192:6831","nonce":32950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":32950},{"type":"v1","addr":"172.21.15.192:6829","nonce":32950}]},"public_addr":"172.21.15.192:6825/32950","cluster_addr":"172.21.15.192:6827/32950","heartbeat_back_addr":"172.21.15.192:6831/32950","heartbeat_front_addr":"172.21.15.192:6829/32950","state":["exists","up"]},{"osd":6,"uuid":"6665b039-4317-4d37-9822-a048a83c99ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":32948},{"type":"v1","addr":"172.21.15.192:6801","nonce":32948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":32948},{"type":"v1","addr":"172.21.15.192:6803","nonce":32948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":32948},{"type":"v1","addr":"172.21.15.192:6807","nonce":32948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":32948},{"type":"v1","addr":"172.21.15.192:6805","nonce":32948}]},"public_addr":"172.21.15.192:6801/32948","cluster_addr":"172.21.15.192:6803/32948","heartbeat_back_addr":"172.21.15.192:6807/32948","heartbeat_front_addr":"172.21.15.192:6805/32948","state":["exists","up"]},{"osd":7,"uuid":"44c15180-c7e5-4974-8451-598d9276fb67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":32951},{"type":"v1","addr":"172.21.15.192:6817","nonce":32951}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":32951},{"type":"v1","addr":"172.21.15.192:6819","nonce":32951}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":32951},{"type":"v1","addr":"172.21.15.192:6823","nonce":32951}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":32951},{"type":"v1","addr":"172.21.15.192:6821","nonce":32951}]},"public_addr":"172.21.15.192:6817/32951","cluster_addr":"172.21.15.192:6819/32951","heartbeat_back_addr":"172.21.15.192:6823/32951","heartbeat_front_addr":"172.21.15.192:6821/32951","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.186110+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.065375+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.238884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.049003+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.975748+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:50.223214+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.782478+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-06-23T01:21:49.752980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-23T01:21:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 msgr2=0x7f3700062960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 0x7f3700062960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f371c04c4b0 tx=0x7f371c088040 comp rx=0 tx=0).stop 2023-06-23T01:21:59.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 msgr2=0x7f3714025790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f370800db80 tx=0x7f3708009040 comp rx=0 tx=0).stop 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 shutdown_connections 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f37000604b0 0x7f3700062960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f37140de770 0x7f37140db1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3714020530 0x7f3714025790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 --2- 172.21.15.45:0/673727853 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f370c0052e0 0x7f3714022160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 >> 172.21.15.45:0/673727853 conn(0x7f37140063c0 msgr2=0x7f371403e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:21:59.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 shutdown_connections 2023-06-23T01:21:59.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:21:59.905+0000 7f3721baa700 1 -- 172.21.15.45:0/673727853 wait complete. 2023-06-23T01:21:59.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-23T01:22:00.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.033+0000 7f82fca7d700 1 Processor -- start 2023-06-23T01:22:00.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.033+0000 7f82fca7d700 1 -- start start 2023-06-23T01:22:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82f8067ff0 0x7f82f806a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 0x7f82f814a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f8069c60 con 0x7f82f806f930 2023-06-23T01:22:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f8068450 con 0x7f82f80acd10 2023-06-23T01:22:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f80ad150 con 0x7f82f8067ff0 2023-06-23T01:22:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82f7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 0x7f82f814a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82f8067ff0 0x7f82f806a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82f8067ff0 0x7f82f806a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.45:44014/0 (socket says 172.21.15.45:44014) 2023-06-23T01:22:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 -- 172.21.15.45:0/1613451700 learned_addr learned my addr 172.21.15.45:0/1613451700 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:22:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82f7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 0x7f82f814a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47258/0 (socket says 172.21.15.45:47258) 2023-06-23T01:22:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 -- 172.21.15.45:0/1613451700 >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 msgr2=0x7f82f814a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:22:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 --2- 172.21.15.45:0/1613451700 >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 0x7f82f814a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 -- 172.21.15.45:0/1613451700 >> v1:172.21.15.192:6789/0 conn(0x7f82f806f930 legacy=0x7f82f8143d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 -- 172.21.15.45:0/1613451700 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f80ac5a0 con 0x7f82f8067ff0 2023-06-23T01:22:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82eeffd700 1 --2- 172.21.15.45:0/1613451700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067ff0 0x7f82f806a0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82f80a8600 tx=0x7f82e0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e841baeac5a9c7a8 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82f6ffd700 1 -- 172.21.15.45:0/1613451700 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e0009e70 con 0x7f82f8067ff0 2023-06-23T01:22:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82f6ffd700 1 -- 172.21.15.45:0/1613451700 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000b860 con 0x7f82f8067ff0 2023-06-23T01:22:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82f6ffd700 1 -- 172.21.15.45:0/1613451700 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000bc00 con 0x7f82f8067ff0 2023-06-23T01:22:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- 172.21.15.45:0/1613451700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067ff0 msgr2=0x7f82f806a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 --2- 172.21.15.45:0/1613451700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067ff0 0x7f82f806a0f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f82f80a8600 tx=0x7f82e0009250 comp rx=0 tx=0).stop 2023-06-23T01:22:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- 172.21.15.45:0/1613451700 shutdown_connections 2023-06-23T01:22:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 --2- 172.21.15.45:0/1613451700 >> v2:172.21.15.45:3300/0 conn(0x7f82f80acd10 0x7f82f814a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 --2- 172.21.15.45:0/1613451700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f8067ff0 0x7f82f806a0f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- 172.21.15.45:0/1613451700 >> 172.21.15.45:0/1613451700 conn(0x7f82f8066ed0 msgr2=0x7f82f80672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:22:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- 172.21.15.45:0/1613451700 shutdown_connections 2023-06-23T01:22:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.037+0000 7f82fca7d700 1 -- 172.21.15.45:0/1613451700 wait complete. 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 Processor -- start 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 -- start start 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f8067ff0 0x7f82f80aa090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82f806f930 0x7f82f81538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80acd10 0x7f82f8153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8098890 con 0x7f82f8067ff0 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f8099fc0 con 0x7f82f80acd10 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82fca7d700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f80983f0 con 0x7f82f806f930 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f8067ff0 0x7f82f80aa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f8067ff0 0x7f82f80aa090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47268/0 (socket says 172.21.15.45:47268) 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 -- 172.21.15.45:0/2342887830 learned_addr learned my addr 172.21.15.45:0/2342887830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f7fff700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80acd10 0x7f82f8153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 -- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82f806f930 msgr2=0x7f82f81538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82eeffd700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82f806f930 0x7f82f81538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82f806f930 0x7f82f81538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 -- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80acd10 msgr2=0x7f82f8153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80acd10 0x7f82f8153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 -- 172.21.15.45:0/2342887830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e00094f0 con 0x7f82f8067ff0 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f7fff700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f80acd10 0x7f82f8153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-23T01:22:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82eeffd700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7f82f806f930 0x7f82f81538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82f77fe700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82f8067ff0 0x7f82f80aa090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f82e800c5c0 tx=0x7f82e800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.041+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011590 con 0x7f82f8067ff0 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82fca7d700 1 -- 172.21.15.45:0/2342887830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f8098ae0 con 0x7f82f8067ff0 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82fca7d700 1 -- 172.21.15.45:0/2342887830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f80990a0 con 0x7f82f8067ff0 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e8001120 con 0x7f82f8067ff0 2023-06-23T01:22:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8011900 con 0x7f82f8067ff0 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82fca7d700 1 -- 172.21.15.45:0/2342887830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82dc0052b0 con 0x7f82f8067ff0 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7f82e8011a60 con 0x7f82f8067ff0 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82effff700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f82d80604b0 0x7f82d8062960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82e807b9f0 con 0x7f82f8067ff0 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82eeffd700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f82d80604b0 0x7f82d8062960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.045+0000 7f82eeffd700 1 --2- 172.21.15.45:0/2342887830 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7f82d80604b0 0x7f82d8062960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f82f80a8600 tx=0x7f82e0017000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.057+0000 7f82effff700 1 -- 172.21.15.45:0/2342887830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7f82e8049bd0 con 0x7f82f8067ff0 2023-06-23T01:22:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:no valid command found; 1 closest matches: 2023-06-23T01:22:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-23T01:22:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:Error EINVAL: invalid command 2023-06-23T01:22:00.264 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-23T01:22:00.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-23T01:22:00.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-23T01:22:00.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 Processor -- start 2023-06-23T01:22:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 -- start start 2023-06-23T01:22:00.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd40814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b2350 con 0x7fd4080b72d0 2023-06-23T01:22:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4080b25a0 con 0x7fd4080b1ed0 2023-06-23T01:22:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd40d7a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40813ca40 con 0x7fd40813c5c0 2023-06-23T01:22:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd406ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd4080b72d0 0x7fd4080b11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52344/0 (socket says 172.21.15.45:52344) 2023-06-23T01:22:00.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd406ffd700 1 -- 172.21.15.45:0/3512026240 learned_addr learned my addr 172.21.15.45:0/3512026240 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd4077fe700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd40814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 661547307 0 0) 0x7fd4080b2350 con 0x7fd4080b72d0 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f0003570 con 0x7fd4080b72d0 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.1 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881296339 0 0) 0x7fd4080b25a0 con 0x7fd4080b1ed0 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4080b2350 con 0x7fd4080b1ed0 2023-06-23T01:22:00.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2061990770 0 0) 0x7fd3f0003570 con 0x7fd4080b72d0 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 msgr2=0x7fd40814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd40814dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 >> v1:172.21.15.192:6789/0 conn(0x7fd4080b1ed0 legacy=0x7fd40813beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40806c220 con 0x7fd4080b72d0 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1271087195 0 0) 0x7fd3fc001470 con 0x7fd4080b72d0 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 >> v1:172.21.15.45:6789/0 conn(0x7fd4080b72d0 legacy=0x7fd4080b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3f0003c20 0x7fd3f0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd3f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0004d50 0x7fd3f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40813ca40 con 0x7fd3f0003c20 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000bb40 con 0x7fd3f0004d50 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.373+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000bd00 con 0x7fd40813c5c0 2023-06-23T01:22:00.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3f0003c20 0x7fd3f0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd4067fc700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd3f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd4077fe700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0004d50 0x7fd3f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 -- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 msgr2=0x7fd3f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813c5c0 0x7fd3f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 -- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0004d50 msgr2=0x7fd3f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3f0004d50 0x7fd3f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 -- 172.21.15.45:0/3512026240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f0003570 con 0x7fd3f0003c20 2023-06-23T01:22:00.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd406ffd700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3f0003c20 0x7fd3f0004010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c2d0 tx=0x7fd3fc001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b09e5e20180cf5e server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00cbc0 con 0x7fd3f0003c20 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc00cd20 con 0x7fd3f0003c20 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd405ffb700 1 -- 172.21.15.45:0/3512026240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc005b70 con 0x7fd3f0003c20 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- 172.21.15.45:0/3512026240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3f0003c20 msgr2=0x7fd3f0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 --2- 172.21.15.45:0/3512026240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3f0003c20 0x7fd3f0004010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00c2d0 tx=0x7fd3fc001e10 comp rx=0 tx=0).stop 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd4077fe700 1 -- 172.21.15.45:0/3512026240 reap_dead start 2023-06-23T01:22:00.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- 172.21.15.45:0/3512026240 shutdown_connections 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- 172.21.15.45:0/3512026240 >> 172.21.15.45:0/3512026240 conn(0x7fd408067950 msgr2=0x7fd4080b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- 172.21.15.45:0/3512026240 shutdown_connections 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- 172.21.15.45:0/3512026240 wait complete. 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 Processor -- start 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.377+0000 7fd40d7a5700 1 -- start start 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 --2- >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813cdd0 0x7fd4081521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40813d1a0 0x7fd408152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd408136bc0 0x7fd408137030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408156240 con 0x7fd408136bc0 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd408155c80 con 0x7fd40813d1a0 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- --> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd408155f60 con 0x7fd40813cdd0 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd408136bc0 0x7fd408137030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd408136bc0 0x7fd408137030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:39340/0 (socket says 172.21.15.45:39340) 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 -- 172.21.15.45:0/2884873348 learned_addr learned my addr 172.21.15.45:0/2884873348 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-06-23T01:22:00.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd406ffd700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813cdd0 0x7fd4081521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4067fc700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40813d1a0 0x7fd408152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 -- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813cdd0 msgr2=0x7fd4081521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3301/0,v1:172.21.15.192:6790/0] conn(0x7fd40813cdd0 0x7fd4081521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 -- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40813d1a0 msgr2=0x7fd408152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40813d1a0 0x7fd408152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 -- 172.21.15.45:0/2884873348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd408137570 con 0x7fd408136bc0 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4067fc700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd40813d1a0 0x7fd408152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-23T01:22:00.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd4077fe700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd408136bc0 0x7fd408137030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4080aa670 tx=0x7fd40000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000e040 con 0x7fd408136bc0 2023-06-23T01:22:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40000f040 con 0x7fd408136bc0 2023-06-23T01:22:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- 172.21.15.45:0/2884873348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4080b0fb0 con 0x7fd408136bc0 2023-06-23T01:22:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40000fe40 con 0x7fd408136bc0 2023-06-23T01:22:00.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- 172.21.15.45:0/2884873348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd408142590 con 0x7fd408136bc0 2023-06-23T01:22:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.381+0000 7fd40d7a5700 1 -- 172.21.15.45:0/2884873348 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40804bc30 con 0x7fd408136bc0 2023-06-23T01:22:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.385+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 79867+0+0 (secure 0 0 0) 0x7fd400015640 con 0x7fd408136bc0 2023-06-23T01:22:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.385+0000 7fd3eeffd700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7fd3f40604e0 0x7fd3f4062990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-23T01:22:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.385+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd40007cea0 con 0x7fd408136bc0 2023-06-23T01:22:00.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.385+0000 7fd406ffd700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7fd3f40604e0 0x7fd3f4062990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-23T01:22:00.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.385+0000 7fd406ffd700 1 --2- 172.21.15.45:0/2884873348 >> [v2:172.21.15.192:6832/32607,v1:172.21.15.192:6833/32607] conn(0x7fd3f40604e0 0x7fd3f4062990 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004890 tx=0x7fd3fc015000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-23T01:22:00.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-06-23T01:22:00.389+0000 7fd3eeffd700 1 -- 172.21.15.45:0/2884873348 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166847 (secure 0 0 0) 0x7fd40004d410 con 0x7fd408136bc0 2023-06-23T01:22:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:no valid command found; 1 closest matches: 2023-06-23T01:22:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:fs set |refuse_client_session|max_xattr_size [--yes-i-really-mean-it] [--yes-i-really-really-mean-it] 2023-06-23T01:22:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:Error EINVAL: invalid command 2023-06-23T01:22:00.599 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-06-23T01:22:00.600 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T01:22:00.601 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-23T01:22:00.601 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-23T01:22:00.601 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.615 INFO:tasks.ceph.mds.a:Stopped 2023-06-23T01:22:00.615 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-23T01:22:00.616 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.630 INFO:tasks.ceph.mds.b:Stopped 2023-06-23T01:22:00.631 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-23T01:22:00.631 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-23T01:22:00.632 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.708 INFO:tasks.ceph.osd.0:Stopped 2023-06-23T01:22:00.709 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-23T01:22:00.709 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.795 INFO:tasks.ceph.osd.1:Stopped 2023-06-23T01:22:00.796 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-23T01:22:00.796 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.868 INFO:tasks.ceph.osd.2:Stopped 2023-06-23T01:22:00.869 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-23T01:22:00.869 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:00.946 INFO:tasks.ceph.osd.3:Stopped 2023-06-23T01:22:00.946 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-23T01:22:00.947 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.027 INFO:tasks.ceph.osd.4:Stopped 2023-06-23T01:22:01.028 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-23T01:22:01.028 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.098 INFO:tasks.ceph.osd.5:Stopped 2023-06-23T01:22:01.099 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-23T01:22:01.100 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.167 INFO:tasks.ceph.osd.6:Stopped 2023-06-23T01:22:01.168 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-23T01:22:01.168 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.244 INFO:tasks.ceph.osd.7:Stopped 2023-06-23T01:22:01.245 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-23T01:22:01.246 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-23T01:22:01.246 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.277 INFO:tasks.ceph.mgr.y:Stopped 2023-06-23T01:22:01.278 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-23T01:22:01.278 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.306 INFO:tasks.ceph.mgr.x:Stopped 2023-06-23T01:22:01.307 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-23T01:22:01.308 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-23T01:22:01.309 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.336 INFO:tasks.ceph.mon.a:Stopped 2023-06-23T01:22:01.337 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-23T01:22:01.337 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.353 INFO:tasks.ceph.mon.b:Stopped 2023-06-23T01:22:01.354 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-23T01:22:01.354 INFO:teuthology.orchestra.run:waiting for 300 2023-06-23T01:22:01.369 INFO:tasks.ceph.mon.c:Stopped 2023-06-23T01:22:01.370 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-23T01:22:01.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-06-23T01:22:01.393 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:22:01.393 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-23T01:22:03.160 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:22:03.161 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-23T01:22:03.388 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:22:03.389 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-23T01:22:03.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:22:03.644 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-23T01:22:03.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:22:03.920 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-23T01:22:04.766 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:22:04.766 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-23T01:22:05.026 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:22:05.027 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-23T01:22:05.191 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:22:05.191 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-23T01:22:05.367 INFO:tasks.ceph:Archiving mon data... 2023-06-23T01:22:05.368 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/data/mon.a.tgz 2023-06-23T01:22:05.368 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-06-23T01:22:05.377 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.sjiDNDDqeC 2023-06-23T01:22:05.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sjiDNDDqeC 2023-06-23T01:22:05.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.sjiDNDDqeC 2023-06-23T01:22:05.461 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.sjiDNDDqeC is 199KB 2023-06-23T01:22:05.479 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.sjiDNDDqeC 2023-06-23T01:22:05.485 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/data/mon.b.tgz 2023-06-23T01:22:05.486 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-06-23T01:22:05.494 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.TEu11fwGQ9 2023-06-23T01:22:05.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TEu11fwGQ9 2023-06-23T01:22:05.565 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.TEu11fwGQ9 2023-06-23T01:22:05.589 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.TEu11fwGQ9 is 274KB 2023-06-23T01:22:05.695 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.TEu11fwGQ9 2023-06-23T01:22:05.713 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/data/mon.c.tgz 2023-06-23T01:22:05.713 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2023-06-23T01:22:05.719 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.bRkgmi8TQ7 2023-06-23T01:22:05.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bRkgmi8TQ7 2023-06-23T01:22:05.833 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.bRkgmi8TQ7 2023-06-23T01:22:05.862 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.bRkgmi8TQ7 is 274KB 2023-06-23T01:22:05.924 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.bRkgmi8TQ7 2023-06-23T01:22:05.931 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-23T01:22:05.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T01:22:05.936 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-23T01:22:05.952 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-23T01:22:05.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T01:22:05.954 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-23T01:22:05.975 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T01:22:05.990 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:05.993 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:06.015 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-23T01:22:06.022 INFO:tasks.ceph:Archiving crash dumps... 2023-06-23T01:22:06.023 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi045/crash 2023-06-23T01:22:06.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T01:22:06.090 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi192/crash 2023-06-23T01:22:06.091 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-23T01:22:06.108 INFO:tasks.ceph:Shutting down logrotate 2023-06-23T01:22:06.109 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:06.111 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:06.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:06.213 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-23T01:22:06.228 INFO:tasks.ceph:Compressing logs... 2023-06-23T01:22:06.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T01:22:06.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T01:22:08.883 INFO:tasks.ceph:Archiving logs... 2023-06-23T01:22:08.884 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi045/log 2023-06-23T01:22:08.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T01:22:09.202 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi192/log 2023-06-23T01:22:09.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-23T01:22:09.479 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T01:22:09.557 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=21a9546fcc66454f9424aac4849d43bc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 1893, in task with contextutil.nested(*subtasks): File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 251, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph.py", line 450, in cephfs_setup fs = Filesystem(ctx, fs_config=temp, name=name, create=True) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 514, in __init__ self.create() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 717, in create self.set_allow_standby_replay(standby_replay) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 589, in set_allow_standby_replay self.set_var("allow_standby_replay", yes) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/cephfs/filesystem.py", line 574, in set_var self.mon_manager.raw_cluster_cmd("fs", "set", self.name, var, *a) File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_ceph_ceph-c_42ddc46e6e6582d8e29a5a982a81886fe028be2c/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false' 2023-06-23T01:22:09.563 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-23T01:22:09.573 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-23T01:22:09.620 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-06-23T01:22:09.621 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T01:22:09.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-06-23T01:22:09.706 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-23T01:22:09.719 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-23T01:22:09.720 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T01:22:09.722 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-23T01:22:09.741 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T01:22:09.742 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-06-23T01:22:09.742 INFO:teuthology.orchestra.run.smithi045.stdout:+hv01.front.sepi 44.4.53.2 2 u 27 64 17 0.187 -2.755 1.824 2023-06-23T01:22:09.742 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 17 0.088 1.545 1.967 2023-06-23T01:22:09.742 INFO:teuthology.orchestra.run.smithi045.stdout:*hv03.front.sepi 74.6.168.72 3 u 26 64 17 0.116 -0.645 2.076 2023-06-23T01:22:09.742 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:22:09.748 INFO:teuthology.orchestra.run.smithi192.stdout: remote refid st t when poll reach delay offset jitter 2023-06-23T01:22:09.749 INFO:teuthology.orchestra.run.smithi192.stdout:============================================================================== 2023-06-23T01:22:09.750 INFO:teuthology.orchestra.run.smithi192.stdout:+hv01.front.sepi 44.4.53.2 2 u 25 64 17 0.118 -1.242 1.009 2023-06-23T01:22:09.750 INFO:teuthology.orchestra.run.smithi192.stdout:+hv02.front.sepi 63.231.80.2 3 u 21 64 17 0.095 2.836 0.419 2023-06-23T01:22:09.750 INFO:teuthology.orchestra.run.smithi192.stdout:*hv03.front.sepi 74.6.168.72 3 u 21 64 17 0.110 0.956 0.536 2023-06-23T01:22:09.751 INFO:teuthology.orchestra.run.smithi192.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-23T01:22:09.752 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-23T01:22:09.767 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-23T01:22:09.768 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-23T01:22:09.800 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-23T01:22:09.834 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-23T01:22:09.877 INFO:teuthology.task.internal:Duration was 567.878270 seconds 2023-06-23T01:22:09.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-23T01:22:09.907 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-23T01:22:09.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T01:22:09.911 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-23T01:22:09.962 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-23T01:22:09.962 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-06-23T01:22:09.963 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T01:22:09.974 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2023-06-23T01:22:09.974 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-23T01:22:09.986 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-23T01:22:09.987 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T01:22:09.989 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-23T01:22:10.061 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-23T01:22:10.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T01:22:10.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-23T01:22:10.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-23T01:22:10.147 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-23T01:22:10.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T01:22:10.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-23T01:22:10.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-23T01:22:10.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T01:22:10.207 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-23T01:22:10.220 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-06-23T01:22:10.238 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2023-06-23T01:22:10.264 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T01:22:10.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:22:10.271 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-23T01:22:10.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-23T01:22:10.277 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-23T01:22:10.286 INFO:teuthology.task.internal:Transferring archived files... 2023-06-23T01:22:10.288 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi045 2023-06-23T01:22:10.289 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T01:22:10.336 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949/remote/smithi192 2023-06-23T01:22:10.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-23T01:22:10.359 INFO:teuthology.task.internal:Removing archive directory... 2023-06-23T01:22:10.360 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T01:22:10.363 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-23T01:22:10.368 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-23T01:22:10.378 INFO:teuthology.task.internal:Not uploading archives. 2023-06-23T01:22:10.379 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-23T01:22:10.407 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-23T01:22:10.407 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T01:22:10.412 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-23T01:22:10.417 INFO:teuthology.orchestra.run.smithi045.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 01:22 /home/ubuntu/cephtest 2023-06-23T01:22:10.419 INFO:teuthology.orchestra.run.smithi192.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 23 01:22 /home/ubuntu/cephtest 2023-06-23T01:22:10.422 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-23T01:22:10.438 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-23T01:22:10.505 INFO:teuthology.nuke:Checking targets against current locks 2023-06-23T01:22:10.534 DEBUG:teuthology.nuke:shortname: smithi045 2023-06-23T01:22:10.535 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:22:10.558 DEBUG:teuthology.nuke:shortname: smithi192 2023-06-23T01:22:10.558 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-23T01:22:10.561 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:03:33.189921', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-06-23T01:22:10.584 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-22_15:25:25-fs-wip-yuri4-testing-2023-06-21-0846-quincy-distro-default-smithi/7311949', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-23 01:03:33.187711', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-06-23T01:22:10.618 INFO:teuthology.orchestra.console:Power off smithi045 2023-06-23T01:22:10.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:22:10.639 INFO:teuthology.orchestra.console:Power off smithi192 2023-06-23T01:22:10.641 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-23T01:22:10.653 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:10.668 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:14.688 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:14.698 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:18.804 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:18.815 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi192.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-23T01:22:19.019 INFO:teuthology.orchestra.console:Power off for smithi045 completed 2023-06-23T01:22:19.028 INFO:teuthology.orchestra.console:Power off for smithi192 completed 2023-06-23T01:22:19.132 INFO:teuthology.run:Summary data: description: fs/permission/{begin/{0-install 1-ceph 2-logrotate} clusters/fixed-2-ucephfs conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore-ec/bluestore-comp overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/cfuse_workunit_misc} duration: 567.8782696723938 failure_reason: 'Command failed on smithi045 with status 22: ''sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=21a9546fcc66454f9424aac4849d43bc status: fail success: false 2023-06-23T01:22:19.133 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-23T01:22:19.226 INFO:teuthology.run:FAIL